-- Logs begin at Thu 2022-07-14 16:54:20 UTC, end at Thu 2022-07-14 18:16:56 UTC. -- Jul 14 17:38:39.985102 dv-cinder-849890-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 14 17:38:39.995313 dv-cinder-849890-1-smb devstack@keystone.service[86759]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 14 17:38:39.997189 dv-cinder-849890-1-smb devstack@keystone.service[86759]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 14 17:38:39 2022] *** Jul 14 17:38:39.997189 dv-cinder-849890-1-smb devstack@keystone.service[86759]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 14 17:38:39.997189 dv-cinder-849890-1-smb devstack@keystone.service[86759]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 14 17:38:39.997189 dv-cinder-849890-1-smb devstack@keystone.service[86759]: nodename: dv-cinder-849890-1-smb Jul 14 17:38:39.997189 dv-cinder-849890-1-smb devstack@keystone.service[86759]: machine: x86_64 Jul 14 17:38:39.997189 dv-cinder-849890-1-smb devstack@keystone.service[86759]: clock source: unix Jul 14 17:38:39.997189 dv-cinder-849890-1-smb devstack@keystone.service[86759]: pcre jit disabled Jul 14 17:38:39.997189 dv-cinder-849890-1-smb devstack@keystone.service[86759]: detected number of CPU cores: 4 Jul 14 17:38:39.997189 dv-cinder-849890-1-smb devstack@keystone.service[86759]: current working directory: / Jul 14 17:38:39.997189 dv-cinder-849890-1-smb devstack@keystone.service[86759]: detected binary path: /usr/bin/uwsgi-core Jul 14 17:38:39.997189 dv-cinder-849890-1-smb devstack@keystone.service[86759]: your processes number limit is 47680 Jul 14 17:38:39.997189 dv-cinder-849890-1-smb devstack@keystone.service[86759]: your memory page size is 4096 bytes Jul 14 17:38:39.997189 dv-cinder-849890-1-smb devstack@keystone.service[86759]: detected max file descriptor number: 2048 Jul 14 17:38:39.997189 dv-cinder-849890-1-smb devstack@keystone.service[86759]: lock engine: pthread robust mutexes Jul 14 17:38:39.998527 dv-cinder-849890-1-smb devstack@keystone.service[86759]: thunder lock: enabled Jul 14 17:38:39.998527 dv-cinder-849890-1-smb devstack@keystone.service[86759]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 14 17:38:39.998527 dv-cinder-849890-1-smb devstack@keystone.service[86759]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 14 17:38:40.042037 dv-cinder-849890-1-smb devstack@keystone.service[86759]: Python main interpreter initialized at 0x5614463799c0 Jul 14 17:38:40.042037 dv-cinder-849890-1-smb devstack@keystone.service[86759]: python threads support enabled Jul 14 17:38:40.042037 dv-cinder-849890-1-smb devstack@keystone.service[86759]: your server socket listen backlog is limited to 100 connections Jul 14 17:38:40.042037 dv-cinder-849890-1-smb devstack@keystone.service[86759]: your mercy for graceful operations on workers is 90 seconds Jul 14 17:38:40.042503 dv-cinder-849890-1-smb devstack@keystone.service[86759]: mapped 403077 bytes (393 KB) for 2 cores Jul 14 17:38:40.042503 dv-cinder-849890-1-smb devstack@keystone.service[86759]: *** Operational MODE: preforking *** Jul 14 17:38:40.042767 dv-cinder-849890-1-smb devstack@keystone.service[86759]: *** uWSGI is running in multiple interpreter mode *** Jul 14 17:38:40.042767 dv-cinder-849890-1-smb devstack@keystone.service[86759]: spawned uWSGI master process (pid: 86759) Jul 14 17:38:40.043040 dv-cinder-849890-1-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 14 17:38:40.043694 dv-cinder-849890-1-smb devstack@keystone.service[86759]: spawned uWSGI worker 1 (pid: 86772, cores: 1) Jul 14 17:38:40.047324 dv-cinder-849890-1-smb devstack@keystone.service[86759]: spawned uWSGI worker 2 (pid: 86773, cores: 1) Jul 14 17:38:40.047324 dv-cinder-849890-1-smb devstack@keystone.service[86759]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 14 17:38:45.601160 dv-cinder-849890-1-smb devstack@keystone.service[86773]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 17:38:45.601160 dv-cinder-849890-1-smb devstack@keystone.service[86773]: from cryptography.utils import int_from_bytes Jul 14 17:38:45.602408 dv-cinder-849890-1-smb devstack@keystone.service[86773]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 17:38:45.602408 dv-cinder-849890-1-smb devstack@keystone.service[86773]: from cryptography.utils import int_from_bytes Jul 14 17:38:45.625303 dv-cinder-849890-1-smb devstack@keystone.service[86772]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 17:38:45.625303 dv-cinder-849890-1-smb devstack@keystone.service[86772]: from cryptography.utils import int_from_bytes Jul 14 17:38:45.626343 dv-cinder-849890-1-smb devstack@keystone.service[86772]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 17:38:45.626343 dv-cinder-849890-1-smb devstack@keystone.service[86772]: from cryptography.utils import int_from_bytes Jul 14 17:38:45.652461 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 14 17:38:45.652743 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 14 17:38:45.652888 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] command line args: [] {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 14 17:38:45.653080 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 14 17:38:45.653264 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] ================================================================================ {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 14 17:38:45.653517 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] admin_token = **** {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:38:45.653792 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] config_dir = [] {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:38:45.653979 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:38:45.654161 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] config_source = [] {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:38:45.654344 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] debug = True {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:38:45.654542 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:38:45.654917 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:38:45.655080 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:38:45.655317 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:38:45.655563 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:38:45.655791 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] list_limit = None {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:38:45.655959 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] log_config_append = None {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:38:45.656116 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:38:45.656286 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] log_dir = None {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:38:45.656456 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] log_file = None {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:38:45.656684 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:38:45.656932 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:38:45.657176 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:38:45.657419 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:38:45.657659 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:38:45.657859 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:38:45.658048 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:38:45.658231 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:38:45.658471 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:38:45.658703 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:38:45.658933 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:38:45.659167 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:38:45.659413 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:38:45.659655 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:38:45.659930 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:38:45.660991 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.67/identity {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:38:45.661190 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] publish_errors = False {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:38:45.661423 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:38:45.661719 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:38:45.661913 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:38:45.662133 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:38:45.662367 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:38:45.662600 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] standard_threads = False {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:38:45.662828 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:38:45.663071 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:38:45.663264 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:38:45.663458 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] use_journal = False {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:38:45.663640 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] use_json = False {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:38:45.663824 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] use_stderr = False {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:38:45.664000 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] use_syslog = False {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:38:45.664187 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:38:45.664369 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.664583 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.664842 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.665079 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.665324 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.665596 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.665850 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.666085 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.666332 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.666577 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.666827 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.667060 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.667304 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.667538 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.667782 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.668026 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.668259 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.668512 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.668764 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.669008 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.669242 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.669495 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.669790 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.670042 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.670289 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.670520 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.670752 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.671020 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.671260 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.671509 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.671752 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.671982 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.672209 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.672454 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.672697 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.672932 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.673190 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.673383 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.673659 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.673894 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.674121 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.674348 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.674575 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.674804 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.675040 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.675208 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 14 17:38:45.675367 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 14 17:38:45.675555 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.675739 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] command line args: [] {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 14 17:38:45.675922 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.676101 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 14 17:38:45.676295 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.676477 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] ================================================================================ {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 14 17:38:45.676677 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.676868 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] admin_token = **** {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:38:45.677066 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.677256 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] config_dir = [] {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:38:45.677446 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.677655 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:38:45.677857 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.678052 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] config_source = [] {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:38:45.678234 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.678422 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] debug = True {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:38:45.678599 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.678778 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:38:45.678993 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.679188 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:38:45.679188 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:38:45.679534 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.679715 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:38:45.679909 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.679909 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.680272 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:38:45.680461 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.680638 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] list_limit = None {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:38:45.680638 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] log_config_append = None {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:38:45.680997 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.681198 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:38:45.681387 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.681604 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] log_dir = None {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:38:45.681604 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] log_file = None {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:38:45.681943 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.681943 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.682405 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:38:45.682405 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:38:45.682761 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.682761 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.683086 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:38:45.683279 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.683462 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:38:45.683462 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:38:45.683826 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.684003 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:38:45.684198 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.684386 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:38:45.684565 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.684748 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:38:45.684932 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.685119 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:38:45.685320 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.685506 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:38:45.685707 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.685903 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:38:45.686084 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.686251 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:38:45.686451 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.686634 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:38:45.686811 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.687001 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:38:45.687001 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:38:45.687335 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.687335 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.687335 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.687846 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.67/identity {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:38:45.687846 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] publish_errors = False {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:38:45.688196 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.688378 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:38:45.688556 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.688737 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:38:45.688924 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.689106 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:38:45.689399 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.689623 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:38:45.689869 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.690044 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:38:45.690224 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.690406 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] standard_threads = False {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:38:45.690601 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.690785 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:38:45.690965 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.691152 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:38:45.691343 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.691529 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:38:45.691529 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] use_journal = False {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:38:45.691884 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.692067 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] use_json = False {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:38:45.692256 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.692448 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] use_stderr = False {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:38:45.692626 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.692823 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] use_syslog = False {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:38:45.693018 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.693198 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 17:38:45.693384 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.693592 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.693774 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.693979 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.694161 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.694340 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.694531 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.694710 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.694890 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.695085 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.695268 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.695447 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.695628 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.695845 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.696042 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.696238 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.696418 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.696599 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.696780 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.696954 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.697119 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.697294 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.697635 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.697803 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.697970 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.698136 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.698302 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] auth.external = None {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.698480 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.698646 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.698850 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.699030 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.699209 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.699386 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.699575 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.699768 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] auth.password = None {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.699952 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.700134 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] auth.token = None {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.700314 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.700493 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.700674 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.700869 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.701052 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.701234 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.701413 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.701633 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.701818 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.702013 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.702013 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.702356 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.702632 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.702818 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.703014 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] credential.caching = True {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.703210 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.703386 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.703572 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.703753 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.703933 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.703933 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.704283 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.704283 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.704635 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.704818 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.704996 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.705192 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.705379 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.705379 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.705759 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.705941 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.706126 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.706330 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.706515 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.706695 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.706875 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.707057 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.707717 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.707916 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.708097 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.708278 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.708456 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.708636 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.708816 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.709001 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.709187 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.709370 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.709573 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] federation.caching = True {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.709772 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.709958 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.710259 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.710564 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.710768 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.710963 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.711145 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.711324 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.711507 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.711699 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.711883 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.712064 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.712259 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.712442 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.712627 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.712827 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.713063 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.713258 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.713440 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.713807 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.713991 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.714200 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.714383 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.714566 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] identity.caching = True {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.714747 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.714930 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.715111 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.715303 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.715488 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.715672 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.715857 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.716041 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.716223 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.716417 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.716598 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.716777 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.716960 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.717186 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.717381 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.717587 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.717769 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.717973 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.718169 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.718352 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.718533 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.718715 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.718900 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.719097 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.719280 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.719461 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.719644 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.719827 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.720020 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.720224 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.720404 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.720568 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.720734 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.720933 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.721123 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.721316 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.721499 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.721702 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.721884 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.722060 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.722237 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.722438 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.722633 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.722815 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.723608 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.723801 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.723985 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.724183 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.724369 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.724561 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.724743 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.724927 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.725110 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.725305 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.725485 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.725779 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.725962 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.726144 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.726330 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.726527 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.726726 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.726929 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.727110 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.727291 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.727473 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.727666 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.727850 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.728031 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.728226 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.728464 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.728648 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.728843 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.729028 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.729221 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.729411 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.729615 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.729798 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.730000 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.730000 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.730388 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.730570 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.730752 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.730931 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.731126 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.731317 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.731500 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.731718 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.731918 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.732099 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.732394 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.732583 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.732776 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.732960 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.733147 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.733333 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.733333 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.733723 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.733903 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.734086 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.734269 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] ldap.user = None {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.734453 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.734654 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.734840 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] auth.external = None {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.735021 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.735204 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.735387 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.735569 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.735772 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.735954 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.736136 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.736319 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] auth.password = None {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.736504 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.736689 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] auth.token = None {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.736884 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.737068 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.737247 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.737431 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.737634 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.737840 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.738024 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.738208 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.738389 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.738575 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.739005 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.739194 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.739371 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.739549 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.739722 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.739894 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] credential.caching = True {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.740070 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.740258 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.740438 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.740438 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.740775 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.740957 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.741152 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.741335 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.741513 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.741739 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.741915 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.742093 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.742273 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.742469 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.742640 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.742816 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.742995 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.743176 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.743352 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.743541 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.743726 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.743905 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.744076 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.744253 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.744253 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.744602 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.744785 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.744962 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.745137 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.745314 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.745487 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.745715 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.745892 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.746073 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] federation.caching = True {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.746251 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.746432 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.746619 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.746806 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.746978 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.747156 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.747312 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.747461 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.747630 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] resource.caching = True {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.747819 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.747997 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.748179 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.748357 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.748537 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.748718 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.748906 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.749085 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.749258 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.749440 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.749721 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.749899 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.750097 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.750279 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.750465 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] identity.caching = True {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.750650 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.750836 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.751008 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.751201 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.751380 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] role.caching = True {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.751562 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.751740 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] role.driver = sql {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.751932 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.752114 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.752302 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.752476 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.752655 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.752832 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.753008 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.753186 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.753377 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.753668 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.753869 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.754048 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.754220 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.754398 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.754591 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.754772 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.754951 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.755132 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.755314 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.755508 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.755693 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.755883 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.756046 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.756213 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.756380 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.756567 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.756741 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.756916 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.757101 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.757101 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.757439 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.757664 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.757858 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.758035 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.758216 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.758395 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.758573 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.758767 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.758950 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.759129 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.759307 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.759486 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.759663 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.759851 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.760041 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.760215 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.760387 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.760561 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.760737 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.760931 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.761108 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.761282 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.761595 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.761595 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.761937 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.762136 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.762316 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.762500 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.762682 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.762682 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.763020 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.763020 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.763380 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.763571 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.763752 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.763924 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.764107 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.764297 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] token.caching = True {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.764472 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.764648 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.764827 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.765006 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.765185 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.765372 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.765580 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.765757 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.765926 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.766091 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.766260 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.766448 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.766632 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.766632 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.766968 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.766968 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.767304 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.767592 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.767773 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.767950 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.768129 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.768303 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.768479 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.768668 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.768847 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.769020 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.769198 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] ldap.user = None {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.769377 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.769602 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.770282 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.770464 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.770641 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.770822 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.770989 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.771170 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.771170 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.771518 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] database.connection = **** {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.771709 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.771906 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.772088 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.772263 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.772443 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.772635 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.772835 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.773017 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.773196 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.773374 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.773585 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.773794 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.773971 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.774149 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.774331 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.774512 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.774695 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.774890 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.774890 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.775223 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.775399 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.775579 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.775763 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.775959 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.776149 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.776335 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.776514 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.776696 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.776875 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.777069 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.777252 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.777437 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.777721 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.777908 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.778087 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.778282 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.778462 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 14 17:38:45.778646 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.778646 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.778646 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.778646 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.778646 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.778646 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.778646 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.778646 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.778646 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.780104 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.780104 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.780104 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.780104 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.780104 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] resource.caching = True {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.780104 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.780104 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.780104 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.780104 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.781589 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.781589 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.781589 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.781589 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.781589 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.781589 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] role.caching = True {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.781589 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] role.driver = sql {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.781589 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.781589 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.783070 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.783070 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.783070 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.783070 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.783070 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.783070 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.783070 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.783070 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.783070 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.784533 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.784533 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.784533 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.784533 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.784533 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.784533 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.784533 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.784533 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.786551 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.786551 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.786551 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.786551 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.786551 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.786551 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.786551 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.786551 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.786551 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.788023 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.788023 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.788023 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.788023 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.788023 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.788023 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] token.caching = True {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.788023 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.788023 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.788023 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.789498 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.789498 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.789498 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.789498 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.789498 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.789498 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.789498 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.789498 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.789498 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.791087 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.791087 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.791087 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.791087 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.791087 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.791087 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] database.connection = **** {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.791087 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.791087 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.791087 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.792563 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.792563 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.792563 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.792563 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.792563 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.792563 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.792563 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.792563 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.792563 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.794048 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.794048 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.794048 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.794048 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.794048 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.794048 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 17:38:45.794048 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 14 17:38:45.795206 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86773) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:38:45.795206 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86773) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:38:45.795206 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86773) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:38:45.795206 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86773) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:38:45.795973 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86772) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:38:45.795973 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86772) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:38:45.795973 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86772) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:38:45.797922 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86772) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:38:45.810067 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86773) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:38:45.810325 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86773) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:38:45.816619 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86772) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:38:45.817372 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86772) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:38:45.865982 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86772) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:38:45.955319 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86773) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:38:45.995257 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86773) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:38:45.995499 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86773) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:38:46.010760 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86772) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:38:46.011015 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86772) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:38:46.065576 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86773) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:38:46.065874 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86772) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:38:46.066018 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86773) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:38:46.066158 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86772) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:38:46.066285 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86773) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:38:46.066422 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86772) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:38:46.067055 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86773) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:38:46.067194 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86772) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:38:46.067317 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86773) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:38:46.067317 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86773) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:38:46.067458 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86772) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:38:46.067458 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86772) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:38:46.092463 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86772) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:38:46.092716 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86773) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:38:46.092864 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86772) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:38:46.093001 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86773) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:38:46.093143 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86772) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:38:46.093310 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86773) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:38:46.093447 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86772) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:38:46.093628 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86773) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:38:46.093770 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86772) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:38:46.093906 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86773) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:38:46.094063 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86772) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:38:46.094201 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86773) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:38:46.094336 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86772) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:38:46.094472 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86773) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:38:46.105498 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86772) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:38:46.105821 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86773) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:38:46.119350 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86773) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:38:46.119583 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86772) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:38:46.119707 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86773) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:38:46.119827 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86772) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:38:46.120136 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86773) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:38:46.120288 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86772) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:38:46.120410 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86773) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:38:46.120525 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86772) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:38:46.120640 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86773) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:38:46.120754 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86772) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:38:46.120882 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86773) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:38:46.120997 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86772) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:38:46.121116 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86773) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:38:46.121229 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86772) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 17:38:46.139699 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.139988 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.139988 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 14 17:38:46.140210 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 14 17:38:46.140325 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.140431 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.140559 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 14 17:38:46.140682 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.140792 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 14 17:38:46.140900 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.141009 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.141164 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.141295 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.141409 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.141563 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.141728 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.153614 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.153909 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.154177 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.154457 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.155271 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.155569 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.155838 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.156116 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.162996 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86773) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 17:38:46.164520 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86772) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 17:38:46.166648 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86773) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 17:38:46.167010 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.167353 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.167701 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.167973 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86772) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 17:38:46.168071 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.168260 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.168409 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.168685 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.168770 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.168974 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.169163 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.169256 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.169508 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.169614 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.169812 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.169963 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.170091 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.170346 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.170453 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.170625 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.170891 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.198160 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.198405 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.199848 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86773) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 17:38:46.200006 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86772) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 17:38:46.200129 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.200294 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.205547 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86773) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 17:38:46.205781 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86772) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 17:38:46.205906 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.206028 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.206150 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.206270 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.214331 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86773) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 17:38:46.214587 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86772) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 17:38:46.214707 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.214835 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.219263 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86773) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 17:38:46.219437 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86772) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 17:38:46.219598 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.219715 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.219840 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.219969 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.220090 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.220241 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.220358 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.220480 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.220610 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.220730 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.220866 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.220986 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.221108 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.221231 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.240965 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.241195 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.241357 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.241474 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.245978 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86773) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 17:38:46.246140 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86772) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 17:38:46.249627 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.249792 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.249943 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.250062 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.255593 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86772) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 17:38:46.255762 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86773) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 17:38:46.259245 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86772) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 17:38:46.259421 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86773) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 17:38:46.263113 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.263264 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.263425 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.263572 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.263690 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.263814 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.263976 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.264094 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.264262 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.264381 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.264539 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.264658 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.284317 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86773) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 17:38:46.284655 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86772) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 17:38:46.284786 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.284914 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.285039 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.285165 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.285368 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.285635 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.293211 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.293441 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.294980 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.295105 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.295262 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.295399 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.298405 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86772) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 17:38:46.298540 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86773) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 17:38:46.298700 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.298820 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.298964 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.299080 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.299249 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.299367 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.299508 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.299624 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.312961 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86773) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 17:38:46.313169 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86772) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 17:38:46.313300 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.313449 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.313592 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.313720 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.313849 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.313973 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.314115 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.314235 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.314358 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.314483 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.314606 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.314731 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.333878 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86772) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 17:38:46.335073 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86773) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 17:38:46.337199 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86772) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 17:38:46.338575 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86773) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 17:38:46.340564 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.342121 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.342280 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.343841 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86772) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 17:38:46.343990 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.344120 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.344395 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.345919 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86773) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 17:38:46.346312 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.346664 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.352110 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.353785 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86772) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 17:38:46.354581 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.356292 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86773) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 17:38:46.357016 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.357315 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.357626 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.357900 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.359895 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.360253 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.360600 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.360933 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.368028 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86772) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 17:38:46.368320 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.368602 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.371346 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86773) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 17:38:46.371714 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.372058 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.376580 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86772) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 17:38:46.376863 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.377167 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.377429 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.377717 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.377989 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.378276 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.378550 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.378830 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.379157 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.379923 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.380186 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.380460 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.380727 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86772) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.381784 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86773) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 17:38:46.382140 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.382973 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.382973 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.383359 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.383707 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.384053 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.384397 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.384914 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.385266 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.385655 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.385997 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.386330 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.386662 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86773) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 17:38:46.419852 dv-cinder-849890-1-smb devstack@keystone.service[86772]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5614463799c0 pid: 86772 (default app) Jul 14 17:38:46.423478 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c647e1-2f0d-4c18-a419-e38937f78b23 None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:38:46.423726 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c647e1-2f0d-4c18-a419-e38937f78b23 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:38:46.424011 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c647e1-2f0d-4c18-a419-e38937f78b23 None None] PATH_INFO: `/v3` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:38:46.425397 dv-cinder-849890-1-smb devstack@keystone.service[86773]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5614463799c0 pid: 86773 (default app) Jul 14 17:38:46.428857 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1/1] 10.222.0.67 () {50 vars in 791 bytes} [Thu Jul 14 17:38:46 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:38:54.526694 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d101ed1e-ca91-4794-9f72-53e7199d1db1 None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:38:54.527296 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d101ed1e-ca91-4794-9f72-53e7199d1db1 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:38:54.527296 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d101ed1e-ca91-4794-9f72-53e7199d1db1 None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:38:54.531620 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1/2] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:38:54 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 17:38:54.538159 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02b744c-3d1e-409d-b36d-f168009a3d7a None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:38:54.538699 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02b744c-3d1e-409d-b36d-f168009a3d7a None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:38:54.538699 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02b744c-3d1e-409d-b36d-f168009a3d7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:38:54.607059 dv-cinder-849890-1-smb devstack@keystone.service[86772]: INFO dbcounter [None req-c02b744c-3d1e-409d-b36d-f168009a3d7a None None] Registered counter for database keystone Jul 14 17:38:54.629817 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG oslo_db.sqlalchemy.engines [None req-c02b744c-3d1e-409d-b36d-f168009a3d7a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86772) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 17:38:54.636338 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writer thread running {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 17:38:54.824473 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG passlib.handlers.bcrypt [None req-c02b744c-3d1e-409d-b36d-f168009a3d7a None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=86772) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 14 17:38:54.824813 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG passlib.handlers.bcrypt [None req-c02b744c-3d1e-409d-b36d-f168009a3d7a None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86772) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 14 17:38:54.884110 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-c02b744c-3d1e-409d-b36d-f168009a3d7a None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:38:54.885880 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-c02b744c-3d1e-409d-b36d-f168009a3d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:38:55.029600 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 2/3] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:38:54 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 492 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 14 17:38:55.225048 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d101ed1e-ca91-4794-9f72-53e7199d1db1 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:38:55.296151 dv-cinder-849890-1-smb devstack@keystone.service[86773]: INFO dbcounter [None req-d101ed1e-ca91-4794-9f72-53e7199d1db1 None None] Registered counter for database keystone Jul 14 17:38:55.318316 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG oslo_db.sqlalchemy.engines [None req-d101ed1e-ca91-4794-9f72-53e7199d1db1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86773) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 17:38:55.325346 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writer thread running {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 17:38:55.456149 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d101ed1e-ca91-4794-9f72-53e7199d1db1 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:38:55.461468 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b871c3-ffa0-4d3d-93cf-e984b77535ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:38:55.462208 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b871c3-ffa0-4d3d-93cf-e984b77535ff admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:38:55.462495 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b871c3-ffa0-4d3d-93cf-e984b77535ff admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:38:55.462776 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b871c3-ffa0-4d3d-93cf-e984b77535ff admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:38:55.472485 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b871c3-ffa0-4d3d-93cf-e984b77535ff admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:38:55.526829 dv-cinder-849890-1-smb devstack@keystone.service[86773]: WARNING keystone.common.rbac_enforcer.enforcer [None req-e3b871c3-ffa0-4d3d-93cf-e984b77535ff admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 14 17:38:55.527477 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b871c3-ffa0-4d3d-93cf-e984b77535ff admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:38:55.539153 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 2/4] 10.222.0.67 () {58 vars in 1324 bytes} [Thu Jul 14 17:38:55 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 17:38:55.545439 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02b744c-3d1e-409d-b36d-f168009a3d7a None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:38:55.562469 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02b744c-3d1e-409d-b36d-f168009a3d7a None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:38:55.567483 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64edd7c7-9b00-460a-a7cd-acc345fafa1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:38:55.568700 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64edd7c7-9b00-460a-a7cd-acc345fafa1c admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:38:55.568993 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64edd7c7-9b00-460a-a7cd-acc345fafa1c admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:38:55.569274 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64edd7c7-9b00-460a-a7cd-acc345fafa1c admin admin] PATH_INFO: `/v3/projects/cbe4032be1b14bfe82df97ec9e98e7c0` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:38:55.571078 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64edd7c7-9b00-460a-a7cd-acc345fafa1c admin admin] RBAC: Authorizing `identity:get_project(project_id=cbe4032be1b14bfe82df97ec9e98e7c0)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:38:55.625462 dv-cinder-849890-1-smb devstack@keystone.service[86772]: WARNING keystone.common.rbac_enforcer.enforcer [None req-64edd7c7-9b00-460a-a7cd-acc345fafa1c admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 14 17:38:55.625843 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64edd7c7-9b00-460a-a7cd-acc345fafa1c admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:38:55.633031 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 3/5] 10.222.0.67 () {56 vars in 1207 bytes} [Thu Jul 14 17:38:55 2022] GET /identity/v3/projects/cbe4032be1b14bfe82df97ec9e98e7c0 => generated 344 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:38:57.809123 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462a8985-42da-4069-9b1b-88f8919dc0b9 None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:38:57.809695 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462a8985-42da-4069-9b1b-88f8919dc0b9 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:38:57.809695 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462a8985-42da-4069-9b1b-88f8919dc0b9 None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:38:57.813788 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 3/6] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:38:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:38:57.819781 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f882057-8e16-4764-b4ad-47c6900c8c56 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:38:57.820294 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f882057-8e16-4764-b4ad-47c6900c8c56 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:38:57.820432 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f882057-8e16-4764-b4ad-47c6900c8c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:38:57.840061 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-4f882057-8e16-4764-b4ad-47c6900c8c56 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:38:57.841664 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-4f882057-8e16-4764-b4ad-47c6900c8c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:38:57.850359 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 4/7] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:38:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 14 17:38:57.874422 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462a8985-42da-4069-9b1b-88f8919dc0b9 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:38:57.891042 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462a8985-42da-4069-9b1b-88f8919dc0b9 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:38:57.895867 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f6428b-fd25-473f-b6da-d2fd5dd6c49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:38:57.896524 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f6428b-fd25-473f-b6da-d2fd5dd6c49c admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:38:57.896812 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f6428b-fd25-473f-b6da-d2fd5dd6c49c admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:38:57.897093 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f6428b-fd25-473f-b6da-d2fd5dd6c49c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:38:57.905669 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f6428b-fd25-473f-b6da-d2fd5dd6c49c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:38:57.907503 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f6428b-fd25-473f-b6da-d2fd5dd6c49c admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:38:57.917936 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 4/8] 10.222.0.67 () {58 vars in 1324 bytes} [Thu Jul 14 17:38:57 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 17:38:57.925404 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f882057-8e16-4764-b4ad-47c6900c8c56 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:38:57.938549 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f882057-8e16-4764-b4ad-47c6900c8c56 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:38:57.944703 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a4080a-6754-42dc-87a8-dc262b73d303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:38:57.945829 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a4080a-6754-42dc-87a8-dc262b73d303 admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:38:57.946203 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a4080a-6754-42dc-87a8-dc262b73d303 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:38:57.946684 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a4080a-6754-42dc-87a8-dc262b73d303 admin admin] PATH_INFO: `/v3/users/7ce563cc32c246e59d48c2a6266075e2` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:38:57.948457 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a4080a-6754-42dc-87a8-dc262b73d303 admin admin] RBAC: Authorizing `identity:get_user(user_id=7ce563cc32c246e59d48c2a6266075e2)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:38:57.951298 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a4080a-6754-42dc-87a8-dc262b73d303 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:38:57.953409 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 5/9] 10.222.0.67 () {56 vars in 1198 bytes} [Thu Jul 14 17:38:57 2022] GET /identity/v3/users/7ce563cc32c246e59d48c2a6266075e2 => generated 247 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:00.093010 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d90999b-86c2-4384-b22c-40a401ab1333 None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:00.096361 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d90999b-86c2-4384-b22c-40a401ab1333 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:00.096361 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d90999b-86c2-4384-b22c-40a401ab1333 None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:00.096361 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 5/10] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:39:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:39:00.100753 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c433e2-0fc6-43cc-ad6d-155e3cee11ba None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:00.101227 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c433e2-0fc6-43cc-ad6d-155e3cee11ba None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:00.101425 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c433e2-0fc6-43cc-ad6d-155e3cee11ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:00.119381 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-d6c433e2-0fc6-43cc-ad6d-155e3cee11ba None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:39:00.120569 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-d6c433e2-0fc6-43cc-ad6d-155e3cee11ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:39:00.169692 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7999f342-3375-4a41-8c8d-06aee389287c None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:00.169984 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7999f342-3375-4a41-8c8d-06aee389287c None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:00.170370 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7999f342-3375-4a41-8c8d-06aee389287c None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:00.171766 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 6/11] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:39:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:39:00.177959 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf488c-f443-425f-892b-f62cf2043381 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:00.178257 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf488c-f443-425f-892b-f62cf2043381 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:00.178533 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf488c-f443-425f-892b-f62cf2043381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:00.206262 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 6/12] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:39:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:39:00.220048 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG passlib.handlers.bcrypt [None req-33cf488c-f443-425f-892b-f62cf2043381 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=86773) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 14 17:39:00.220468 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG passlib.handlers.bcrypt [None req-33cf488c-f443-425f-892b-f62cf2043381 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86773) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 14 17:39:00.229588 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c433e2-0fc6-43cc-ad6d-155e3cee11ba None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:00.254418 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:00.267268 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-33cf488c-f443-425f-892b-f62cf2043381 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:39:00.268967 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-33cf488c-f443-425f-892b-f62cf2043381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:39:00.340217 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c433e2-0fc6-43cc-ad6d-155e3cee11ba None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:00.386287 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd6ae92-ef97-452e-b88b-19e3c51a2fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:00.387370 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 7/13] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:39:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 17:39:00.388774 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd6ae92-ef97-452e-b88b-19e3c51a2fcf None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:00.388774 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd6ae92-ef97-452e-b88b-19e3c51a2fcf None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:00.388774 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd6ae92-ef97-452e-b88b-19e3c51a2fcf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:00.401358 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd6ae92-ef97-452e-b88b-19e3c51a2fcf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:39:00.409987 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cf488c-f443-425f-892b-f62cf2043381 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:00.413410 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-cdd6ae92-ef97-452e-b88b-19e3c51a2fcf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 17:39:00.413410 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:39:00.413410 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:39:00.413410 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:39:00.413410 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:39:00.413410 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:39:00.413410 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:39:00.413410 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:39:00.413410 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:39:00.413410 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:39:00.413410 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:39:00.413410 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:39:00.413410 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:39:00.413410 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:39:00.413410 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:39:00.413410 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:39:00.414432 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:39:00.414432 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:39:00.414432 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:39:00.414432 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:39:00.414432 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:39:00.414432 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:39:00.414432 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:39:00.414432 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:39:00.414432 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:39:00.414432 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:39:00.414432 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:39:00.414432 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:39:00.414432 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:39:00.414432 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:39:00.414432 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:39:00.414432 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:39:00.415249 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:39:00.415249 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:39:00.415249 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:39:00.415249 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:39:00.415249 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:39:00.415249 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:39:00.415249 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:39:00.415249 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:39:00.415249 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:39:00.415249 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:39:00.415249 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 17:39:00.415249 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:39:00.415249 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 7/14] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 14 17:39:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 17:39:00.421115 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd6ae92-ef97-452e-b88b-19e3c51a2fcf None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:00.518490 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:00.531968 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cf488c-f443-425f-892b-f62cf2043381 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:00.534407 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:00.541223 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd6ae92-ef97-452e-b88b-19e3c51a2fcf None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:00.577700 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed74cd4-0d74-48c3-8a1e-2c09305e32c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:00.578654 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed74cd4-0d74-48c3-8a1e-2c09305e32c5 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:00.578936 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed74cd4-0d74-48c3-8a1e-2c09305e32c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:00.579211 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed74cd4-0d74-48c3-8a1e-2c09305e32c5 None admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:00.579975 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed74cd4-0d74-48c3-8a1e-2c09305e32c5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:39:00.580146 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4943815e-b43b-4463-82e9-40f65169d90f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:00.580267 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed74cd4-0d74-48c3-8a1e-2c09305e32c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:00.581702 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed74cd4-0d74-48c3-8a1e-2c09305e32c5 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:00.581829 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943815e-b43b-4463-82e9-40f65169d90f None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:00.582227 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943815e-b43b-4463-82e9-40f65169d90f None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:00.583285 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943815e-b43b-4463-82e9-40f65169d90f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:00.594751 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 8/15] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 14 17:39:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:39:00.600867 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed74cd4-0d74-48c3-8a1e-2c09305e32c5 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:00.657253 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4943815e-b43b-4463-82e9-40f65169d90f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:00.658751 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4943815e-b43b-4463-82e9-40f65169d90f None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:00.761047 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed74cd4-0d74-48c3-8a1e-2c09305e32c5 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:00.764214 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 8/16] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 14 17:39:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 17:39:00.769781 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4943815e-b43b-4463-82e9-40f65169d90f None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:00.772801 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:00.812342 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a066178-c57a-4d52-9bb3-adf408596bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:00.813237 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a066178-c57a-4d52-9bb3-adf408596bc1 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:00.813548 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a066178-c57a-4d52-9bb3-adf408596bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:00.813834 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a066178-c57a-4d52-9bb3-adf408596bc1 None admin] PATH_INFO: `/v3/users/7ce563cc32c246e59d48c2a6266075e2` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:00.815075 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a066178-c57a-4d52-9bb3-adf408596bc1 None admin] RBAC: Authorizing `identity:get_user(user_id=7ce563cc32c246e59d48c2a6266075e2)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:00.816565 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a066178-c57a-4d52-9bb3-adf408596bc1 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:00.818901 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 9/17] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 14 17:39:00 2022] GET /identity/v3/users/7ce563cc32c246e59d48c2a6266075e2 => generated 247 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:39:00.824414 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a066178-c57a-4d52-9bb3-adf408596bc1 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:00.841552 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:00.918270 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4943815e-b43b-4463-82e9-40f65169d90f None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:00.939465 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a066178-c57a-4d52-9bb3-adf408596bc1 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:00.958804 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcea090-121c-4843-866a-8c9d84610f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:00.959719 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcea090-121c-4843-866a-8c9d84610f1b None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:00.960100 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcea090-121c-4843-866a-8c9d84610f1b None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:00.960440 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcea090-121c-4843-866a-8c9d84610f1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:00.979943 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b2f803-2157-4ef8-a6c7-63d967db0411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:00.980761 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b2f803-2157-4ef8-a6c7-63d967db0411 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:00.981042 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b2f803-2157-4ef8-a6c7-63d967db0411 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:00.981324 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b2f803-2157-4ef8-a6c7-63d967db0411 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:00.982613 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b2f803-2157-4ef8-a6c7-63d967db0411 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:00.984125 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b2f803-2157-4ef8-a6c7-63d967db0411 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:00.984486 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcea090-121c-4843-866a-8c9d84610f1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:00.985830 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 10/18] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:39:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:39:00.986093 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcea090-121c-4843-866a-8c9d84610f1b None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:00.991977 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b2f803-2157-4ef8-a6c7-63d967db0411 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:01.011033 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-bdcea090-121c-4843-866a-8c9d84610f1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:39:01.011033 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:39:01.011033 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:39:01.011033 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:39:01.011033 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:39:01.011033 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:39:01.011033 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:39:01.011033 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:39:01.011033 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:39:01.011033 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:39:01.011033 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:39:01.011033 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:39:01.011033 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:39:01.011033 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:39:01.011033 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:39:01.012463 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:39:01.012463 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:39:01.012463 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:39:01.012463 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:39:01.012463 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:39:01.012463 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:39:01.012463 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:39:01.012463 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:39:01.012463 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:39:01.012463 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:39:01.012463 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:39:01.012463 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:39:01.012463 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:39:01.012463 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:39:01.012463 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:39:01.012463 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:39:01.012463 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:39:01.014081 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:39:01.014081 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:39:01.014081 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:39:01.014081 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:39:01.014081 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 9/19] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:39:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 17:39:01.021236 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcea090-121c-4843-866a-8c9d84610f1b None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:01.081926 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:01.095934 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:01.119387 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b2f803-2157-4ef8-a6c7-63d967db0411 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:01.143923 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcea090-121c-4843-866a-8c9d84610f1b None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:01.169505 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e3e5c7-b5e5-4ebd-9adf-a8b792cb8c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:01.170131 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e3e5c7-b5e5-4ebd-9adf-a8b792cb8c30 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:01.170416 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e3e5c7-b5e5-4ebd-9adf-a8b792cb8c30 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:01.170694 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e3e5c7-b5e5-4ebd-9adf-a8b792cb8c30 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:01.171544 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e3e5c7-b5e5-4ebd-9adf-a8b792cb8c30 None admin] RBAC: Adding query filter params (role.id=4651a1cc7b4d4ab7a7a9ca1e77e58e71, scope.domain.id=default, user.id=7ce563cc32c246e59d48c2a6266075e2) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:39:01.171859 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e3e5c7-b5e5-4ebd-9adf-a8b792cb8c30 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:01.173314 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e3e5c7-b5e5-4ebd-9adf-a8b792cb8c30 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:01.181633 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 11/20] 10.222.0.67 () {56 vars in 1322 bytes} [Thu Jul 14 17:39:00 2022] GET /identity/v3/role_assignments?user.id=7ce563cc32c246e59d48c2a6266075e2&scope.domain.id=default&role.id=4651a1cc7b4d4ab7a7a9ca1e77e58e71 => generated 233 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:39:01.186161 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981eeb09-603f-4c1f-a974-034022a53f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:01.186860 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981eeb09-603f-4c1f-a974-034022a53f8d None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:01.187145 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981eeb09-603f-4c1f-a974-034022a53f8d None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:01.187425 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981eeb09-603f-4c1f-a974-034022a53f8d None admin] PATH_INFO: `/v3/domains` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:01.188210 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981eeb09-603f-4c1f-a974-034022a53f8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:39:01.188521 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981eeb09-603f-4c1f-a974-034022a53f8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:01.190078 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981eeb09-603f-4c1f-a974-034022a53f8d None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:01.211311 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 10/21] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 14 17:39:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:39:03.744762 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a31e27-925e-470e-8961-335813586268 None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:03.745920 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a31e27-925e-470e-8961-335813586268 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:03.746582 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a31e27-925e-470e-8961-335813586268 None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:03.749285 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 12/22] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:39:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:39:03.756810 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5162516-685a-42df-9731-1dcc7b86744e None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:03.758042 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5162516-685a-42df-9731-1dcc7b86744e None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:03.758642 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5162516-685a-42df-9731-1dcc7b86744e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:03.793690 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-d5162516-685a-42df-9731-1dcc7b86744e None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:39:03.795988 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-d5162516-685a-42df-9731-1dcc7b86744e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:39:03.904244 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 11/23] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:39:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:39:03.934762 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a31e27-925e-470e-8961-335813586268 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:04.063538 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a31e27-925e-470e-8961-335813586268 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:04.111092 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7d2a60-7ab5-46f3-b439-b60b805c208c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:04.112215 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d2a60-7ab5-46f3-b439-b60b805c208c None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:04.112656 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d2a60-7ab5-46f3-b439-b60b805c208c None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:04.113078 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d2a60-7ab5-46f3-b439-b60b805c208c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:04.128146 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff3105-80b0-4dec-ac66-4c79664e2d1f None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:04.128674 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff3105-80b0-4dec-ac66-4c79664e2d1f None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:04.129117 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff3105-80b0-4dec-ac66-4c79664e2d1f None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:04.131296 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 12/24] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:39:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 17:39:04.137251 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c864e1-1d4b-4834-bb75-1eda3bc1db5b None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:04.137785 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c864e1-1d4b-4834-bb75-1eda3bc1db5b None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:04.138209 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c864e1-1d4b-4834-bb75-1eda3bc1db5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:04.147447 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7d2a60-7ab5-46f3-b439-b60b805c208c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:39:04.155404 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-af7d2a60-7ab5-46f3-b439-b60b805c208c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 17:39:04.155404 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:39:04.155404 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:39:04.155404 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:39:04.155404 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:39:04.155404 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:39:04.155404 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:39:04.155404 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:39:04.155404 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:39:04.155404 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:39:04.155404 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:39:04.155404 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:39:04.155404 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:39:04.155404 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:39:04.155404 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:39:04.155404 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:39:04.156332 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:39:04.156332 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:39:04.156332 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:39:04.156332 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:39:04.156332 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:39:04.156332 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:39:04.156332 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:39:04.156332 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:39:04.156332 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:39:04.156332 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:39:04.156332 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:39:04.156332 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:39:04.156332 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:39:04.156332 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:39:04.156332 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:39:04.156332 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:39:04.157106 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:39:04.157106 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:39:04.157106 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:39:04.157106 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:39:04.157106 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:39:04.157106 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:39:04.157106 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:39:04.157106 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:39:04.157106 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:39:04.157106 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:39:04.157106 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 17:39:04.157106 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:39:04.157106 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 13/25] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 14 17:39:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:39:04.167149 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7d2a60-7ab5-46f3-b439-b60b805c208c None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:04.170739 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:04.180103 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-f3c864e1-1d4b-4834-bb75-1eda3bc1db5b None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:39:04.181728 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-f3c864e1-1d4b-4834-bb75-1eda3bc1db5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:39:04.299993 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:04.360251 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 13/26] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:39:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:39:04.391843 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7d2a60-7ab5-46f3-b439-b60b805c208c None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:04.406402 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c864e1-1d4b-4834-bb75-1eda3bc1db5b None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:04.481356 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8527d5a9-bdda-4584-b856-1a254bd8bb2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:04.486417 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8527d5a9-bdda-4584-b856-1a254bd8bb2b None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:04.486833 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8527d5a9-bdda-4584-b856-1a254bd8bb2b None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:04.487109 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8527d5a9-bdda-4584-b856-1a254bd8bb2b None admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:04.488020 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8527d5a9-bdda-4584-b856-1a254bd8bb2b None admin] RBAC: Adding query filter params (name=admin) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:39:04.488337 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8527d5a9-bdda-4584-b856-1a254bd8bb2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:04.490142 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8527d5a9-bdda-4584-b856-1a254bd8bb2b None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:04.514132 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 14/27] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 14 17:39:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:04.520765 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8527d5a9-bdda-4584-b856-1a254bd8bb2b None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:04.620803 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c864e1-1d4b-4834-bb75-1eda3bc1db5b None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:04.635864 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:04.661305 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7732b69b-ce8e-41e2-9b1c-7bce707f4188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:04.662267 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732b69b-ce8e-41e2-9b1c-7bce707f4188 None admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:04.662718 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732b69b-ce8e-41e2-9b1c-7bce707f4188 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:04.663132 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732b69b-ce8e-41e2-9b1c-7bce707f4188 None admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:04.664050 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7732b69b-ce8e-41e2-9b1c-7bce707f4188 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:04.665679 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7732b69b-ce8e-41e2-9b1c-7bce707f4188 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:04.682553 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8527d5a9-bdda-4584-b856-1a254bd8bb2b None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:04.737163 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149ad1ea-9a08-4fa6-9ac9-7e4e276795b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:04.738386 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ad1ea-9a08-4fa6-9ac9-7e4e276795b4 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:04.738994 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ad1ea-9a08-4fa6-9ac9-7e4e276795b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:04.739746 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ad1ea-9a08-4fa6-9ac9-7e4e276795b4 None admin] PATH_INFO: `/v3/users/7ce563cc32c246e59d48c2a6266075e2` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:04.741739 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149ad1ea-9a08-4fa6-9ac9-7e4e276795b4 None admin] RBAC: Authorizing `identity:get_user(user_id=7ce563cc32c246e59d48c2a6266075e2)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:04.744238 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149ad1ea-9a08-4fa6-9ac9-7e4e276795b4 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:04.746532 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 15/28] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 14 17:39:04 2022] GET /identity/v3/users/7ce563cc32c246e59d48c2a6266075e2 => generated 247 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:04.747633 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bc939c-a670-4cea-baab-ebffca351423 None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:04.748116 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bc939c-a670-4cea-baab-ebffca351423 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:04.748541 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bc939c-a670-4cea-baab-ebffca351423 None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:04.751182 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 16/29] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:39:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:39:04.753164 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbdfec2-ab2b-4867-bbb7-c57ca2bc05bf None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:04.753632 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbdfec2-ab2b-4867-bbb7-c57ca2bc05bf None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:04.754757 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbdfec2-ab2b-4867-bbb7-c57ca2bc05bf None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:04.757098 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 17/30] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:39:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:39:04.758289 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbdfec2-ab2b-4867-bbb7-c57ca2bc05bf None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:04.818021 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 14/31] 10.222.0.67 () {60 vars in 1131 bytes} [Thu Jul 14 17:39:04 2022] POST /identity/v3/roles => generated 219 bytes in 412 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:39:04.820533 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fd7cb8-6855-404c-a570-576733478165 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:04.821171 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fd7cb8-6855-404c-a570-576733478165 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:04.821689 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fd7cb8-6855-404c-a570-576733478165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:04.870902 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-b8fd7cb8-6855-404c-a570-576733478165 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:39:04.872408 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-b8fd7cb8-6855-404c-a570-576733478165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:39:04.915298 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbdfec2-ab2b-4867-bbb7-c57ca2bc05bf None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:04.959712 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:04.963012 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7315cb3d-3a08-424f-b6a7-99dd8f1789c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:04.964062 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7315cb3d-3a08-424f-b6a7-99dd8f1789c5 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:04.964351 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7315cb3d-3a08-424f-b6a7-99dd8f1789c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:04.964985 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7315cb3d-3a08-424f-b6a7-99dd8f1789c5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:04.968048 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7315cb3d-3a08-424f-b6a7-99dd8f1789c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:04.968942 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7315cb3d-3a08-424f-b6a7-99dd8f1789c5 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:04.971775 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 18/32] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:39:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:04.974148 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cbd485-f486-4789-b904-d5a0b3f05d3a None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:04.974525 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cbd485-f486-4789-b904-d5a0b3f05d3a None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:04.974914 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cbd485-f486-4789-b904-d5a0b3f05d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:04.981293 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:04.999379 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-85cbd485-f486-4789-b904-d5a0b3f05d3a None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:39:05.001056 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-85cbd485-f486-4789-b904-d5a0b3f05d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:39:05.037006 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 15/33] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:39:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:39:05.038256 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fd7cb8-6855-404c-a570-576733478165 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:05.120479 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 19/34] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:39:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:39:05.121984 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cbd485-f486-4789-b904-d5a0b3f05d3a None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:05.216786 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fd7cb8-6855-404c-a570-576733478165 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:05.264717 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cbd485-f486-4789-b904-d5a0b3f05d3a None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:05.268927 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17562aa5-7ac5-4f57-beda-b6b4aa0d5c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:05.270280 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17562aa5-7ac5-4f57-beda-b6b4aa0d5c79 None admin] REQUEST_METHOD: `PUT` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:05.270860 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17562aa5-7ac5-4f57-beda-b6b4aa0d5c79 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:05.271457 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17562aa5-7ac5-4f57-beda-b6b4aa0d5c79 None admin] PATH_INFO: `/v3/domains/default/users/7ce563cc32c246e59d48c2a6266075e2/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:05.274849 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17562aa5-7ac5-4f57-beda-b6b4aa0d5c79 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=7ce563cc32c246e59d48c2a6266075e2, role_id=4651a1cc7b4d4ab7a7a9ca1e77e58e71)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:05.276930 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17562aa5-7ac5-4f57-beda-b6b4aa0d5c79 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:05.299438 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 16/35] 10.222.0.67 () {58 vars in 1361 bytes} [Thu Jul 14 17:39:05 2022] PUT /identity/v3/domains/default/users/7ce563cc32c246e59d48c2a6266075e2/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:39:05.300563 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:05.302157 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17562aa5-7ac5-4f57-beda-b6b4aa0d5c79 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:05.308675 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53d3080-8f9c-4e42-b54d-f5ec644688c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:05.309516 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d3080-8f9c-4e42-b54d-f5ec644688c8 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:05.309831 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d3080-8f9c-4e42-b54d-f5ec644688c8 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:05.310111 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d3080-8f9c-4e42-b54d-f5ec644688c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:05.326368 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53d3080-8f9c-4e42-b54d-f5ec644688c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:05.327257 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53d3080-8f9c-4e42-b54d-f5ec644688c8 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:05.348515 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:05.351111 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-c53d3080-8f9c-4e42-b54d-f5ec644688c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:39:05.351111 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:39:05.351111 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:39:05.351111 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:39:05.351111 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:39:05.351111 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:39:05.351111 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:39:05.351111 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:39:05.351111 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:39:05.351111 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:39:05.351111 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:39:05.351111 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:39:05.351111 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:39:05.351111 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:39:05.351111 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:39:05.352082 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:39:05.352082 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:39:05.352082 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:39:05.352082 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:39:05.352082 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:39:05.352082 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:39:05.352082 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:39:05.352082 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:39:05.352082 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:39:05.352082 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:39:05.352082 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:39:05.352082 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:39:05.352082 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:39:05.352082 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:39:05.352082 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:39:05.352082 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:39:05.352082 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:39:05.353869 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:39:05.353869 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:39:05.353869 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:39:05.353869 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:39:05.353869 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 20/36] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:39:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:39:05.355562 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e33326-ee6d-4e13-a5cb-06cc758c9b5d None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:05.355853 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e33326-ee6d-4e13-a5cb-06cc758c9b5d None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:05.356225 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e33326-ee6d-4e13-a5cb-06cc758c9b5d None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:05.357765 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 21/37] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:39:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:39:05.359924 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e33326-ee6d-4e13-a5cb-06cc758c9b5d None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:05.443953 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17562aa5-7ac5-4f57-beda-b6b4aa0d5c79 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:05.484605 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6593085e-1cf1-484c-957f-c838472d3322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:05.485893 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6593085e-1cf1-484c-957f-c838472d3322 None admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:05.486541 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6593085e-1cf1-484c-957f-c838472d3322 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:05.487029 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6593085e-1cf1-484c-957f-c838472d3322 None admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:05.488047 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6593085e-1cf1-484c-957f-c838472d3322 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:05.490102 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6593085e-1cf1-484c-957f-c838472d3322 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:05.491316 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e33326-ee6d-4e13-a5cb-06cc758c9b5d None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:05.511820 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 17/38] 10.222.0.67 () {60 vars in 1131 bytes} [Thu Jul 14 17:39:05 2022] POST /identity/v3/roles => generated 225 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:39:05.513700 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7968b69b-4e58-4272-b825-6adabc59d1bb None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:05.514311 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7968b69b-4e58-4272-b825-6adabc59d1bb None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:05.514795 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7968b69b-4e58-4272-b825-6adabc59d1bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:05.534750 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-7968b69b-4e58-4272-b825-6adabc59d1bb None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:39:05.536484 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-7968b69b-4e58-4272-b825-6adabc59d1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:39:05.537383 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f203c25e-249a-4d51-ba13-cef298e8a2d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:05.538159 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f203c25e-249a-4d51-ba13-cef298e8a2d9 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:05.538447 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f203c25e-249a-4d51-ba13-cef298e8a2d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:05.538728 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f203c25e-249a-4d51-ba13-cef298e8a2d9 None admin] PATH_INFO: `/v3/domains` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:05.539553 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f203c25e-249a-4d51-ba13-cef298e8a2d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:39:05.539861 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f203c25e-249a-4d51-ba13-cef298e8a2d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:05.542272 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f203c25e-249a-4d51-ba13-cef298e8a2d9 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:05.563993 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 22/39] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 14 17:39:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:39:05.574673 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f203c25e-249a-4d51-ba13-cef298e8a2d9 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:05.640521 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 18/40] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:39:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:39:05.642107 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4620b5b7-d0f5-416c-b8d1-3f576e4ad9b0 None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:05.642401 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4620b5b7-d0f5-416c-b8d1-3f576e4ad9b0 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:05.642748 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4620b5b7-d0f5-416c-b8d1-3f576e4ad9b0 None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:05.645031 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 19/41] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:39:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:39:05.651030 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de5021-68dd-4299-b48e-64b8f6c92648 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:05.651320 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de5021-68dd-4299-b48e-64b8f6c92648 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:05.651605 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de5021-68dd-4299-b48e-64b8f6c92648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:05.662102 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:05.689392 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-72de5021-68dd-4299-b48e-64b8f6c92648 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:39:05.691096 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-72de5021-68dd-4299-b48e-64b8f6c92648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:39:05.706061 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:05.763908 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f203c25e-249a-4d51-ba13-cef298e8a2d9 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:05.782820 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 20/42] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:39:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 17:39:05.784095 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72de5021-68dd-4299-b48e-64b8f6c92648 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:05.826166 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae309b1-3b2b-486a-a997-e46d815138fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:05.826866 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae309b1-3b2b-486a-a997-e46d815138fd None admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:05.827158 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae309b1-3b2b-486a-a997-e46d815138fd None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:05.827437 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae309b1-3b2b-486a-a997-e46d815138fd None admin] PATH_INFO: `/v3/projects` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:05.828189 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae309b1-3b2b-486a-a997-e46d815138fd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:05.829741 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae309b1-3b2b-486a-a997-e46d815138fd None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:05.958711 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72de5021-68dd-4299-b48e-64b8f6c92648 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:06.011178 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1a875e-dc3f-46a7-bd4e-3cc30df8b6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:06.012061 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a875e-dc3f-46a7-bd4e-3cc30df8b6b3 None admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:06.012479 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a875e-dc3f-46a7-bd4e-3cc30df8b6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:06.012967 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a875e-dc3f-46a7-bd4e-3cc30df8b6b3 None admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:06.014038 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1a875e-dc3f-46a7-bd4e-3cc30df8b6b3 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:06.015644 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1a875e-dc3f-46a7-bd4e-3cc30df8b6b3 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:06.032478 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 21/43] 10.222.0.67 () {60 vars in 1131 bytes} [Thu Jul 14 17:39:05 2022] POST /identity/v3/roles => generated 223 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:39:06.033802 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1a875e-dc3f-46a7-bd4e-3cc30df8b6b3 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:06.055195 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:06.087890 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 23/44] 10.222.0.67 () {60 vars in 1141 bytes} [Thu Jul 14 17:39:05 2022] POST /identity/v3/projects => generated 301 bytes in 514 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:39:06.262800 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1a875e-dc3f-46a7-bd4e-3cc30df8b6b3 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:06.323822 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5debc1-2811-472d-8c22-416f75b0fb66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:06.325184 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5debc1-2811-472d-8c22-416f75b0fb66 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:06.325724 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5debc1-2811-472d-8c22-416f75b0fb66 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:06.326216 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5debc1-2811-472d-8c22-416f75b0fb66 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:06.328039 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5debc1-2811-472d-8c22-416f75b0fb66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:06.329552 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5debc1-2811-472d-8c22-416f75b0fb66 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:06.331246 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 22/45] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:39:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:06.339590 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae309b1-3b2b-486a-a997-e46d815138fd None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:06.440412 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:06.449442 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae309b1-3b2b-486a-a997-e46d815138fd None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:06.490273 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fc6428-c52d-4e08-839c-46ab06aad701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:06.491062 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc6428-c52d-4e08-839c-46ab06aad701 None admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:06.491474 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc6428-c52d-4e08-839c-46ab06aad701 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:06.491853 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc6428-c52d-4e08-839c-46ab06aad701 None admin] PATH_INFO: `/v3/projects` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:06.492674 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fc6428-c52d-4e08-839c-46ab06aad701 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:06.494493 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fc6428-c52d-4e08-839c-46ab06aad701 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:06.522016 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 24/46] 10.222.0.67 () {60 vars in 1141 bytes} [Thu Jul 14 17:39:06 2022] POST /identity/v3/projects => generated 312 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 17:39:07.681666 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26430579-54b2-4155-beae-ad4e11786459 None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:07.682183 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26430579-54b2-4155-beae-ad4e11786459 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:07.682755 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26430579-54b2-4155-beae-ad4e11786459 None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:07.685238 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 23/47] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:39:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:39:07.694040 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4826acc-d7cc-456d-a159-270a1d373b1b None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:07.694560 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4826acc-d7cc-456d-a159-270a1d373b1b None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:07.694702 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4826acc-d7cc-456d-a159-270a1d373b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:07.713166 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-a4826acc-d7cc-456d-a159-270a1d373b1b None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:39:07.714847 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-a4826acc-d7cc-456d-a159-270a1d373b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:39:07.788267 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 25/48] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:39:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:39:07.812981 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26430579-54b2-4155-beae-ad4e11786459 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:07.895881 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:07.924323 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26430579-54b2-4155-beae-ad4e11786459 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:07.962253 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0325cee1-4b25-4842-9a85-0778d02922a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:07.963074 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0325cee1-4b25-4842-9a85-0778d02922a3 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:07.963424 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0325cee1-4b25-4842-9a85-0778d02922a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:07.963648 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0325cee1-4b25-4842-9a85-0778d02922a3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:07.977168 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0325cee1-4b25-4842-9a85-0778d02922a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:39:07.986372 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-0325cee1-4b25-4842-9a85-0778d02922a3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 17:39:07.986372 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:39:07.986372 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:39:07.986372 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:39:07.986372 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:39:07.986372 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:39:07.986372 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:39:07.986372 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:39:07.986372 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:39:07.986372 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:39:07.986372 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:39:07.986372 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:39:07.986372 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:39:07.986372 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:39:07.986372 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:39:07.986372 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:39:07.988101 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:39:07.988101 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:39:07.988101 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:39:07.988101 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:39:07.988101 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:39:07.988101 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:39:07.988101 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:39:07.988101 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:39:07.988101 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:39:07.988101 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:39:07.988101 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:39:07.988101 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:39:07.988101 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:39:07.988101 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:39:07.988101 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:39:07.988101 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:39:07.990444 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:39:07.990444 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:39:07.990444 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:39:07.990444 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:39:07.990444 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:39:07.990444 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:39:07.990444 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:39:07.990444 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:39:07.990444 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:39:07.990444 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:39:07.990444 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 17:39:07.990444 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:39:07.990444 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 24/49] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 14 17:39:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 17:39:07.998153 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4826acc-d7cc-456d-a159-270a1d373b1b None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:08.097252 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:08.129983 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4826acc-d7cc-456d-a159-270a1d373b1b None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:08.167774 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ba6bb4-d148-4c47-9837-dc9cd179decd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:08.168469 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba6bb4-d148-4c47-9837-dc9cd179decd None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:08.168755 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba6bb4-d148-4c47-9837-dc9cd179decd None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:08.169035 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba6bb4-d148-4c47-9837-dc9cd179decd None admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:08.169834 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ba6bb4-d148-4c47-9837-dc9cd179decd None admin] RBAC: Adding query filter params (name=admin) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:39:08.170149 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ba6bb4-d148-4c47-9837-dc9cd179decd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:08.171567 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ba6bb4-d148-4c47-9837-dc9cd179decd None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:08.181305 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 26/50] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 14 17:39:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:08.186905 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0325cee1-4b25-4842-9a85-0778d02922a3 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:08.300500 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0325cee1-4b25-4842-9a85-0778d02922a3 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:08.337910 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cc14a4-60dc-40d3-a167-b7b923a06009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:08.338792 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cc14a4-60dc-40d3-a167-b7b923a06009 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:08.339079 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cc14a4-60dc-40d3-a167-b7b923a06009 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:08.339358 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cc14a4-60dc-40d3-a167-b7b923a06009 None admin] PATH_INFO: `/v3/users/7ce563cc32c246e59d48c2a6266075e2` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:08.340603 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cc14a4-60dc-40d3-a167-b7b923a06009 None admin] RBAC: Authorizing `identity:get_user(user_id=7ce563cc32c246e59d48c2a6266075e2)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:08.342108 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cc14a4-60dc-40d3-a167-b7b923a06009 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:08.343785 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 25/51] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 14 17:39:08 2022] GET /identity/v3/users/7ce563cc32c246e59d48c2a6266075e2 => generated 247 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:08.349661 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ba6bb4-d148-4c47-9837-dc9cd179decd None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:08.478895 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ba6bb4-d148-4c47-9837-dc9cd179decd None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:08.518655 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7698fd44-34b9-4c6d-aa0b-02b315e83ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:08.519496 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698fd44-34b9-4c6d-aa0b-02b315e83ade None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:08.519786 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698fd44-34b9-4c6d-aa0b-02b315e83ade None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:08.520617 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698fd44-34b9-4c6d-aa0b-02b315e83ade None admin] PATH_INFO: `/v3/domains/default` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:08.522065 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7698fd44-34b9-4c6d-aa0b-02b315e83ade None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:08.523615 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7698fd44-34b9-4c6d-aa0b-02b315e83ade None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:08.525412 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 27/52] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:39:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:39:08.531843 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cc14a4-60dc-40d3-a167-b7b923a06009 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:08.535089 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:08.619339 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1ce034-c437-42a8-9203-e38ae8614319 None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:08.619871 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1ce034-c437-42a8-9203-e38ae8614319 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:08.620375 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1ce034-c437-42a8-9203-e38ae8614319 None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:08.623068 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 28/53] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:39:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 17:39:08.631882 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b605d-4e82-4357-9439-772abef8ab15 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:08.632404 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b605d-4e82-4357-9439-772abef8ab15 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:08.632910 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b605d-4e82-4357-9439-772abef8ab15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:08.655914 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cc14a4-60dc-40d3-a167-b7b923a06009 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:08.659560 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-259b605d-4e82-4357-9439-772abef8ab15 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:39:08.661375 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-259b605d-4e82-4357-9439-772abef8ab15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:39:08.663695 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:08.710726 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78782af7-90f9-411c-a6c9-e471f377a327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:08.711862 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78782af7-90f9-411c-a6c9-e471f377a327 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:08.712366 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78782af7-90f9-411c-a6c9-e471f377a327 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:08.713152 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78782af7-90f9-411c-a6c9-e471f377a327 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:08.714483 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78782af7-90f9-411c-a6c9-e471f377a327 None admin] RBAC: Adding query filter params (role.id=4651a1cc7b4d4ab7a7a9ca1e77e58e71, scope.domain.id=default, user.id=7ce563cc32c246e59d48c2a6266075e2) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:39:08.715063 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78782af7-90f9-411c-a6c9-e471f377a327 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:08.717890 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78782af7-90f9-411c-a6c9-e471f377a327 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:08.734526 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 26/54] 10.222.0.67 () {56 vars in 1322 bytes} [Thu Jul 14 17:39:08 2022] GET /identity/v3/role_assignments?user.id=7ce563cc32c246e59d48c2a6266075e2&scope.domain.id=default&role.id=4651a1cc7b4d4ab7a7a9ca1e77e58e71 => generated 530 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:08.754053 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 29/55] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:39:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:39:08.797263 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78782af7-90f9-411c-a6c9-e471f377a327 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:08.875032 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:08.915364 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78782af7-90f9-411c-a6c9-e471f377a327 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:08.962804 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3ac040-2686-4157-b510-2e9539165dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:08.964281 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ac040-2686-4157-b510-2e9539165dd8 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:08.964754 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ac040-2686-4157-b510-2e9539165dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:08.965227 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ac040-2686-4157-b510-2e9539165dd8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:08.967284 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3ac040-2686-4157-b510-2e9539165dd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:08.970047 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3ac040-2686-4157-b510-2e9539165dd8 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:08.973777 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 27/56] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:39:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:08.980320 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259b605d-4e82-4357-9439-772abef8ab15 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:09.097066 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259b605d-4e82-4357-9439-772abef8ab15 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:09.133127 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f053b299-1908-4f69-92cc-75b1fbf3c36f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:09.133744 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f053b299-1908-4f69-92cc-75b1fbf3c36f None admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:09.134036 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f053b299-1908-4f69-92cc-75b1fbf3c36f None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:09.134319 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f053b299-1908-4f69-92cc-75b1fbf3c36f None admin] PATH_INFO: `/v3/projects` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:09.135035 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f053b299-1908-4f69-92cc-75b1fbf3c36f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:09.136506 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f053b299-1908-4f69-92cc-75b1fbf3c36f None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:09.145035 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:09.163745 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 30/57] 10.222.0.67 () {60 vars in 1140 bytes} [Thu Jul 14 17:39:08 2022] POST /identity/v3/projects => generated 298 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:39:11.282026 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104dbc8f-c823-4212-a701-73d57f6237dd None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:11.283129 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104dbc8f-c823-4212-a701-73d57f6237dd None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:11.283129 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104dbc8f-c823-4212-a701-73d57f6237dd None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:11.284020 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 28/58] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:39:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:39:11.289440 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a72ce7-6777-441f-b232-82735af0cb98 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:11.290191 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a72ce7-6777-441f-b232-82735af0cb98 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:11.290191 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a72ce7-6777-441f-b232-82735af0cb98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:11.307555 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-a0a72ce7-6777-441f-b232-82735af0cb98 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:39:11.308799 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-a0a72ce7-6777-441f-b232-82735af0cb98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:39:11.378737 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 31/59] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:39:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:39:11.404238 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104dbc8f-c823-4212-a701-73d57f6237dd None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:11.638592 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104dbc8f-c823-4212-a701-73d57f6237dd None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:11.673981 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b251e39-bb79-499f-a103-1c308642b4f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:11.674794 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b251e39-bb79-499f-a103-1c308642b4f6 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:11.675085 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b251e39-bb79-499f-a103-1c308642b4f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:11.675366 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b251e39-bb79-499f-a103-1c308642b4f6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:11.677130 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b251e39-bb79-499f-a103-1c308642b4f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:11.678632 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b251e39-bb79-499f-a103-1c308642b4f6 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:11.680335 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 29/60] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:39:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:11.686064 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a72ce7-6777-441f-b232-82735af0cb98 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:11.801703 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a72ce7-6777-441f-b232-82735af0cb98 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:11.827469 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:11.843165 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07de0f75-43ff-4777-a723-b51f8c93c8e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:11.843850 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07de0f75-43ff-4777-a723-b51f8c93c8e6 None admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:11.844136 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07de0f75-43ff-4777-a723-b51f8c93c8e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:11.844416 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07de0f75-43ff-4777-a723-b51f8c93c8e6 None admin] PATH_INFO: `/v3/users` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:11.845143 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07de0f75-43ff-4777-a723-b51f8c93c8e6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:11.846648 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07de0f75-43ff-4777-a723-b51f8c93c8e6 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:11.875468 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 32/61] 10.222.0.67 () {60 vars in 1132 bytes} [Thu Jul 14 17:39:11 2022] POST /identity/v3/users => generated 275 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:39:15.440299 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c058fb98-5946-4021-ba34-0d0a7da6f2e9 None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:15.441318 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c058fb98-5946-4021-ba34-0d0a7da6f2e9 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:15.441852 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c058fb98-5946-4021-ba34-0d0a7da6f2e9 None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:15.443510 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 30/62] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:39:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:39:15.449315 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3db72b-f72b-45a5-ad97-080a61d2588d None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:15.450264 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3db72b-f72b-45a5-ad97-080a61d2588d None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:15.450761 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3db72b-f72b-45a5-ad97-080a61d2588d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:15.482671 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-de3db72b-f72b-45a5-ad97-080a61d2588d None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:39:15.483900 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-de3db72b-f72b-45a5-ad97-080a61d2588d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:39:15.549704 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c6272-0c3c-43b9-96ed-81e594763599 None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:15.550037 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c6272-0c3c-43b9-96ed-81e594763599 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:15.550272 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c6272-0c3c-43b9-96ed-81e594763599 None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:15.552596 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 31/63] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:39:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:39:15.559681 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c3af22-734b-49ec-b780-319b19738467 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:15.560003 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c3af22-734b-49ec-b780-319b19738467 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:15.560244 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c3af22-734b-49ec-b780-319b19738467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:15.569916 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:15.584604 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-16c3af22-734b-49ec-b780-319b19738467 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:39:15.585880 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-16c3af22-734b-49ec-b780-319b19738467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:39:15.624750 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 33/64] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:39:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:39:15.671801 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3db72b-f72b-45a5-ad97-080a61d2588d None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:15.686434 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 32/65] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:39:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:39:15.688008 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d594a0fb-7fbf-488f-b0ad-8dc060c323e0 None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:15.688479 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d594a0fb-7fbf-488f-b0ad-8dc060c323e0 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:15.688901 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d594a0fb-7fbf-488f-b0ad-8dc060c323e0 None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:15.690418 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 33/66] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:39:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:39:15.701561 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a6cd27-58cd-4929-9d34-0fa2262ecaef None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:15.701561 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a6cd27-58cd-4929-9d34-0fa2262ecaef None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:15.701561 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a6cd27-58cd-4929-9d34-0fa2262ecaef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:15.716523 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-64a6cd27-58cd-4929-9d34-0fa2262ecaef None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:39:15.718122 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-64a6cd27-58cd-4929-9d34-0fa2262ecaef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:39:15.796311 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 34/67] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:39:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:39:15.797177 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a6cd27-58cd-4929-9d34-0fa2262ecaef None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:15.819165 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3db72b-f72b-45a5-ad97-080a61d2588d None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:15.827563 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:15.859486 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1a6a7d-6cb3-4aee-a472-e5edd0d3a466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:15.860307 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1a6a7d-6cb3-4aee-a472-e5edd0d3a466 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:15.860592 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1a6a7d-6cb3-4aee-a472-e5edd0d3a466 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:15.860957 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1a6a7d-6cb3-4aee-a472-e5edd0d3a466 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:15.866529 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:15.874080 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1a6a7d-6cb3-4aee-a472-e5edd0d3a466 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:39:15.882885 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-ab1a6a7d-6cb3-4aee-a472-e5edd0d3a466 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 17:39:15.882885 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:39:15.882885 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:39:15.882885 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:39:15.882885 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:39:15.882885 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:39:15.882885 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:39:15.882885 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:39:15.882885 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:39:15.882885 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:39:15.882885 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:39:15.882885 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:39:15.882885 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:39:15.882885 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:39:15.882885 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:39:15.882885 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:39:15.883824 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:39:15.883824 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:39:15.883824 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:39:15.883824 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:39:15.883824 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:39:15.883824 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:39:15.883824 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:39:15.883824 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:39:15.883824 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:39:15.883824 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:39:15.883824 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:39:15.883824 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:39:15.883824 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:39:15.883824 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:39:15.883824 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:39:15.883824 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:39:15.884614 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:39:15.884614 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:39:15.884614 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:39:15.884614 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:39:15.884614 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:39:15.884614 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:39:15.884614 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:39:15.884614 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:39:15.884614 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:39:15.884614 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:39:15.884614 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 17:39:15.884614 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:39:15.884614 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 34/68] 10.222.0.67 () {56 vars in 1114 bytes} [Thu Jul 14 17:39:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 17:39:15.885393 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee310a-5eaa-4fa2-962f-0966f97d9747 None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:15.885684 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee310a-5eaa-4fa2-962f-0966f97d9747 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:15.885971 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee310a-5eaa-4fa2-962f-0966f97d9747 None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:15.887245 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 35/69] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:39:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:39:15.887942 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ee310a-5eaa-4fa2-962f-0966f97d9747 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:15.910933 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a6cd27-58cd-4929-9d34-0fa2262ecaef None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:15.945466 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aac390-fe0d-496b-a563-795cd90e3620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:15.946216 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aac390-fe0d-496b-a563-795cd90e3620 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:15.946502 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aac390-fe0d-496b-a563-795cd90e3620 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:15.946781 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aac390-fe0d-496b-a563-795cd90e3620 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:15.956895 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aac390-fe0d-496b-a563-795cd90e3620 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:39:15.964792 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-c7aac390-fe0d-496b-a563-795cd90e3620 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 17:39:15.964792 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:39:15.964792 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:39:15.964792 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:39:15.964792 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:39:15.964792 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:39:15.964792 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:39:15.964792 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:39:15.964792 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:39:15.964792 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:39:15.964792 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:39:15.964792 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:39:15.964792 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:39:15.964792 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:39:15.964792 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:39:15.964792 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:39:15.965694 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:39:15.965694 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:39:15.965694 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:39:15.965694 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:39:15.965694 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:39:15.965694 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:39:15.965694 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:39:15.965694 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:39:15.965694 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:39:15.965694 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:39:15.965694 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:39:15.965694 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:39:15.965694 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:39:15.965694 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:39:15.965694 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:39:15.965694 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:39:15.966487 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:39:15.966487 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:39:15.966487 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:39:15.966487 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:39:15.966487 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:39:15.966487 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:39:15.966487 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:39:15.966487 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:39:15.966487 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:39:15.966487 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:39:15.966487 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 17:39:15.966487 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:39:15.966487 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 35/70] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 14 17:39:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:39:15.972679 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c94c69-e37a-425a-a038-e5a3a002d6a0 None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:15.972679 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c94c69-e37a-425a-a038-e5a3a002d6a0 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:15.972679 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c94c69-e37a-425a-a038-e5a3a002d6a0 None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:15.972679 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 36/71] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:39:15 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:39:15.972679 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c94c69-e37a-425a-a038-e5a3a002d6a0 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:15.994382 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ee310a-5eaa-4fa2-962f-0966f97d9747 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:16.027062 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412b9ffd-b77e-48f5-9234-a1e7a703efb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:16.027876 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b9ffd-b77e-48f5-9234-a1e7a703efb4 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:16.028165 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b9ffd-b77e-48f5-9234-a1e7a703efb4 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:16.028445 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b9ffd-b77e-48f5-9234-a1e7a703efb4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:16.039359 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412b9ffd-b77e-48f5-9234-a1e7a703efb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:39:16.047026 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-412b9ffd-b77e-48f5-9234-a1e7a703efb4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 17:39:16.047026 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:39:16.047026 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:39:16.047026 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:39:16.047026 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:39:16.047026 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:39:16.047026 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:39:16.047026 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:39:16.047026 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:39:16.047026 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:39:16.047026 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:39:16.047026 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:39:16.047026 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:39:16.047026 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:39:16.047026 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:39:16.047026 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:39:16.047934 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:39:16.047934 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:39:16.047934 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:39:16.047934 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:39:16.047934 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:39:16.047934 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:39:16.047934 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:39:16.047934 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:39:16.047934 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:39:16.047934 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:39:16.047934 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:39:16.047934 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:39:16.047934 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:39:16.047934 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:39:16.047934 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:39:16.047934 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:39:16.048716 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:39:16.048716 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:39:16.048716 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:39:16.048716 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:39:16.048716 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:39:16.048716 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:39:16.048716 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:39:16.048716 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:39:16.048716 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:39:16.048716 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:39:16.048716 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 17:39:16.048716 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:39:16.048716 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 36/72] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 14 17:39:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:39:16.049411 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c9dcf-5514-45ca-bbc6-4a583a3e9936 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:16.049715 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c9dcf-5514-45ca-bbc6-4a583a3e9936 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:16.049999 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c9dcf-5514-45ca-bbc6-4a583a3e9936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:16.066925 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-0c1c9dcf-5514-45ca-bbc6-4a583a3e9936 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:39:16.068146 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-0c1c9dcf-5514-45ca-bbc6-4a583a3e9936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:39:16.079289 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c94c69-e37a-425a-a038-e5a3a002d6a0 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:16.088275 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:16.102166 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:16.113514 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f09117f-3dda-42a8-aa4c-584637a0f1e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:16.115025 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f09117f-3dda-42a8-aa4c-584637a0f1e7 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:16.115313 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f09117f-3dda-42a8-aa4c-584637a0f1e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:16.115588 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f09117f-3dda-42a8-aa4c-584637a0f1e7 None admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:16.116348 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f09117f-3dda-42a8-aa4c-584637a0f1e7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:39:16.116655 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f09117f-3dda-42a8-aa4c-584637a0f1e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:16.118081 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f09117f-3dda-42a8-aa4c-584637a0f1e7 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:16.129997 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 37/73] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 14 17:39:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:16.130911 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f09117f-3dda-42a8-aa4c-584637a0f1e7 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:16.144283 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 37/74] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:39:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:39:16.145767 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751f7cc3-0bef-4e24-afa9-4b4cf0f82e99 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:16.146055 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751f7cc3-0bef-4e24-afa9-4b4cf0f82e99 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:16.146449 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751f7cc3-0bef-4e24-afa9-4b4cf0f82e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:16.162490 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-751f7cc3-0bef-4e24-afa9-4b4cf0f82e99 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:39:16.163682 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-751f7cc3-0bef-4e24-afa9-4b4cf0f82e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:39:16.232502 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 38/75] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:39:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:39:16.233263 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751f7cc3-0bef-4e24-afa9-4b4cf0f82e99 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:16.237752 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f09117f-3dda-42a8-aa4c-584637a0f1e7 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:16.274430 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662ddb1c-0294-4cd9-8094-ee23a8ab12b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:16.275099 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662ddb1c-0294-4cd9-8094-ee23a8ab12b1 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:16.275385 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662ddb1c-0294-4cd9-8094-ee23a8ab12b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:16.275660 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662ddb1c-0294-4cd9-8094-ee23a8ab12b1 None admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:16.276418 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662ddb1c-0294-4cd9-8094-ee23a8ab12b1 None admin] RBAC: Adding query filter params (name=member) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:39:16.276725 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662ddb1c-0294-4cd9-8094-ee23a8ab12b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:16.278141 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662ddb1c-0294-4cd9-8094-ee23a8ab12b1 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:16.286235 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 38/76] 10.222.0.67 () {56 vars in 1101 bytes} [Thu Jul 14 17:39:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:16.287014 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662ddb1c-0294-4cd9-8094-ee23a8ab12b1 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:16.323152 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:16.334260 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:16.339302 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751f7cc3-0bef-4e24-afa9-4b4cf0f82e99 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:16.372814 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551bf590-5fac-4dde-9688-5df305f911bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:16.373486 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551bf590-5fac-4dde-9688-5df305f911bf None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:16.373804 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551bf590-5fac-4dde-9688-5df305f911bf None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:16.374087 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551bf590-5fac-4dde-9688-5df305f911bf None admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:16.374840 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551bf590-5fac-4dde-9688-5df305f911bf None admin] RBAC: Adding query filter params (name=admin) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:39:16.375151 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551bf590-5fac-4dde-9688-5df305f911bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:16.376535 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551bf590-5fac-4dde-9688-5df305f911bf None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:16.386050 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 39/77] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 14 17:39:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:16.386664 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551bf590-5fac-4dde-9688-5df305f911bf None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:16.392513 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662ddb1c-0294-4cd9-8094-ee23a8ab12b1 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:16.424719 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62f0f0f-86d3-4677-b623-aa5a07670e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:16.425626 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62f0f0f-86d3-4677-b623-aa5a07670e78 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:16.425911 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62f0f0f-86d3-4677-b623-aa5a07670e78 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:16.426193 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62f0f0f-86d3-4677-b623-aa5a07670e78 None admin] PATH_INFO: `/v3/users/07cbc28bcd2b49ae85b2ff52eb00af9b` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:16.441920 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62f0f0f-86d3-4677-b623-aa5a07670e78 None admin] RBAC: Authorizing `identity:get_user(user_id=07cbc28bcd2b49ae85b2ff52eb00af9b)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:16.443946 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62f0f0f-86d3-4677-b623-aa5a07670e78 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:16.445636 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 39/78] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 14 17:39:16 2022] GET /identity/v3/users/07cbc28bcd2b49ae85b2ff52eb00af9b => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:16.446395 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62f0f0f-86d3-4677-b623-aa5a07670e78 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:16.489852 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551bf590-5fac-4dde-9688-5df305f911bf None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:16.522925 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30abecc3-c367-4906-a27f-a270cf4aa8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:16.523723 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30abecc3-c367-4906-a27f-a270cf4aa8fe None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:16.524006 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30abecc3-c367-4906-a27f-a270cf4aa8fe None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:16.524280 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30abecc3-c367-4906-a27f-a270cf4aa8fe None admin] PATH_INFO: `/v3/roles/member` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:16.534249 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30abecc3-c367-4906-a27f-a270cf4aa8fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:39:16.541913 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-30abecc3-c367-4906-a27f-a270cf4aa8fe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 17:39:16.541913 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:39:16.541913 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:39:16.541913 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:39:16.541913 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:39:16.541913 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:39:16.541913 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:39:16.541913 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:39:16.541913 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:39:16.541913 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:39:16.541913 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:39:16.541913 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:39:16.541913 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:39:16.541913 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:39:16.541913 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:39:16.541913 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:39:16.542857 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:39:16.542857 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:39:16.542857 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:39:16.542857 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:39:16.542857 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:39:16.542857 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:39:16.542857 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:39:16.542857 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:39:16.542857 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:39:16.542857 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:39:16.542857 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:39:16.542857 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:39:16.542857 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:39:16.542857 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:39:16.542857 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:39:16.542857 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:39:16.543688 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:39:16.543688 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:39:16.543688 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:39:16.543688 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:39:16.543688 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:39:16.543688 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:39:16.543688 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:39:16.543688 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:39:16.543688 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:39:16.543688 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:39:16.543688 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 17:39:16.543688 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:39:16.543688 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 40/79] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 14 17:39:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:39:16.544325 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30abecc3-c367-4906-a27f-a270cf4aa8fe None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:16.551977 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62f0f0f-86d3-4677-b623-aa5a07670e78 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:16.554384 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:16.557000 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:16.586820 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8627d5-c5a7-4962-8f38-55e1bce9261b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:16.587626 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8627d5-c5a7-4962-8f38-55e1bce9261b None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:16.587911 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8627d5-c5a7-4962-8f38-55e1bce9261b None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:16.588193 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8627d5-c5a7-4962-8f38-55e1bce9261b None admin] PATH_INFO: `/v3/domains/default` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:16.589394 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8627d5-c5a7-4962-8f38-55e1bce9261b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:16.590884 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8627d5-c5a7-4962-8f38-55e1bce9261b None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:16.592516 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 40/80] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:39:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:16.593281 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8627d5-c5a7-4962-8f38-55e1bce9261b None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:16.650139 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30abecc3-c367-4906-a27f-a270cf4aa8fe None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:16.683581 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7ca253-aaed-462f-a5ec-5634853621b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:16.684459 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ca253-aaed-462f-a5ec-5634853621b1 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:16.684745 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ca253-aaed-462f-a5ec-5634853621b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:16.685019 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ca253-aaed-462f-a5ec-5634853621b1 None admin] PATH_INFO: `/v3/users/07cbc28bcd2b49ae85b2ff52eb00af9b` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:16.686250 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7ca253-aaed-462f-a5ec-5634853621b1 None admin] RBAC: Authorizing `identity:get_user(user_id=07cbc28bcd2b49ae85b2ff52eb00af9b)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:16.687691 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7ca253-aaed-462f-a5ec-5634853621b1 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:16.689301 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 41/81] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 14 17:39:16 2022] GET /identity/v3/users/07cbc28bcd2b49ae85b2ff52eb00af9b => generated 275 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:16.694362 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7ca253-aaed-462f-a5ec-5634853621b1 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:16.694937 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8627d5-c5a7-4962-8f38-55e1bce9261b None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:16.730228 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f028660f-81f3-407d-950a-39f19057e5e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:16.731106 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f028660f-81f3-407d-950a-39f19057e5e6 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:16.731389 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f028660f-81f3-407d-950a-39f19057e5e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:16.731666 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f028660f-81f3-407d-950a-39f19057e5e6 None admin] PATH_INFO: `/v3/users/7ce563cc32c246e59d48c2a6266075e2` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:16.732842 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f028660f-81f3-407d-950a-39f19057e5e6 None admin] RBAC: Authorizing `identity:get_user(user_id=7ce563cc32c246e59d48c2a6266075e2)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:16.734346 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f028660f-81f3-407d-950a-39f19057e5e6 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:16.735975 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 41/82] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 14 17:39:16 2022] GET /identity/v3/users/7ce563cc32c246e59d48c2a6266075e2 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:16.736720 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f028660f-81f3-407d-950a-39f19057e5e6 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:16.778885 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:16.779773 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:16.801108 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7ca253-aaed-462f-a5ec-5634853621b1 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:16.835344 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b482225a-8094-4def-8213-511fe6abe90d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:16.835990 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b482225a-8094-4def-8213-511fe6abe90d None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:16.836272 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b482225a-8094-4def-8213-511fe6abe90d None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:16.836548 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b482225a-8094-4def-8213-511fe6abe90d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:16.837797 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f028660f-81f3-407d-950a-39f19057e5e6 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:16.871180 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8e7418-1a80-421a-a3e8-7dee88f25bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:16.871857 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e7418-1a80-421a-a3e8-7dee88f25bdf None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:16.872147 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e7418-1a80-421a-a3e8-7dee88f25bdf None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:16.872429 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e7418-1a80-421a-a3e8-7dee88f25bdf None admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:16.873184 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8e7418-1a80-421a-a3e8-7dee88f25bdf None admin] RBAC: Adding query filter params (name=member) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:39:16.873494 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8e7418-1a80-421a-a3e8-7dee88f25bdf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:16.874927 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8e7418-1a80-421a-a3e8-7dee88f25bdf None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:16.883936 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 42/83] 10.222.0.67 () {56 vars in 1101 bytes} [Thu Jul 14 17:39:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:16.884525 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8e7418-1a80-421a-a3e8-7dee88f25bdf None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:16.904428 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b482225a-8094-4def-8213-511fe6abe90d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:16.905926 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b482225a-8094-4def-8213-511fe6abe90d None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:16.978985 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:16.985111 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8e7418-1a80-421a-a3e8-7dee88f25bdf None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:16.986679 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:17.004436 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 42/84] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 14 17:39:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 17:39:17.005627 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b482225a-8094-4def-8213-511fe6abe90d None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:17.019888 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14d9b10-1b4e-48f0-9c31-fa4f4ecdfa6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:17.020566 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d9b10-1b4e-48f0-9c31-fa4f4ecdfa6c None admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:17.020847 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d9b10-1b4e-48f0-9c31-fa4f4ecdfa6c None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:17.021127 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d9b10-1b4e-48f0-9c31-fa4f4ecdfa6c None admin] PATH_INFO: `/v3/users` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:17.021876 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14d9b10-1b4e-48f0-9c31-fa4f4ecdfa6c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:17.023318 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14d9b10-1b4e-48f0-9c31-fa4f4ecdfa6c None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:17.049668 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 43/85] 10.222.0.67 () {60 vars in 1132 bytes} [Thu Jul 14 17:39:16 2022] POST /identity/v3/users => generated 289 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:39:17.050538 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14d9b10-1b4e-48f0-9c31-fa4f4ecdfa6c None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:17.129459 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b482225a-8094-4def-8213-511fe6abe90d None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:17.169540 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5cfcaf-48ab-4358-85c1-1745b6acef0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:17.170231 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5cfcaf-48ab-4358-85c1-1745b6acef0a None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:17.170517 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5cfcaf-48ab-4358-85c1-1745b6acef0a None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:17.170799 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5cfcaf-48ab-4358-85c1-1745b6acef0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:17.175390 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14d9b10-1b4e-48f0-9c31-fa4f4ecdfa6c None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:17.220915 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ed094c-35dd-4f1e-b86e-98771947e409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:17.221659 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ed094c-35dd-4f1e-b86e-98771947e409 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:17.221949 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ed094c-35dd-4f1e-b86e-98771947e409 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:17.222229 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ed094c-35dd-4f1e-b86e-98771947e409 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:17.228762 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:17.253622 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5cfcaf-48ab-4358-85c1-1745b6acef0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:17.255741 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5cfcaf-48ab-4358-85c1-1745b6acef0a None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:17.261344 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:17.313554 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ed094c-35dd-4f1e-b86e-98771947e409 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:17.314991 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ed094c-35dd-4f1e-b86e-98771947e409 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:17.375944 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 43/86] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 14 17:39:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 17:39:17.376688 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5cfcaf-48ab-4358-85c1-1745b6acef0a None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:17.443777 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 44/87] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 14 17:39:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 17:39:17.449474 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ed094c-35dd-4f1e-b86e-98771947e409 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:17.481109 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:17.511108 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5cfcaf-48ab-4358-85c1-1745b6acef0a None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:17.524910 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:17.560881 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8191efcf-c4e2-4dd4-9149-e022de56199d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:17.562440 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8191efcf-c4e2-4dd4-9149-e022de56199d None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:17.562747 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8191efcf-c4e2-4dd4-9149-e022de56199d None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:17.563014 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8191efcf-c4e2-4dd4-9149-e022de56199d None admin] PATH_INFO: `/v3/users/07cbc28bcd2b49ae85b2ff52eb00af9b` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:17.564569 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8191efcf-c4e2-4dd4-9149-e022de56199d None admin] RBAC: Authorizing `identity:get_user(user_id=07cbc28bcd2b49ae85b2ff52eb00af9b)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:17.566226 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8191efcf-c4e2-4dd4-9149-e022de56199d None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:17.568132 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 44/88] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 14 17:39:17 2022] GET /identity/v3/users/07cbc28bcd2b49ae85b2ff52eb00af9b => generated 275 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:17.573033 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8191efcf-c4e2-4dd4-9149-e022de56199d None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:17.582364 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ed094c-35dd-4f1e-b86e-98771947e409 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:17.621627 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d00184-743c-4ca5-aff2-3461d1e48741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:17.622365 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d00184-743c-4ca5-aff2-3461d1e48741 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:17.622656 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d00184-743c-4ca5-aff2-3461d1e48741 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:17.622938 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d00184-743c-4ca5-aff2-3461d1e48741 None admin] PATH_INFO: `/v3/projects/44c7c7b4ddec44b48803f27448a16a78` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:17.624257 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d00184-743c-4ca5-aff2-3461d1e48741 None admin] RBAC: Authorizing `identity:get_project(project_id=44c7c7b4ddec44b48803f27448a16a78)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:17.625766 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d00184-743c-4ca5-aff2-3461d1e48741 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:17.627787 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 45/89] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 14 17:39:17 2022] GET /identity/v3/projects/44c7c7b4ddec44b48803f27448a16a78 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:17.633461 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d00184-743c-4ca5-aff2-3461d1e48741 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:17.697571 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8191efcf-c4e2-4dd4-9149-e022de56199d None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:17.749752 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c2823c-2c10-4e1f-b1fa-64b90dede8c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:17.751080 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c2823c-2c10-4e1f-b1fa-64b90dede8c8 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:17.751562 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c2823c-2c10-4e1f-b1fa-64b90dede8c8 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:17.752042 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c2823c-2c10-4e1f-b1fa-64b90dede8c8 None admin] PATH_INFO: `/v3/projects/44c7c7b4ddec44b48803f27448a16a78` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:17.752910 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d00184-743c-4ca5-aff2-3461d1e48741 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:17.753724 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c2823c-2c10-4e1f-b1fa-64b90dede8c8 None admin] RBAC: Authorizing `identity:get_project(project_id=44c7c7b4ddec44b48803f27448a16a78)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:17.756175 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c2823c-2c10-4e1f-b1fa-64b90dede8c8 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:17.758316 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 45/90] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 14 17:39:17 2022] GET /identity/v3/projects/44c7c7b4ddec44b48803f27448a16a78 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:17.759186 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c2823c-2c10-4e1f-b1fa-64b90dede8c8 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:17.775726 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:17.791323 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:17.803205 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6811760-bad5-4398-a630-2aea95ca7464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:17.805269 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6811760-bad5-4398-a630-2aea95ca7464 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:17.805772 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6811760-bad5-4398-a630-2aea95ca7464 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:17.806229 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6811760-bad5-4398-a630-2aea95ca7464 None admin] PATH_INFO: `/v3/projects/44c7c7b4ddec44b48803f27448a16a78` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:17.807702 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6811760-bad5-4398-a630-2aea95ca7464 None admin] RBAC: Authorizing `identity:get_project(project_id=44c7c7b4ddec44b48803f27448a16a78)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:17.809421 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6811760-bad5-4398-a630-2aea95ca7464 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:17.817919 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 46/91] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 14 17:39:17 2022] GET /identity/v3/projects/44c7c7b4ddec44b48803f27448a16a78 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:17.817919 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6811760-bad5-4398-a630-2aea95ca7464 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:17.896458 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c2823c-2c10-4e1f-b1fa-64b90dede8c8 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:17.937647 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1568fc6-5a6f-4014-bc16-5851a278381a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:17.938794 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1568fc6-5a6f-4014-bc16-5851a278381a None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:17.939389 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1568fc6-5a6f-4014-bc16-5851a278381a None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:17.939919 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1568fc6-5a6f-4014-bc16-5851a278381a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:17.949058 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6811760-bad5-4398-a630-2aea95ca7464 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:17.987085 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a340f97-1a61-4bab-b744-3d5560bf08fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:17.987606 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a340f97-1a61-4bab-b744-3d5560bf08fb None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:17.987955 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a340f97-1a61-4bab-b744-3d5560bf08fb None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:17.988243 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a340f97-1a61-4bab-b744-3d5560bf08fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:17.990151 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a340f97-1a61-4bab-b744-3d5560bf08fb None admin] RBAC: Adding query filter params (role.id=fa9b6b80eda3440ca058cb77bd7f8f5c, scope.project.id=44c7c7b4ddec44b48803f27448a16a78, user.id=07cbc28bcd2b49ae85b2ff52eb00af9b) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:39:17.990635 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a340f97-1a61-4bab-b744-3d5560bf08fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:17.992012 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a340f97-1a61-4bab-b744-3d5560bf08fb None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:18.005634 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 47/92] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 14 17:39:17 2022] GET /identity/v3/role_assignments?user.id=07cbc28bcd2b49ae85b2ff52eb00af9b&scope.project.id=44c7c7b4ddec44b48803f27448a16a78&role.id=fa9b6b80eda3440ca058cb77bd7f8f5c => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:18.005634 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a340f97-1a61-4bab-b744-3d5560bf08fb None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:18.041906 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1568fc6-5a6f-4014-bc16-5851a278381a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:18.043604 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1568fc6-5a6f-4014-bc16-5851a278381a None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:18.065578 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:18.074099 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:18.115388 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a340f97-1a61-4bab-b744-3d5560bf08fb None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:18.155110 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c209cec-2a85-4b94-ad74-7d686aff4aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:18.155803 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c209cec-2a85-4b94-ad74-7d686aff4aa5 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:18.156091 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c209cec-2a85-4b94-ad74-7d686aff4aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:18.156374 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c209cec-2a85-4b94-ad74-7d686aff4aa5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:18.157385 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c209cec-2a85-4b94-ad74-7d686aff4aa5 None admin] RBAC: Adding query filter params (role.id=95d753870f97426cb1ce32e078621a4c, scope.project.id=44c7c7b4ddec44b48803f27448a16a78, user.id=07cbc28bcd2b49ae85b2ff52eb00af9b) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:39:18.157731 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c209cec-2a85-4b94-ad74-7d686aff4aa5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:18.161555 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c209cec-2a85-4b94-ad74-7d686aff4aa5 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:18.165987 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 48/93] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 14 17:39:17 2022] GET /identity/v3/role_assignments?user.id=07cbc28bcd2b49ae85b2ff52eb00af9b&scope.project.id=44c7c7b4ddec44b48803f27448a16a78&role.id=95d753870f97426cb1ce32e078621a4c => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:18.167006 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c209cec-2a85-4b94-ad74-7d686aff4aa5 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:18.272844 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 46/94] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 14 17:39:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 17:39:18.282843 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1568fc6-5a6f-4014-bc16-5851a278381a None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:18.291870 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c209cec-2a85-4b94-ad74-7d686aff4aa5 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:18.319240 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:18.332167 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dca35e5-f41f-47e6-bbd6-ddd647c558dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:18.333321 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dca35e5-f41f-47e6-bbd6-ddd647c558dc None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:18.333660 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dca35e5-f41f-47e6-bbd6-ddd647c558dc None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:18.333944 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dca35e5-f41f-47e6-bbd6-ddd647c558dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:18.334820 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dca35e5-f41f-47e6-bbd6-ddd647c558dc None admin] RBAC: Adding query filter params (role.id=4651a1cc7b4d4ab7a7a9ca1e77e58e71, scope.project.id=44c7c7b4ddec44b48803f27448a16a78, user.id=7ce563cc32c246e59d48c2a6266075e2) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:39:18.335245 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dca35e5-f41f-47e6-bbd6-ddd647c558dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:18.336842 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dca35e5-f41f-47e6-bbd6-ddd647c558dc None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:18.343361 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 49/95] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 14 17:39:18 2022] GET /identity/v3/role_assignments?user.id=7ce563cc32c246e59d48c2a6266075e2&scope.project.id=44c7c7b4ddec44b48803f27448a16a78&role.id=4651a1cc7b4d4ab7a7a9ca1e77e58e71 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:18.451462 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1568fc6-5a6f-4014-bc16-5851a278381a None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:18.481953 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:18.518317 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eba636-0bfd-4c27-ade7-d4d1087ea92e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:18.519265 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eba636-0bfd-4c27-ade7-d4d1087ea92e None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:18.519555 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eba636-0bfd-4c27-ade7-d4d1087ea92e None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:18.519833 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eba636-0bfd-4c27-ade7-d4d1087ea92e None admin] PATH_INFO: `/v3/projects/4942e68ff7384c3aadf824bb57309ea4` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:18.526579 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eba636-0bfd-4c27-ade7-d4d1087ea92e None admin] RBAC: Authorizing `identity:get_project(project_id=4942e68ff7384c3aadf824bb57309ea4)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:18.528150 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eba636-0bfd-4c27-ade7-d4d1087ea92e None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:18.530186 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 47/96] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 14 17:39:18 2022] GET /identity/v3/projects/4942e68ff7384c3aadf824bb57309ea4 => generated 312 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:18.537302 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dca35e5-f41f-47e6-bbd6-ddd647c558dc None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:18.668504 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dca35e5-f41f-47e6-bbd6-ddd647c558dc None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:18.703129 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3de3a14-3cde-48cb-b8c7-ddbe9206dcf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:18.703801 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de3a14-3cde-48cb-b8c7-ddbe9206dcf9 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:18.704091 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de3a14-3cde-48cb-b8c7-ddbe9206dcf9 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:18.704374 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de3a14-3cde-48cb-b8c7-ddbe9206dcf9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:18.705224 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3de3a14-3cde-48cb-b8c7-ddbe9206dcf9 None admin] RBAC: Adding query filter params (role.id=95d753870f97426cb1ce32e078621a4c, scope.project.id=4942e68ff7384c3aadf824bb57309ea4, user.id=07cbc28bcd2b49ae85b2ff52eb00af9b) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:39:18.705565 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3de3a14-3cde-48cb-b8c7-ddbe9206dcf9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:18.707008 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3de3a14-3cde-48cb-b8c7-ddbe9206dcf9 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:18.713923 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 50/97] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 14 17:39:18 2022] GET /identity/v3/role_assignments?user.id=07cbc28bcd2b49ae85b2ff52eb00af9b&scope.project.id=4942e68ff7384c3aadf824bb57309ea4&role.id=95d753870f97426cb1ce32e078621a4c => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:19.669793 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b2dab-fa64-4ad8-91a9-3a660af7fb14 None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:19.670842 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b2dab-fa64-4ad8-91a9-3a660af7fb14 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:19.671408 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b2dab-fa64-4ad8-91a9-3a660af7fb14 None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:19.673310 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 48/98] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:39:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:39:19.679018 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f885843d-d472-4c63-9282-9041167bb627 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:19.679918 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f885843d-d472-4c63-9282-9041167bb627 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:19.680424 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f885843d-d472-4c63-9282-9041167bb627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:19.705927 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-f885843d-d472-4c63-9282-9041167bb627 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:39:19.707520 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-f885843d-d472-4c63-9282-9041167bb627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:39:19.713985 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e4134a-ac7f-42a5-a783-d8e944ea6f09 None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:19.715527 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e4134a-ac7f-42a5-a783-d8e944ea6f09 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:19.716048 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e4134a-ac7f-42a5-a783-d8e944ea6f09 None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:19.717837 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 49/99] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:39:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:39:19.724892 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac13135-18e1-4c38-836d-090509146748 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:19.725509 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac13135-18e1-4c38-836d-090509146748 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:19.726053 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac13135-18e1-4c38-836d-090509146748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:19.748276 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-fac13135-18e1-4c38-836d-090509146748 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:39:19.749499 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-fac13135-18e1-4c38-836d-090509146748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:39:19.810416 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:19.866419 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 51/100] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:39:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:39:19.897721 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 50/101] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:39:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:39:19.914880 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f885843d-d472-4c63-9282-9041167bb627 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:19.942627 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac13135-18e1-4c38-836d-090509146748 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:20.111023 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac13135-18e1-4c38-836d-090509146748 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:20.122132 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f885843d-d472-4c63-9282-9041167bb627 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:20.125983 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:20.152138 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268e4ff6-baab-4208-9639-ead82a656d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:20.153040 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268e4ff6-baab-4208-9639-ead82a656d32 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:20.153331 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268e4ff6-baab-4208-9639-ead82a656d32 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:20.153632 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268e4ff6-baab-4208-9639-ead82a656d32 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:20.154817 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268e4ff6-baab-4208-9639-ead82a656d32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:20.156258 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268e4ff6-baab-4208-9639-ead82a656d32 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:20.158081 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 51/102] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:39:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:20.164327 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268e4ff6-baab-4208-9639-ead82a656d32 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:20.187209 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f1fbab-4deb-4402-8763-4cefe9074692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:20.188044 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f1fbab-4deb-4402-8763-4cefe9074692 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:20.188336 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f1fbab-4deb-4402-8763-4cefe9074692 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:20.189147 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f1fbab-4deb-4402-8763-4cefe9074692 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:20.219443 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f1fbab-4deb-4402-8763-4cefe9074692 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:39:20.227576 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-f2f1fbab-4deb-4402-8763-4cefe9074692 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 17:39:20.227576 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:39:20.227576 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:39:20.227576 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:39:20.227576 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:39:20.227576 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:39:20.227576 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:39:20.227576 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:39:20.227576 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:39:20.227576 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:39:20.227576 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:39:20.227576 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:39:20.227576 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:39:20.227576 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:39:20.227576 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:39:20.227576 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:39:20.228511 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:39:20.228511 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:39:20.228511 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:39:20.228511 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:39:20.228511 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:39:20.228511 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:39:20.228511 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:39:20.228511 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:39:20.228511 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:39:20.228511 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:39:20.228511 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:39:20.228511 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:39:20.228511 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:39:20.228511 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:39:20.228511 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:39:20.228511 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:39:20.229306 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:39:20.229306 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:39:20.229306 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:39:20.229306 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:39:20.229306 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:39:20.229306 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:39:20.229306 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:39:20.229306 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:39:20.229306 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:39:20.229306 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:39:20.229306 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 17:39:20.229306 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:39:20.237979 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 52/103] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 14 17:39:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:39:20.244470 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f1fbab-4deb-4402-8763-4cefe9074692 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:20.276077 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268e4ff6-baab-4208-9639-ead82a656d32 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:20.312858 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db52fe1e-804f-499f-a866-1911d1fd830b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:20.313553 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db52fe1e-804f-499f-a866-1911d1fd830b None admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:20.313848 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db52fe1e-804f-499f-a866-1911d1fd830b None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:20.314126 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db52fe1e-804f-499f-a866-1911d1fd830b None admin] PATH_INFO: `/v3/projects` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:20.314748 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:20.316048 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db52fe1e-804f-499f-a866-1911d1fd830b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:20.318911 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db52fe1e-804f-499f-a866-1911d1fd830b None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:20.347980 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 52/104] 10.222.0.67 () {60 vars in 1141 bytes} [Thu Jul 14 17:39:20 2022] POST /identity/v3/projects => generated 302 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:39:20.421924 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f1fbab-4deb-4402-8763-4cefe9074692 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:20.482326 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbee2887-555c-4ca9-b248-9c420d2e2cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:20.483060 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee2887-555c-4ca9-b248-9c420d2e2cdb None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:20.483351 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee2887-555c-4ca9-b248-9c420d2e2cdb None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:20.483636 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee2887-555c-4ca9-b248-9c420d2e2cdb None admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:20.484442 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbee2887-555c-4ca9-b248-9c420d2e2cdb None admin] RBAC: Adding query filter params (name=reader) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:39:20.484760 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbee2887-555c-4ca9-b248-9c420d2e2cdb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:20.486308 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbee2887-555c-4ca9-b248-9c420d2e2cdb None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:20.499264 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 53/105] 10.222.0.67 () {56 vars in 1101 bytes} [Thu Jul 14 17:39:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:20.505684 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db52fe1e-804f-499f-a866-1911d1fd830b None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:20.551211 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:20.635898 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db52fe1e-804f-499f-a866-1911d1fd830b None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:20.671523 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33b94f8-0174-4c2f-b4b4-e17986719a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:20.673315 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b94f8-0174-4c2f-b4b4-e17986719a4a None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:20.673840 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b94f8-0174-4c2f-b4b4-e17986719a4a None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:20.674311 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b94f8-0174-4c2f-b4b4-e17986719a4a None admin] PATH_INFO: `/v3/users/747d1e29cc784b14bc2534ecf99600f3` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:20.689436 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33b94f8-0174-4c2f-b4b4-e17986719a4a None admin] RBAC: Authorizing `identity:get_user(user_id=747d1e29cc784b14bc2534ecf99600f3)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:20.691211 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33b94f8-0174-4c2f-b4b4-e17986719a4a None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:20.693966 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 53/106] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 14 17:39:20 2022] GET /identity/v3/users/747d1e29cc784b14bc2534ecf99600f3 => generated 289 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:20.699599 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbee2887-555c-4ca9-b248-9c420d2e2cdb None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:20.808454 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbee2887-555c-4ca9-b248-9c420d2e2cdb None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:20.810347 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:20.844954 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fb9024-64b1-404c-a5c5-6a4f1dd8db47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:20.845990 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb9024-64b1-404c-a5c5-6a4f1dd8db47 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:20.846499 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb9024-64b1-404c-a5c5-6a4f1dd8db47 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:20.846972 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb9024-64b1-404c-a5c5-6a4f1dd8db47 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:20.919384 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fb9024-64b1-404c-a5c5-6a4f1dd8db47 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:20.921230 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fb9024-64b1-404c-a5c5-6a4f1dd8db47 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:21.030259 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 54/107] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 14 17:39:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 17:39:21.037507 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33b94f8-0174-4c2f-b4b4-e17986719a4a None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:21.153760 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13586af4-6c36-4941-ad71-26783b9cc5ab None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:21.154122 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13586af4-6c36-4941-ad71-26783b9cc5ab None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:21.154328 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13586af4-6c36-4941-ad71-26783b9cc5ab None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:21.154878 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:21.156537 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 55/108] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:39:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 17:39:21.163186 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ae9d1-2c77-441a-9fd4-ef144be116c9 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:21.163643 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ae9d1-2c77-441a-9fd4-ef144be116c9 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:21.163755 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ae9d1-2c77-441a-9fd4-ef144be116c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:21.177821 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33b94f8-0174-4c2f-b4b4-e17986719a4a None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:21.185909 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:21.196311 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-7f9ae9d1-2c77-441a-9fd4-ef144be116c9 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:39:21.197549 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-7f9ae9d1-2c77-441a-9fd4-ef144be116c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:39:21.221515 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a5b52c-a555-44e2-81f9-8ea2ac7d2257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:21.224297 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a5b52c-a555-44e2-81f9-8ea2ac7d2257 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:21.224580 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a5b52c-a555-44e2-81f9-8ea2ac7d2257 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:21.224857 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a5b52c-a555-44e2-81f9-8ea2ac7d2257 None admin] PATH_INFO: `/v3/projects/44c7c7b4ddec44b48803f27448a16a78` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:21.226798 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a5b52c-a555-44e2-81f9-8ea2ac7d2257 None admin] RBAC: Authorizing `identity:get_project(project_id=44c7c7b4ddec44b48803f27448a16a78)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:21.228263 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a5b52c-a555-44e2-81f9-8ea2ac7d2257 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:21.230190 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 54/109] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 14 17:39:21 2022] GET /identity/v3/projects/44c7c7b4ddec44b48803f27448a16a78 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:21.240237 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a5b52c-a555-44e2-81f9-8ea2ac7d2257 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:21.360132 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 56/110] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:39:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 17:39:21.403461 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9ae9d1-2c77-441a-9fd4-ef144be116c9 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:21.509596 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a5b52c-a555-44e2-81f9-8ea2ac7d2257 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:21.541275 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9ae9d1-2c77-441a-9fd4-ef144be116c9 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:21.576563 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1908ef37-1183-4a8e-9cff-ff1c916254cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:21.577277 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1908ef37-1183-4a8e-9cff-ff1c916254cf None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:21.577596 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1908ef37-1183-4a8e-9cff-ff1c916254cf None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:21.577890 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1908ef37-1183-4a8e-9cff-ff1c916254cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:21.578777 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1908ef37-1183-4a8e-9cff-ff1c916254cf None admin] RBAC: Adding query filter params (role.id=7e81381d29ef4d8c89fe53e977678bf6, scope.project.id=44c7c7b4ddec44b48803f27448a16a78, user.id=747d1e29cc784b14bc2534ecf99600f3) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:39:21.579097 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1908ef37-1183-4a8e-9cff-ff1c916254cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:21.584251 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1908ef37-1183-4a8e-9cff-ff1c916254cf None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:21.587743 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:21.594510 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 55/111] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 14 17:39:21 2022] GET /identity/v3/role_assignments?user.id=747d1e29cc784b14bc2534ecf99600f3&scope.project.id=44c7c7b4ddec44b48803f27448a16a78&role.id=7e81381d29ef4d8c89fe53e977678bf6 => generated 259 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:21.611212 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0e5511-1ee1-40eb-87b2-1f92502e21d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:21.612466 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0e5511-1ee1-40eb-87b2-1f92502e21d7 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:21.613005 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0e5511-1ee1-40eb-87b2-1f92502e21d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:21.613553 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0e5511-1ee1-40eb-87b2-1f92502e21d7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:21.637330 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0e5511-1ee1-40eb-87b2-1f92502e21d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:39:21.646002 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-1b0e5511-1ee1-40eb-87b2-1f92502e21d7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 17:39:21.646002 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:39:21.646002 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:39:21.646002 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:39:21.646002 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:39:21.646002 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:39:21.646002 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:39:21.646002 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:39:21.646002 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:39:21.646002 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:39:21.646002 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:39:21.646002 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:39:21.646002 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:39:21.646002 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:39:21.646002 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:39:21.646002 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:39:21.646976 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:39:21.646976 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:39:21.646976 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:39:21.646976 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:39:21.646976 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:39:21.646976 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:39:21.646976 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:39:21.646976 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:39:21.646976 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:39:21.646976 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:39:21.646976 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:39:21.646976 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:39:21.646976 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:39:21.646976 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:39:21.646976 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:39:21.646976 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:39:21.647747 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:39:21.647747 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:39:21.647747 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:39:21.647747 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:39:21.647747 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:39:21.647747 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:39:21.647747 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:39:21.647747 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:39:21.647747 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:39:21.647747 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:39:21.647747 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 17:39:21.647747 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:39:21.647747 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 57/112] 10.222.0.67 () {56 vars in 1114 bytes} [Thu Jul 14 17:39:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 17:39:21.653453 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1908ef37-1183-4a8e-9cff-ff1c916254cf None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:21.698546 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:21.702000 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec6b0b-b347-4fd2-94e2-f44c28037bd4 None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:21.702616 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec6b0b-b347-4fd2-94e2-f44c28037bd4 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:21.702616 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec6b0b-b347-4fd2-94e2-f44c28037bd4 None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:21.704060 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 58/113] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:39:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:39:21.714702 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5ba1b6-767e-4bec-98df-bae438b6fec0 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:21.715009 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5ba1b6-767e-4bec-98df-bae438b6fec0 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:21.715308 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5ba1b6-767e-4bec-98df-bae438b6fec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:21.755327 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-0a5ba1b6-767e-4bec-98df-bae438b6fec0 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:39:21.756578 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-0a5ba1b6-767e-4bec-98df-bae438b6fec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:39:21.856773 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1908ef37-1183-4a8e-9cff-ff1c916254cf None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:21.891875 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 59/114] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:39:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 17:39:21.893388 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30d65b8-3fff-4cc6-9c70-2bdf120f4e28 None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:21.893712 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30d65b8-3fff-4cc6-9c70-2bdf120f4e28 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:21.893998 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30d65b8-3fff-4cc6-9c70-2bdf120f4e28 None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:21.896194 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 60/115] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:39:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:39:21.901659 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6468cd87-e4ef-4785-80bf-5b6d45f271ed None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:21.901659 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6468cd87-e4ef-4785-80bf-5b6d45f271ed None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:21.901885 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6468cd87-e4ef-4785-80bf-5b6d45f271ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:21.908732 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ae445e-8574-4dce-aed5-c84bbc4c0bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:21.909781 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae445e-8574-4dce-aed5-c84bbc4c0bb5 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:21.910312 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae445e-8574-4dce-aed5-c84bbc4c0bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:21.910815 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae445e-8574-4dce-aed5-c84bbc4c0bb5 None admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:21.911769 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ae445e-8574-4dce-aed5-c84bbc4c0bb5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:39:21.912383 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ae445e-8574-4dce-aed5-c84bbc4c0bb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:21.920818 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ae445e-8574-4dce-aed5-c84bbc4c0bb5 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:21.933041 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 56/116] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 14 17:39:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:21.934400 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ae445e-8574-4dce-aed5-c84bbc4c0bb5 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:21.954604 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-6468cd87-e4ef-4785-80bf-5b6d45f271ed None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:39:21.955840 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-6468cd87-e4ef-4785-80bf-5b6d45f271ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:39:22.036072 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:22.038302 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 61/117] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:39:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:39:22.039550 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6468cd87-e4ef-4785-80bf-5b6d45f271ed None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:22.058705 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ae445e-8574-4dce-aed5-c84bbc4c0bb5 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:22.099891 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:22.112881 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5637c844-9f60-43ed-810e-c01cb200a8ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:22.115700 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5637c844-9f60-43ed-810e-c01cb200a8ab None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:22.116200 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5637c844-9f60-43ed-810e-c01cb200a8ab None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:22.116905 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5637c844-9f60-43ed-810e-c01cb200a8ab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:22.131679 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5637c844-9f60-43ed-810e-c01cb200a8ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:39:22.142873 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-5637c844-9f60-43ed-810e-c01cb200a8ab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 17:39:22.142873 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:39:22.142873 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:39:22.142873 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:39:22.142873 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:39:22.142873 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:39:22.142873 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:39:22.142873 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:39:22.142873 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:39:22.142873 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:39:22.142873 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:39:22.142873 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:39:22.142873 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:39:22.142873 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:39:22.142873 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:39:22.142873 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:39:22.143742 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:39:22.143742 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:39:22.143742 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:39:22.143742 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:39:22.143742 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:39:22.143742 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:39:22.143742 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:39:22.143742 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:39:22.143742 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:39:22.143742 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:39:22.143742 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:39:22.143742 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:39:22.143742 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:39:22.143742 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:39:22.143742 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:39:22.143742 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:39:22.144539 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:39:22.144539 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:39:22.144539 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:39:22.144539 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:39:22.144539 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:39:22.144539 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:39:22.144539 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:39:22.144539 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:39:22.144539 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:39:22.144539 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:39:22.144539 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 17:39:22.144539 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:39:22.152166 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 57/118] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 14 17:39:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:39:22.152166 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272d2937-1842-4d58-bf0b-4e0318ffd0bd None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:22.152166 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272d2937-1842-4d58-bf0b-4e0318ffd0bd None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:22.152166 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272d2937-1842-4d58-bf0b-4e0318ffd0bd None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:22.152166 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 58/119] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:39:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:39:22.152166 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272d2937-1842-4d58-bf0b-4e0318ffd0bd None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:22.166137 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6468cd87-e4ef-4785-80bf-5b6d45f271ed None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:22.203266 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bfe330-d22c-41cc-88c0-859206940635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:22.204370 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bfe330-d22c-41cc-88c0-859206940635 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:22.204663 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bfe330-d22c-41cc-88c0-859206940635 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:22.204948 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bfe330-d22c-41cc-88c0-859206940635 None admin] PATH_INFO: `/v3/users/07cbc28bcd2b49ae85b2ff52eb00af9b` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:22.206217 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bfe330-d22c-41cc-88c0-859206940635 None admin] RBAC: Authorizing `identity:get_user(user_id=07cbc28bcd2b49ae85b2ff52eb00af9b)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:22.208327 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bfe330-d22c-41cc-88c0-859206940635 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:22.210037 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 62/120] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 14 17:39:22 2022] GET /identity/v3/users/07cbc28bcd2b49ae85b2ff52eb00af9b => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:22.210813 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bfe330-d22c-41cc-88c0-859206940635 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:22.290851 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272d2937-1842-4d58-bf0b-4e0318ffd0bd None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:22.320000 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bfe330-d22c-41cc-88c0-859206940635 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:22.338742 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ed7d68-7ed2-4cb1-aef3-6a182efc5db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:22.339924 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed7d68-7ed2-4cb1-aef3-6a182efc5db9 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:22.340218 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed7d68-7ed2-4cb1-aef3-6a182efc5db9 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:22.340510 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed7d68-7ed2-4cb1-aef3-6a182efc5db9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:22.342812 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:22.356854 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ed7d68-7ed2-4cb1-aef3-6a182efc5db9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:39:22.358603 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384c7c41-52d7-45a6-bcdf-9a10acc91592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:22.359383 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c7c41-52d7-45a6-bcdf-9a10acc91592 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:22.359765 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c7c41-52d7-45a6-bcdf-9a10acc91592 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:22.360144 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c7c41-52d7-45a6-bcdf-9a10acc91592 None admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:22.361052 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384c7c41-52d7-45a6-bcdf-9a10acc91592 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:39:22.361455 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384c7c41-52d7-45a6-bcdf-9a10acc91592 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:22.362968 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384c7c41-52d7-45a6-bcdf-9a10acc91592 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:22.367786 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-36ed7d68-7ed2-4cb1-aef3-6a182efc5db9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 17:39:22.367786 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:39:22.367786 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:39:22.367786 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:39:22.367786 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:39:22.367786 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:39:22.367786 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:39:22.367786 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:39:22.367786 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:39:22.367786 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:39:22.367786 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:39:22.367786 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:39:22.367786 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:39:22.367786 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:39:22.367786 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:39:22.367786 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:39:22.368867 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:39:22.368867 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:39:22.368867 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:39:22.368867 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:39:22.368867 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:39:22.368867 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:39:22.368867 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:39:22.368867 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:39:22.368867 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:39:22.368867 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:39:22.368867 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:39:22.368867 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:39:22.368867 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:39:22.368867 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:39:22.368867 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:39:22.368867 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:39:22.369835 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:39:22.369835 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:39:22.369835 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:39:22.369835 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:39:22.369835 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:39:22.369835 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:39:22.369835 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:39:22.369835 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:39:22.369835 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:39:22.369835 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:39:22.369835 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 17:39:22.369835 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:39:22.372901 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 59/121] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 14 17:39:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:39:22.374331 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e3b93-e155-43cd-a2c1-a646a9aab7f5 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:22.374785 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e3b93-e155-43cd-a2c1-a646a9aab7f5 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:22.374904 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 63/122] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 14 17:39:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:22.375305 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e3b93-e155-43cd-a2c1-a646a9aab7f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:22.375954 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384c7c41-52d7-45a6-bcdf-9a10acc91592 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:22.385883 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:22.405758 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-fc0e3b93-e155-43cd-a2c1-a646a9aab7f5 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:39:22.407489 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-fc0e3b93-e155-43cd-a2c1-a646a9aab7f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:39:22.493962 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384c7c41-52d7-45a6-bcdf-9a10acc91592 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:22.508689 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 60/123] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:39:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:39:22.510314 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0e3b93-e155-43cd-a2c1-a646a9aab7f5 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:22.531235 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf283f4-577b-4b99-85d5-8538f27764d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:22.532521 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf283f4-577b-4b99-85d5-8538f27764d2 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:22.532900 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf283f4-577b-4b99-85d5-8538f27764d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:22.533276 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf283f4-577b-4b99-85d5-8538f27764d2 None admin] PATH_INFO: `/v3/projects/44c7c7b4ddec44b48803f27448a16a78` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:22.535038 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf283f4-577b-4b99-85d5-8538f27764d2 None admin] RBAC: Authorizing `identity:get_project(project_id=44c7c7b4ddec44b48803f27448a16a78)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:22.536730 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf283f4-577b-4b99-85d5-8538f27764d2 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:22.543614 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 64/124] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 14 17:39:22 2022] GET /identity/v3/projects/44c7c7b4ddec44b48803f27448a16a78 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:22.543614 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf283f4-577b-4b99-85d5-8538f27764d2 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:22.601931 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:22.648939 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0e3b93-e155-43cd-a2c1-a646a9aab7f5 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:22.666253 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf283f4-577b-4b99-85d5-8538f27764d2 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:22.687032 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:22.695872 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be15936-0684-4f6b-beea-d91579a4109a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:22.697132 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be15936-0684-4f6b-beea-d91579a4109a None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:22.698004 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be15936-0684-4f6b-beea-d91579a4109a None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:22.698799 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be15936-0684-4f6b-beea-d91579a4109a None admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:22.700870 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be15936-0684-4f6b-beea-d91579a4109a None admin] RBAC: Adding query filter params (name=member) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:39:22.701747 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be15936-0684-4f6b-beea-d91579a4109a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:22.703381 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be15936-0684-4f6b-beea-d91579a4109a None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:22.705773 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f987f4b6-4a9d-4789-b4dc-a81f7c9b7955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:22.707008 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f987f4b6-4a9d-4789-b4dc-a81f7c9b7955 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:22.707302 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f987f4b6-4a9d-4789-b4dc-a81f7c9b7955 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:22.708147 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f987f4b6-4a9d-4789-b4dc-a81f7c9b7955 None admin] PATH_INFO: `/v3/users/7ce563cc32c246e59d48c2a6266075e2` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:22.709343 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f987f4b6-4a9d-4789-b4dc-a81f7c9b7955 None admin] RBAC: Authorizing `identity:get_user(user_id=7ce563cc32c246e59d48c2a6266075e2)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:22.710850 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f987f4b6-4a9d-4789-b4dc-a81f7c9b7955 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:22.713363 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 65/125] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 14 17:39:22 2022] GET /identity/v3/users/7ce563cc32c246e59d48c2a6266075e2 => generated 247 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:22.714427 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f987f4b6-4a9d-4789-b4dc-a81f7c9b7955 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:22.715866 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 61/126] 10.222.0.67 () {56 vars in 1101 bytes} [Thu Jul 14 17:39:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:22.716905 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be15936-0684-4f6b-beea-d91579a4109a None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:22.834313 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be15936-0684-4f6b-beea-d91579a4109a None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:22.838295 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f987f4b6-4a9d-4789-b4dc-a81f7c9b7955 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:22.857873 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:22.870682 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b421ccd3-9d07-428d-bea2-4bc1a0914744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:22.871687 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b421ccd3-9d07-428d-bea2-4bc1a0914744 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:22.871867 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b421ccd3-9d07-428d-bea2-4bc1a0914744 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:22.872093 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b421ccd3-9d07-428d-bea2-4bc1a0914744 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:22.880546 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189d5522-5dd4-4d1b-88f4-8979e9968b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:22.881757 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189d5522-5dd4-4d1b-88f4-8979e9968b27 None admin] REQUEST_METHOD: `PUT` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:22.882248 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189d5522-5dd4-4d1b-88f4-8979e9968b27 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:22.882726 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189d5522-5dd4-4d1b-88f4-8979e9968b27 None admin] PATH_INFO: `/v3/projects/44c7c7b4ddec44b48803f27448a16a78/users/07cbc28bcd2b49ae85b2ff52eb00af9b/roles/fa9b6b80eda3440ca058cb77bd7f8f5c` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:22.883134 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b421ccd3-9d07-428d-bea2-4bc1a0914744 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:39:22.885597 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189d5522-5dd4-4d1b-88f4-8979e9968b27 None admin] RBAC: Authorizing `identity:create_grant(project_id=44c7c7b4ddec44b48803f27448a16a78, user_id=07cbc28bcd2b49ae85b2ff52eb00af9b, role_id=fa9b6b80eda3440ca058cb77bd7f8f5c)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:22.887312 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189d5522-5dd4-4d1b-88f4-8979e9968b27 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:22.891445 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-b421ccd3-9d07-428d-bea2-4bc1a0914744 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 17:39:22.891445 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:39:22.891445 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:39:22.891445 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:39:22.891445 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:39:22.891445 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:39:22.891445 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:39:22.891445 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:39:22.891445 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:39:22.891445 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:39:22.891445 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:39:22.891445 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:39:22.891445 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:39:22.891445 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:39:22.891445 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:39:22.891445 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:39:22.892403 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:39:22.892403 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:39:22.892403 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:39:22.892403 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:39:22.892403 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:39:22.892403 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:39:22.892403 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:39:22.892403 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:39:22.892403 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:39:22.892403 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:39:22.892403 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:39:22.892403 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:39:22.892403 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:39:22.892403 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:39:22.892403 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:39:22.892403 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:39:22.893201 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:39:22.893201 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:39:22.893201 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:39:22.893201 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:39:22.893201 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:39:22.893201 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:39:22.893201 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:39:22.893201 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:39:22.893201 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:39:22.893201 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:39:22.893201 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 17:39:22.893201 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:39:22.893201 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 62/127] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 14 17:39:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:39:22.893884 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b421ccd3-9d07-428d-bea2-4bc1a0914744 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:22.921468 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 66/128] 10.222.0.67 () {58 vars in 1439 bytes} [Thu Jul 14 17:39:22 2022] PUT /identity/v3/projects/44c7c7b4ddec44b48803f27448a16a78/users/07cbc28bcd2b49ae85b2ff52eb00af9b/roles/fa9b6b80eda3440ca058cb77bd7f8f5c => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:39:22.922384 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189d5522-5dd4-4d1b-88f4-8979e9968b27 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:22.955885 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:23.004909 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b421ccd3-9d07-428d-bea2-4bc1a0914744 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:23.043669 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189d5522-5dd4-4d1b-88f4-8979e9968b27 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:23.068180 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae06ed78-c083-4e9c-9b00-0a4a6fb693fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:23.069067 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06ed78-c083-4e9c-9b00-0a4a6fb693fa None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:23.069353 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06ed78-c083-4e9c-9b00-0a4a6fb693fa None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:23.069656 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06ed78-c083-4e9c-9b00-0a4a6fb693fa None admin] PATH_INFO: `/v3/projects/44c7c7b4ddec44b48803f27448a16a78` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:23.072763 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae06ed78-c083-4e9c-9b00-0a4a6fb693fa None admin] RBAC: Authorizing `identity:get_project(project_id=44c7c7b4ddec44b48803f27448a16a78)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:23.074258 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae06ed78-c083-4e9c-9b00-0a4a6fb693fa None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:23.080593 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 63/129] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 14 17:39:22 2022] GET /identity/v3/projects/44c7c7b4ddec44b48803f27448a16a78 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:23.081474 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae06ed78-c083-4e9c-9b00-0a4a6fb693fa None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:23.124300 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240edd8c-16ef-42c4-9676-c87056363b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:23.126086 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240edd8c-16ef-42c4-9676-c87056363b57 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:23.126585 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240edd8c-16ef-42c4-9676-c87056363b57 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:23.126866 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240edd8c-16ef-42c4-9676-c87056363b57 None admin] PATH_INFO: `/v3/users/07cbc28bcd2b49ae85b2ff52eb00af9b` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:23.129567 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240edd8c-16ef-42c4-9676-c87056363b57 None admin] RBAC: Authorizing `identity:get_user(user_id=07cbc28bcd2b49ae85b2ff52eb00af9b)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:23.130999 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240edd8c-16ef-42c4-9676-c87056363b57 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:23.137175 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 67/130] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 14 17:39:22 2022] GET /identity/v3/users/07cbc28bcd2b49ae85b2ff52eb00af9b => generated 275 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:23.137482 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240edd8c-16ef-42c4-9676-c87056363b57 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:23.197132 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:23.229491 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae06ed78-c083-4e9c-9b00-0a4a6fb693fa None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:23.254202 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:23.259446 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240edd8c-16ef-42c4-9676-c87056363b57 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:23.267936 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce501bc-5471-441b-9706-0418476f81be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:23.268961 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce501bc-5471-441b-9706-0418476f81be None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:23.269461 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce501bc-5471-441b-9706-0418476f81be None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:23.269976 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce501bc-5471-441b-9706-0418476f81be None admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:23.271016 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce501bc-5471-441b-9706-0418476f81be None admin] RBAC: Adding query filter params (name=member) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:39:23.271543 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce501bc-5471-441b-9706-0418476f81be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:23.273166 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce501bc-5471-441b-9706-0418476f81be None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:23.282461 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 64/131] 10.222.0.67 () {56 vars in 1101 bytes} [Thu Jul 14 17:39:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:23.283632 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce501bc-5471-441b-9706-0418476f81be None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:23.301949 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c77f579-a110-4be6-acfd-492a5299e01c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:23.302887 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77f579-a110-4be6-acfd-492a5299e01c None admin] REQUEST_METHOD: `PUT` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:23.303225 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77f579-a110-4be6-acfd-492a5299e01c None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:23.303512 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77f579-a110-4be6-acfd-492a5299e01c None admin] PATH_INFO: `/v3/projects/44c7c7b4ddec44b48803f27448a16a78/users/7ce563cc32c246e59d48c2a6266075e2/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:23.305759 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c77f579-a110-4be6-acfd-492a5299e01c None admin] RBAC: Authorizing `identity:create_grant(project_id=44c7c7b4ddec44b48803f27448a16a78, user_id=7ce563cc32c246e59d48c2a6266075e2, role_id=4651a1cc7b4d4ab7a7a9ca1e77e58e71)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:23.307274 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c77f579-a110-4be6-acfd-492a5299e01c None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:23.330493 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 68/132] 10.222.0.67 () {58 vars in 1439 bytes} [Thu Jul 14 17:39:23 2022] PUT /identity/v3/projects/44c7c7b4ddec44b48803f27448a16a78/users/7ce563cc32c246e59d48c2a6266075e2/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:39:23.331742 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c77f579-a110-4be6-acfd-492a5299e01c None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:23.496542 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce501bc-5471-441b-9706-0418476f81be None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:23.502574 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c77f579-a110-4be6-acfd-492a5299e01c None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:23.518830 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:23.542454 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e48f47-4a0e-4315-aca4-f5270e5f287a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:23.543731 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e48f47-4a0e-4315-aca4-f5270e5f287a None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:23.544232 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e48f47-4a0e-4315-aca4-f5270e5f287a None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:23.544744 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e48f47-4a0e-4315-aca4-f5270e5f287a None admin] PATH_INFO: `/v3/users/07cbc28bcd2b49ae85b2ff52eb00af9b` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:23.546330 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e48f47-4a0e-4315-aca4-f5270e5f287a None admin] RBAC: Authorizing `identity:get_user(user_id=07cbc28bcd2b49ae85b2ff52eb00af9b)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:23.548071 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e48f47-4a0e-4315-aca4-f5270e5f287a None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:23.550099 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 69/133] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 14 17:39:23 2022] GET /identity/v3/users/07cbc28bcd2b49ae85b2ff52eb00af9b => generated 275 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:23.552347 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd6eb7-14c8-48d8-b65b-91bc7240ac61 None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:23.552839 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd6eb7-14c8-48d8-b65b-91bc7240ac61 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:23.553330 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd6eb7-14c8-48d8-b65b-91bc7240ac61 None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:23.554858 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 70/134] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:39:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:39:23.562818 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb32bbc-c1ca-4c88-90c5-45acd83ef669 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:23.563446 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb32bbc-c1ca-4c88-90c5-45acd83ef669 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:23.563919 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb32bbc-c1ca-4c88-90c5-45acd83ef669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:23.569685 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a509e7-d0ab-4a52-914a-0e98168cbf5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:23.570751 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a509e7-d0ab-4a52-914a-0e98168cbf5c None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:23.571207 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a509e7-d0ab-4a52-914a-0e98168cbf5c None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:23.571623 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a509e7-d0ab-4a52-914a-0e98168cbf5c None admin] PATH_INFO: `/v3/projects/4942e68ff7384c3aadf824bb57309ea4` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:23.573138 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a509e7-d0ab-4a52-914a-0e98168cbf5c None admin] RBAC: Authorizing `identity:get_project(project_id=4942e68ff7384c3aadf824bb57309ea4)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:23.574802 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a509e7-d0ab-4a52-914a-0e98168cbf5c None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:23.576775 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 65/135] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 14 17:39:23 2022] GET /identity/v3/projects/4942e68ff7384c3aadf824bb57309ea4 => generated 312 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:23.577794 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a509e7-d0ab-4a52-914a-0e98168cbf5c None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:23.589683 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-abb32bbc-c1ca-4c88-90c5-45acd83ef669 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:39:23.590903 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-abb32bbc-c1ca-4c88-90c5-45acd83ef669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:39:23.645166 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:23.683906 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 71/136] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:39:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:39:23.685039 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb32bbc-c1ca-4c88-90c5-45acd83ef669 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:23.706246 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a509e7-d0ab-4a52-914a-0e98168cbf5c None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:23.767738 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac7056a-ee80-442a-b3ed-dfb9e8a6ddc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:23.768477 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac7056a-ee80-442a-b3ed-dfb9e8a6ddc9 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:23.768862 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac7056a-ee80-442a-b3ed-dfb9e8a6ddc9 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:23.769209 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac7056a-ee80-442a-b3ed-dfb9e8a6ddc9 None admin] PATH_INFO: `/v3/projects/44c7c7b4ddec44b48803f27448a16a78` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:23.770805 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac7056a-ee80-442a-b3ed-dfb9e8a6ddc9 None admin] RBAC: Authorizing `identity:get_project(project_id=44c7c7b4ddec44b48803f27448a16a78)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:23.772424 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac7056a-ee80-442a-b3ed-dfb9e8a6ddc9 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:23.774558 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 66/137] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 14 17:39:23 2022] GET /identity/v3/projects/44c7c7b4ddec44b48803f27448a16a78 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:23.775524 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac7056a-ee80-442a-b3ed-dfb9e8a6ddc9 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:23.797153 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb32bbc-c1ca-4c88-90c5-45acd83ef669 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:23.800923 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:23.836445 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0d8c1c-cfe5-45d8-95ea-5cac408eedfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:23.837667 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0d8c1c-cfe5-45d8-95ea-5cac408eedfe None admin] REQUEST_METHOD: `PUT` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:23.838127 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0d8c1c-cfe5-45d8-95ea-5cac408eedfe None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:23.838600 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0d8c1c-cfe5-45d8-95ea-5cac408eedfe None admin] PATH_INFO: `/v3/projects/4942e68ff7384c3aadf824bb57309ea4/users/07cbc28bcd2b49ae85b2ff52eb00af9b/roles/95d753870f97426cb1ce32e078621a4c` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:23.840891 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0d8c1c-cfe5-45d8-95ea-5cac408eedfe None admin] RBAC: Authorizing `identity:create_grant(project_id=4942e68ff7384c3aadf824bb57309ea4, user_id=07cbc28bcd2b49ae85b2ff52eb00af9b, role_id=95d753870f97426cb1ce32e078621a4c)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:23.842596 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0d8c1c-cfe5-45d8-95ea-5cac408eedfe None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:23.860699 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 72/138] 10.222.0.67 () {58 vars in 1439 bytes} [Thu Jul 14 17:39:23 2022] PUT /identity/v3/projects/4942e68ff7384c3aadf824bb57309ea4/users/07cbc28bcd2b49ae85b2ff52eb00af9b/roles/95d753870f97426cb1ce32e078621a4c => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:39:23.861984 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0d8c1c-cfe5-45d8-95ea-5cac408eedfe None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:23.976728 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac7056a-ee80-442a-b3ed-dfb9e8a6ddc9 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:24.019411 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:24.043378 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b8bb0a-494a-48f4-9920-6e6ea3d7dbe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:24.044305 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b8bb0a-494a-48f4-9920-6e6ea3d7dbe1 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:24.044593 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b8bb0a-494a-48f4-9920-6e6ea3d7dbe1 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:24.044868 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b8bb0a-494a-48f4-9920-6e6ea3d7dbe1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:24.046148 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b8bb0a-494a-48f4-9920-6e6ea3d7dbe1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:24.047664 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b8bb0a-494a-48f4-9920-6e6ea3d7dbe1 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:24.049670 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 67/139] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:39:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:24.055367 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b8bb0a-494a-48f4-9920-6e6ea3d7dbe1 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:24.150325 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0d8c1c-cfe5-45d8-95ea-5cac408eedfe None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:24.174636 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b8bb0a-494a-48f4-9920-6e6ea3d7dbe1 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:24.241955 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a282ab-d386-4921-801b-94d80202832f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:24.242887 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a282ab-d386-4921-801b-94d80202832f None admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:24.243504 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a282ab-d386-4921-801b-94d80202832f None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:24.243877 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a282ab-d386-4921-801b-94d80202832f None admin] PATH_INFO: `/v3/users` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:24.244627 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a282ab-d386-4921-801b-94d80202832f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:24.246160 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a282ab-d386-4921-801b-94d80202832f None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:24.246268 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9f097f-20a0-4150-b118-41b6d9817cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:24.247162 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f097f-20a0-4150-b118-41b6d9817cfd None admin] REQUEST_METHOD: `PUT` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:24.247451 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f097f-20a0-4150-b118-41b6d9817cfd None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:24.247738 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f097f-20a0-4150-b118-41b6d9817cfd None admin] PATH_INFO: `/v3/projects/44c7c7b4ddec44b48803f27448a16a78/users/07cbc28bcd2b49ae85b2ff52eb00af9b/roles/95d753870f97426cb1ce32e078621a4c` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:24.254431 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9f097f-20a0-4150-b118-41b6d9817cfd None admin] RBAC: Authorizing `identity:create_grant(project_id=44c7c7b4ddec44b48803f27448a16a78, user_id=07cbc28bcd2b49ae85b2ff52eb00af9b, role_id=95d753870f97426cb1ce32e078621a4c)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:24.256007 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9f097f-20a0-4150-b118-41b6d9817cfd None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:24.274796 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 68/140] 10.222.0.67 () {60 vars in 1132 bytes} [Thu Jul 14 17:39:24 2022] POST /identity/v3/users => generated 283 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:39:24.276196 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3fb5af-babf-4e94-9dbd-25b8f31a6e6d None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:24.276503 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3fb5af-babf-4e94-9dbd-25b8f31a6e6d None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:24.276821 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3fb5af-babf-4e94-9dbd-25b8f31a6e6d None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:24.282919 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 69/141] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:39:24 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:39:24.290779 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 73/142] 10.222.0.67 () {58 vars in 1439 bytes} [Thu Jul 14 17:39:23 2022] PUT /identity/v3/projects/44c7c7b4ddec44b48803f27448a16a78/users/07cbc28bcd2b49ae85b2ff52eb00af9b/roles/95d753870f97426cb1ce32e078621a4c => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:39:24.292834 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a112b190-8529-44b3-bdaf-6601bc61bd52 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:24.292834 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a112b190-8529-44b3-bdaf-6601bc61bd52 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:24.292834 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a112b190-8529-44b3-bdaf-6601bc61bd52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:24.313119 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-a112b190-8529-44b3-bdaf-6601bc61bd52 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:39:24.314413 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-a112b190-8529-44b3-bdaf-6601bc61bd52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:39:24.366203 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:24.399172 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 70/143] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:39:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 17:39:24.422913 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9f097f-20a0-4150-b118-41b6d9817cfd None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:24.454995 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:24.547627 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9f097f-20a0-4150-b118-41b6d9817cfd None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:24.590742 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03effd7-77e3-446c-9aad-13971cec1f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:24.591759 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03effd7-77e3-446c-9aad-13971cec1f25 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:24.592058 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03effd7-77e3-446c-9aad-13971cec1f25 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:24.592351 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03effd7-77e3-446c-9aad-13971cec1f25 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:24.606701 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03effd7-77e3-446c-9aad-13971cec1f25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:39:24.617178 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-d03effd7-77e3-446c-9aad-13971cec1f25 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 17:39:24.617178 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:39:24.617178 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:39:24.617178 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:39:24.617178 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:39:24.617178 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:39:24.617178 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:39:24.617178 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:39:24.617178 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:39:24.617178 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:39:24.617178 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:39:24.617178 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:39:24.617178 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:39:24.617178 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:39:24.617178 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:39:24.617178 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:39:24.618137 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:39:24.618137 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:39:24.618137 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:39:24.618137 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:39:24.618137 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:39:24.618137 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:39:24.618137 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:39:24.618137 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:39:24.618137 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:39:24.618137 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:39:24.618137 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:39:24.618137 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:39:24.618137 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:39:24.618137 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:39:24.618137 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:39:24.618137 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:39:24.618939 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:39:24.618939 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:39:24.618939 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:39:24.618939 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:39:24.618939 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:39:24.618939 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:39:24.618939 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:39:24.618939 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:39:24.618939 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:39:24.618939 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:39:24.618939 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 17:39:24.618939 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:39:24.618939 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 74/144] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 14 17:39:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:39:24.625695 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a112b190-8529-44b3-bdaf-6601bc61bd52 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:24.736956 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a112b190-8529-44b3-bdaf-6601bc61bd52 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:24.777637 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d1160-e2be-4272-90d6-7f2e3c863d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:24.778363 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d1160-e2be-4272-90d6-7f2e3c863d05 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:24.778662 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d1160-e2be-4272-90d6-7f2e3c863d05 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:24.778938 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d1160-e2be-4272-90d6-7f2e3c863d05 None admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:24.779702 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9d1160-e2be-4272-90d6-7f2e3c863d05 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:39:24.780147 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9d1160-e2be-4272-90d6-7f2e3c863d05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:24.781920 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9d1160-e2be-4272-90d6-7f2e3c863d05 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:24.793077 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 71/145] 10.222.0.67 () {56 vars in 1101 bytes} [Thu Jul 14 17:39:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:24.799273 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03effd7-77e3-446c-9aad-13971cec1f25 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:24.911770 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:24.930707 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03effd7-77e3-446c-9aad-13971cec1f25 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:24.979327 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54fdc32-2ad3-42f9-8b66-2e154e6001dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:24.980253 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54fdc32-2ad3-42f9-8b66-2e154e6001dd None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:24.980542 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54fdc32-2ad3-42f9-8b66-2e154e6001dd None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:24.980818 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54fdc32-2ad3-42f9-8b66-2e154e6001dd None admin] PATH_INFO: `/v3/users/747d1e29cc784b14bc2534ecf99600f3` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:24.982237 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54fdc32-2ad3-42f9-8b66-2e154e6001dd None admin] RBAC: Authorizing `identity:get_user(user_id=747d1e29cc784b14bc2534ecf99600f3)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:24.983755 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54fdc32-2ad3-42f9-8b66-2e154e6001dd None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:24.985554 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 75/146] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 14 17:39:24 2022] GET /identity/v3/users/747d1e29cc784b14bc2534ecf99600f3 => generated 289 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:24.991447 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d1160-e2be-4272-90d6-7f2e3c863d05 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:25.055099 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:25.139218 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d1160-e2be-4272-90d6-7f2e3c863d05 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:25.178194 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd87244-892c-46e2-81dc-75293c7d0174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:25.179422 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd87244-892c-46e2-81dc-75293c7d0174 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:25.179902 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd87244-892c-46e2-81dc-75293c7d0174 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:25.180395 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd87244-892c-46e2-81dc-75293c7d0174 None admin] PATH_INFO: `/v3/projects/44c7c7b4ddec44b48803f27448a16a78` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:25.181986 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd87244-892c-46e2-81dc-75293c7d0174 None admin] RBAC: Authorizing `identity:get_project(project_id=44c7c7b4ddec44b48803f27448a16a78)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:25.183677 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd87244-892c-46e2-81dc-75293c7d0174 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:25.185665 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 72/147] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 14 17:39:24 2022] GET /identity/v3/projects/44c7c7b4ddec44b48803f27448a16a78 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:25.191397 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54fdc32-2ad3-42f9-8b66-2e154e6001dd None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:25.366341 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54fdc32-2ad3-42f9-8b66-2e154e6001dd None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:25.406703 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9759dd-b98a-4231-89cc-f0e2d0fb9d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:25.407950 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9759dd-b98a-4231-89cc-f0e2d0fb9d99 None admin] REQUEST_METHOD: `PUT` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:25.408428 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9759dd-b98a-4231-89cc-f0e2d0fb9d99 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:25.408917 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9759dd-b98a-4231-89cc-f0e2d0fb9d99 None admin] PATH_INFO: `/v3/projects/44c7c7b4ddec44b48803f27448a16a78/users/747d1e29cc784b14bc2534ecf99600f3/roles/7e81381d29ef4d8c89fe53e977678bf6` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:25.412691 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9759dd-b98a-4231-89cc-f0e2d0fb9d99 None admin] RBAC: Authorizing `identity:create_grant(project_id=44c7c7b4ddec44b48803f27448a16a78, user_id=747d1e29cc784b14bc2534ecf99600f3, role_id=7e81381d29ef4d8c89fe53e977678bf6)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:25.414395 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9759dd-b98a-4231-89cc-f0e2d0fb9d99 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:25.434592 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 76/148] 10.222.0.67 () {58 vars in 1439 bytes} [Thu Jul 14 17:39:25 2022] PUT /identity/v3/projects/44c7c7b4ddec44b48803f27448a16a78/users/747d1e29cc784b14bc2534ecf99600f3/roles/7e81381d29ef4d8c89fe53e977678bf6 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:39:25.953864 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac18502-7cf5-4253-a291-1558da4e6bea None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:25.954864 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac18502-7cf5-4253-a291-1558da4e6bea None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:25.955375 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac18502-7cf5-4253-a291-1558da4e6bea None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:25.956940 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 73/149] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:39:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:39:25.971144 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb0c975-a5c7-406d-af36-1de9b359e851 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:25.972074 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb0c975-a5c7-406d-af36-1de9b359e851 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:25.972552 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb0c975-a5c7-406d-af36-1de9b359e851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:25.995243 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-aeb0c975-a5c7-406d-af36-1de9b359e851 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:39:25.996826 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-aeb0c975-a5c7-406d-af36-1de9b359e851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:39:26.007822 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:26.084607 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 77/150] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:39:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:39:26.120444 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac18502-7cf5-4253-a291-1558da4e6bea None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:26.242301 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac18502-7cf5-4253-a291-1558da4e6bea None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:26.245151 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:26.289478 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388fc137-d3ef-40e7-8af5-cec9668932d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:26.290717 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388fc137-d3ef-40e7-8af5-cec9668932d0 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:26.291197 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388fc137-d3ef-40e7-8af5-cec9668932d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:26.291665 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388fc137-d3ef-40e7-8af5-cec9668932d0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:26.313373 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388fc137-d3ef-40e7-8af5-cec9668932d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:39:26.322453 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-388fc137-d3ef-40e7-8af5-cec9668932d0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 17:39:26.322453 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:39:26.322453 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:39:26.322453 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:39:26.322453 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:39:26.322453 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:39:26.322453 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:39:26.322453 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:39:26.322453 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:39:26.322453 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:39:26.322453 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:39:26.322453 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:39:26.322453 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:39:26.322453 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:39:26.322453 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:39:26.322453 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:39:26.323451 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:39:26.323451 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:39:26.323451 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:39:26.323451 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:39:26.323451 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:39:26.323451 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:39:26.323451 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:39:26.323451 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:39:26.323451 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:39:26.323451 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:39:26.323451 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:39:26.323451 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:39:26.323451 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:39:26.323451 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:39:26.323451 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:39:26.323451 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:39:26.324229 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:39:26.324229 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:39:26.324229 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:39:26.324229 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:39:26.324229 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:39:26.324229 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:39:26.324229 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:39:26.324229 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:39:26.324229 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:39:26.324229 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:39:26.324229 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 17:39:26.324229 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:39:26.326653 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 74/151] 10.222.0.67 () {56 vars in 1114 bytes} [Thu Jul 14 17:39:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:39:26.333390 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb0c975-a5c7-406d-af36-1de9b359e851 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:26.465492 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb0c975-a5c7-406d-af36-1de9b359e851 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:26.524771 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a396c3d-5c4d-4d0d-9d88-f7e2e9fb03c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:26.525378 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a396c3d-5c4d-4d0d-9d88-f7e2e9fb03c5 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:26.525696 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a396c3d-5c4d-4d0d-9d88-f7e2e9fb03c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:26.525974 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a396c3d-5c4d-4d0d-9d88-f7e2e9fb03c5 None admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:26.526750 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a396c3d-5c4d-4d0d-9d88-f7e2e9fb03c5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:39:26.527058 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a396c3d-5c4d-4d0d-9d88-f7e2e9fb03c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:26.528443 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a396c3d-5c4d-4d0d-9d88-f7e2e9fb03c5 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:26.541444 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 78/152] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 14 17:39:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:26.547057 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388fc137-d3ef-40e7-8af5-cec9668932d0 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:26.689704 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388fc137-d3ef-40e7-8af5-cec9668932d0 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:26.739159 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9712cec6-444e-4f09-bf12-8ec5edb5713c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:26.740653 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9712cec6-444e-4f09-bf12-8ec5edb5713c None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:26.741135 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9712cec6-444e-4f09-bf12-8ec5edb5713c None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:26.741629 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9712cec6-444e-4f09-bf12-8ec5edb5713c None admin] PATH_INFO: `/v3/users/07cbc28bcd2b49ae85b2ff52eb00af9b` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:26.743084 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9712cec6-444e-4f09-bf12-8ec5edb5713c None admin] RBAC: Authorizing `identity:get_user(user_id=07cbc28bcd2b49ae85b2ff52eb00af9b)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:26.744738 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9712cec6-444e-4f09-bf12-8ec5edb5713c None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:26.746601 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 75/153] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 14 17:39:26 2022] GET /identity/v3/users/07cbc28bcd2b49ae85b2ff52eb00af9b => generated 275 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:26.752385 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a396c3d-5c4d-4d0d-9d88-f7e2e9fb03c5 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:26.767666 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:26.921416 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a396c3d-5c4d-4d0d-9d88-f7e2e9fb03c5 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:26.963363 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08306fcf-8cc1-48c0-9bd2-ede85634ae51 None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:26.964316 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08306fcf-8cc1-48c0-9bd2-ede85634ae51 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:26.964794 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08306fcf-8cc1-48c0-9bd2-ede85634ae51 None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:26.966403 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 76/154] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:39:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:39:26.969575 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef88b572-6ffb-423f-8804-6c0a1b68c190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:26.969575 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef88b572-6ffb-423f-8804-6c0a1b68c190 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:26.969575 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef88b572-6ffb-423f-8804-6c0a1b68c190 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:26.969575 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef88b572-6ffb-423f-8804-6c0a1b68c190 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:26.971981 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68522af-bef9-4de6-89ee-ada90b3eb110 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:26.972507 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68522af-bef9-4de6-89ee-ada90b3eb110 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:26.973026 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68522af-bef9-4de6-89ee-ada90b3eb110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:27.014260 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-c68522af-bef9-4de6-89ee-ada90b3eb110 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:39:27.017030 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-c68522af-bef9-4de6-89ee-ada90b3eb110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:39:27.061558 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:27.086253 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef88b572-6ffb-423f-8804-6c0a1b68c190 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:27.087847 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef88b572-6ffb-423f-8804-6c0a1b68c190 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:27.093553 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:27.134639 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 77/155] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:39:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:39:27.218774 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68522af-bef9-4de6-89ee-ada90b3eb110 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:27.235793 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 79/156] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 14 17:39:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 17:39:27.245553 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef88b572-6ffb-423f-8804-6c0a1b68c190 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:27.353230 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef88b572-6ffb-423f-8804-6c0a1b68c190 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:27.355749 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:27.383797 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68522af-bef9-4de6-89ee-ada90b3eb110 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:27.402944 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7ed790-3dae-43c7-b94c-4cf048e883a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:27.404146 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ed790-3dae-43c7-b94c-4cf048e883a2 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:27.404602 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ed790-3dae-43c7-b94c-4cf048e883a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:27.405022 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ed790-3dae-43c7-b94c-4cf048e883a2 None admin] PATH_INFO: `/v3/projects/44c7c7b4ddec44b48803f27448a16a78` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:27.406839 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7ed790-3dae-43c7-b94c-4cf048e883a2 None admin] RBAC: Authorizing `identity:get_project(project_id=44c7c7b4ddec44b48803f27448a16a78)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:27.408513 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7ed790-3dae-43c7-b94c-4cf048e883a2 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:27.411178 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 80/157] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 14 17:39:27 2022] GET /identity/v3/projects/44c7c7b4ddec44b48803f27448a16a78 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:27.417200 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7ed790-3dae-43c7-b94c-4cf048e883a2 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:27.431838 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d3d68f-3814-473d-92d0-7cd26215d926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:27.432750 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d3d68f-3814-473d-92d0-7cd26215d926 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:27.433131 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d3d68f-3814-473d-92d0-7cd26215d926 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:27.433554 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d3d68f-3814-473d-92d0-7cd26215d926 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:27.471239 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d3d68f-3814-473d-92d0-7cd26215d926 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:39:27.484663 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-36d3d68f-3814-473d-92d0-7cd26215d926 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 17:39:27.484663 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:39:27.484663 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:39:27.484663 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:39:27.484663 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:39:27.484663 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:39:27.484663 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:39:27.484663 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:39:27.484663 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:39:27.484663 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:39:27.484663 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:39:27.484663 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:39:27.484663 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:39:27.484663 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:39:27.484663 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:39:27.484663 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:39:27.485748 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:39:27.485748 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:39:27.485748 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:39:27.485748 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:39:27.485748 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:39:27.485748 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:39:27.485748 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:39:27.485748 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:39:27.485748 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:39:27.485748 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:39:27.485748 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:39:27.485748 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:39:27.485748 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:39:27.485748 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:39:27.485748 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:39:27.485748 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:39:27.486549 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:39:27.486549 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:39:27.486549 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:39:27.486549 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:39:27.486549 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:39:27.486549 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:39:27.486549 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:39:27.486549 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:39:27.486549 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:39:27.486549 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:39:27.486549 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 17:39:27.486549 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:39:27.486549 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 78/158] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 14 17:39:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:39:27.494629 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d3d68f-3814-473d-92d0-7cd26215d926 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:27.540370 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:27.713464 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7ed790-3dae-43c7-b94c-4cf048e883a2 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:27.729596 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d3d68f-3814-473d-92d0-7cd26215d926 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:27.818787 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6a12f3-c0bf-4e54-a076-bf979ac24a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:27.819504 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a12f3-c0bf-4e54-a076-bf979ac24a2b None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:27.819784 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a12f3-c0bf-4e54-a076-bf979ac24a2b None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:27.820057 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a12f3-c0bf-4e54-a076-bf979ac24a2b None admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:27.820954 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6a12f3-c0bf-4e54-a076-bf979ac24a2b None admin] RBAC: Adding query filter params (name=admin) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:39:27.821052 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d0c4e3-6691-4b33-82f2-56aa383d155d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:27.821266 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6a12f3-c0bf-4e54-a076-bf979ac24a2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:27.821681 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d0c4e3-6691-4b33-82f2-56aa383d155d None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:27.821971 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d0c4e3-6691-4b33-82f2-56aa383d155d None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:27.822248 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d0c4e3-6691-4b33-82f2-56aa383d155d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:27.822751 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6a12f3-c0bf-4e54-a076-bf979ac24a2b None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:27.823128 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d0c4e3-6691-4b33-82f2-56aa383d155d None admin] RBAC: Adding query filter params (role.id=fa9b6b80eda3440ca058cb77bd7f8f5c, scope.project.id=44c7c7b4ddec44b48803f27448a16a78, user.id=07cbc28bcd2b49ae85b2ff52eb00af9b) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:39:27.823450 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d0c4e3-6691-4b33-82f2-56aa383d155d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:27.824971 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d0c4e3-6691-4b33-82f2-56aa383d155d None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:27.837347 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 81/159] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 14 17:39:27 2022] GET /identity/v3/role_assignments?user.id=07cbc28bcd2b49ae85b2ff52eb00af9b&scope.project.id=44c7c7b4ddec44b48803f27448a16a78&role.id=fa9b6b80eda3440ca058cb77bd7f8f5c => generated 608 bytes in 420 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:39:27.839931 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 79/160] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 14 17:39:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:39:27.845646 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d0c4e3-6691-4b33-82f2-56aa383d155d None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:27.895657 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2498cc80-d498-4313-a58a-0f29e4ddb2f4 None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:27.895974 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2498cc80-d498-4313-a58a-0f29e4ddb2f4 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:27.896210 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2498cc80-d498-4313-a58a-0f29e4ddb2f4 None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:27.898878 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 80/161] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:39:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:39:27.903378 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d193f-7507-4a73-9cf3-2c309e72093a None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:27.903675 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d193f-7507-4a73-9cf3-2c309e72093a None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:27.903936 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d193f-7507-4a73-9cf3-2c309e72093a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:27.925163 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:27.943307 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-105d193f-7507-4a73-9cf3-2c309e72093a None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:39:27.944539 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-105d193f-7507-4a73-9cf3-2c309e72093a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:39:28.060668 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d0c4e3-6691-4b33-82f2-56aa383d155d None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:28.121813 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 81/162] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:39:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 17:39:28.124292 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08c3fb0-9e16-4759-8fef-8f2c66519456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:28.125829 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c3fb0-9e16-4759-8fef-8f2c66519456 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:28.126376 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c3fb0-9e16-4759-8fef-8f2c66519456 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:28.126842 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c3fb0-9e16-4759-8fef-8f2c66519456 None admin] PATH_INFO: `/v3/users/7ce563cc32c246e59d48c2a6266075e2` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:28.131106 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08c3fb0-9e16-4759-8fef-8f2c66519456 None admin] RBAC: Authorizing `identity:get_user(user_id=7ce563cc32c246e59d48c2a6266075e2)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:28.132883 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08c3fb0-9e16-4759-8fef-8f2c66519456 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:28.134836 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 82/163] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 14 17:39:27 2022] GET /identity/v3/users/7ce563cc32c246e59d48c2a6266075e2 => generated 247 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:28.140300 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105d193f-7507-4a73-9cf3-2c309e72093a None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:28.167208 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:28.179837 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08c3fb0-9e16-4759-8fef-8f2c66519456 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:28.356204 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105d193f-7507-4a73-9cf3-2c309e72093a None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:28.425218 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08c3fb0-9e16-4759-8fef-8f2c66519456 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:28.431312 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:28.432359 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626840bd-53ba-4c64-ba15-db87ed62ecbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:28.433260 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626840bd-53ba-4c64-ba15-db87ed62ecbc None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:28.433875 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626840bd-53ba-4c64-ba15-db87ed62ecbc None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:28.434336 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626840bd-53ba-4c64-ba15-db87ed62ecbc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:28.526952 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6262f9f2-bb2e-4599-9d3b-68a5959a043e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:28.527785 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262f9f2-bb2e-4599-9d3b-68a5959a043e None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:28.528072 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262f9f2-bb2e-4599-9d3b-68a5959a043e None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:28.528347 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262f9f2-bb2e-4599-9d3b-68a5959a043e None admin] PATH_INFO: `/v3/roles/member` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:28.556316 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6262f9f2-bb2e-4599-9d3b-68a5959a043e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:39:28.564220 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-6262f9f2-bb2e-4599-9d3b-68a5959a043e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 17:39:28.564220 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:39:28.564220 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:39:28.564220 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:39:28.564220 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:39:28.564220 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:39:28.564220 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:39:28.564220 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:39:28.564220 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:39:28.564220 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:39:28.564220 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:39:28.564220 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:39:28.564220 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:39:28.564220 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:39:28.564220 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:39:28.564220 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:39:28.565152 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:39:28.565152 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:39:28.565152 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:39:28.565152 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:39:28.565152 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:39:28.565152 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:39:28.565152 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:39:28.565152 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:39:28.565152 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:39:28.565152 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:39:28.565152 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:39:28.565152 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:39:28.565152 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:39:28.565152 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:39:28.565152 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:39:28.565152 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:39:28.565985 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:39:28.565985 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:39:28.565985 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:39:28.565985 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:39:28.565985 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:39:28.565985 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:39:28.565985 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:39:28.565985 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:39:28.565985 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:39:28.565985 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:39:28.565985 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 17:39:28.565985 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:39:28.565985 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 83/164] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 14 17:39:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 386 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:39:28.566895 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa581f9d-821b-4b69-be02-c1c31bf94430 None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:28.567269 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa581f9d-821b-4b69-be02-c1c31bf94430 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:28.567375 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa581f9d-821b-4b69-be02-c1c31bf94430 None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:28.568783 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 84/165] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:39:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:39:28.573616 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa581f9d-821b-4b69-be02-c1c31bf94430 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:28.582259 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626840bd-53ba-4c64-ba15-db87ed62ecbc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:28.584401 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626840bd-53ba-4c64-ba15-db87ed62ecbc None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:28.603628 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:28.704452 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 82/166] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 14 17:39:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 564 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 17:39:28.705702 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5029a765-8416-403f-9e03-522184a8bf0e None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:28.706570 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5029a765-8416-403f-9e03-522184a8bf0e None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:28.706849 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5029a765-8416-403f-9e03-522184a8bf0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:28.739132 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-5029a765-8416-403f-9e03-522184a8bf0e None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:39:28.740587 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-5029a765-8416-403f-9e03-522184a8bf0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:39:28.851204 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa581f9d-821b-4b69-be02-c1c31bf94430 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:28.883893 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 83/167] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:39:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:39:28.884757 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5029a765-8416-403f-9e03-522184a8bf0e None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:28.891767 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee382802-ab01-4d06-9236-42cd609d68bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:28.892697 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee382802-ab01-4d06-9236-42cd609d68bb None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:28.892977 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee382802-ab01-4d06-9236-42cd609d68bb None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:28.893249 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee382802-ab01-4d06-9236-42cd609d68bb None admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:28.903142 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee382802-ab01-4d06-9236-42cd609d68bb None admin] RBAC: Adding query filter params (name=member) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:39:28.903458 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee382802-ab01-4d06-9236-42cd609d68bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:28.904873 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee382802-ab01-4d06-9236-42cd609d68bb None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:28.930776 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 85/168] 10.222.0.67 () {56 vars in 1101 bytes} [Thu Jul 14 17:39:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:39:28.932045 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f624d-a8c7-4cb0-b9e5-9a3b3b99db91 None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:28.932337 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f624d-a8c7-4cb0-b9e5-9a3b3b99db91 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:28.932610 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f624d-a8c7-4cb0-b9e5-9a3b3b99db91 None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:28.934145 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 86/169] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:39:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:39:28.948311 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aed16f-c133-4d49-9910-951649396a82 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:28.948311 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aed16f-c133-4d49-9910-951649396a82 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:28.948311 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aed16f-c133-4d49-9910-951649396a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:28.967840 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:28.980868 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-21aed16f-c133-4d49-9910-951649396a82 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:39:28.982087 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-21aed16f-c133-4d49-9910-951649396a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:39:29.021428 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:29.029567 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5029a765-8416-403f-9e03-522184a8bf0e None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:29.066768 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63e7e60-83a8-4f36-8617-8a07757b1d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:29.068019 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e7e60-83a8-4f36-8617-8a07757b1d8c None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:29.068541 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e7e60-83a8-4f36-8617-8a07757b1d8c None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:29.069012 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e7e60-83a8-4f36-8617-8a07757b1d8c None admin] PATH_INFO: `/v3/projects/44c7c7b4ddec44b48803f27448a16a78` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:29.070508 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63e7e60-83a8-4f36-8617-8a07757b1d8c None admin] RBAC: Authorizing `identity:get_project(project_id=44c7c7b4ddec44b48803f27448a16a78)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:29.072351 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63e7e60-83a8-4f36-8617-8a07757b1d8c None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:29.074797 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 84/170] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 14 17:39:28 2022] GET /identity/v3/projects/44c7c7b4ddec44b48803f27448a16a78 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:29.075768 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63e7e60-83a8-4f36-8617-8a07757b1d8c None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:29.123255 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 87/171] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:39:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:39:29.124109 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aed16f-c133-4d49-9910-951649396a82 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:29.209296 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63e7e60-83a8-4f36-8617-8a07757b1d8c None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:29.226168 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:29.256718 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d594e0-da36-4013-b4f5-3fabb2c5807e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:29.257635 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d594e0-da36-4013-b4f5-3fabb2c5807e None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:29.257921 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d594e0-da36-4013-b4f5-3fabb2c5807e None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:29.258197 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d594e0-da36-4013-b4f5-3fabb2c5807e None admin] PATH_INFO: `/v3/users/07cbc28bcd2b49ae85b2ff52eb00af9b` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:29.259544 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d594e0-da36-4013-b4f5-3fabb2c5807e None admin] RBAC: Authorizing `identity:get_user(user_id=07cbc28bcd2b49ae85b2ff52eb00af9b)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:29.261010 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d594e0-da36-4013-b4f5-3fabb2c5807e None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:29.262692 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 85/172] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 14 17:39:29 2022] GET /identity/v3/users/07cbc28bcd2b49ae85b2ff52eb00af9b => generated 275 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:29.263452 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d594e0-da36-4013-b4f5-3fabb2c5807e None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:29.308106 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aed16f-c133-4d49-9910-951649396a82 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:29.354613 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef0bf9d-54a4-4462-8aac-0c050a4b6461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:29.356376 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef0bf9d-54a4-4462-8aac-0c050a4b6461 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:29.356861 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef0bf9d-54a4-4462-8aac-0c050a4b6461 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:29.357566 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef0bf9d-54a4-4462-8aac-0c050a4b6461 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:29.373686 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef0bf9d-54a4-4462-8aac-0c050a4b6461 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:39:29.376978 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d594e0-da36-4013-b4f5-3fabb2c5807e None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:29.384175 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-4ef0bf9d-54a4-4462-8aac-0c050a4b6461 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 17:39:29.384175 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:39:29.384175 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:39:29.384175 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:39:29.384175 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:39:29.384175 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:39:29.384175 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:39:29.384175 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:39:29.384175 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:39:29.384175 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:39:29.384175 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:39:29.384175 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:39:29.384175 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:39:29.384175 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:39:29.384175 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:39:29.384175 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:39:29.385099 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:39:29.385099 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:39:29.385099 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:39:29.385099 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:39:29.385099 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:39:29.385099 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:39:29.385099 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:39:29.385099 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:39:29.385099 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:39:29.385099 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:39:29.385099 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:39:29.385099 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:39:29.385099 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:39:29.385099 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:39:29.385099 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:39:29.385099 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:39:29.385925 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:39:29.385925 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:39:29.385925 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:39:29.385925 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:39:29.385925 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:39:29.385925 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:39:29.385925 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:39:29.385925 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:39:29.385925 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:39:29.385925 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:39:29.385925 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 17:39:29.385925 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:39:29.392169 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 88/173] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 14 17:39:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:39:29.392169 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef0bf9d-54a4-4462-8aac-0c050a4b6461 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:29.412850 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:29.434594 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feacf71-b48d-4fac-a888-2131fee1346f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:29.435716 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feacf71-b48d-4fac-a888-2131fee1346f None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:29.436197 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feacf71-b48d-4fac-a888-2131fee1346f None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:29.436688 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feacf71-b48d-4fac-a888-2131fee1346f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:29.437751 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feacf71-b48d-4fac-a888-2131fee1346f None admin] RBAC: Adding query filter params (role.id=4651a1cc7b4d4ab7a7a9ca1e77e58e71, scope.project.id=44c7c7b4ddec44b48803f27448a16a78, user.id=7ce563cc32c246e59d48c2a6266075e2) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:39:29.438710 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feacf71-b48d-4fac-a888-2131fee1346f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:29.440767 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feacf71-b48d-4fac-a888-2131fee1346f None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:29.450225 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 86/174] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 14 17:39:29 2022] GET /identity/v3/role_assignments?user.id=7ce563cc32c246e59d48c2a6266075e2&scope.project.id=44c7c7b4ddec44b48803f27448a16a78&role.id=4651a1cc7b4d4ab7a7a9ca1e77e58e71 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:29.452506 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd7be73-9d4c-4644-85e3-0f2f600e18aa None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:29.453004 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd7be73-9d4c-4644-85e3-0f2f600e18aa None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:29.453495 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd7be73-9d4c-4644-85e3-0f2f600e18aa None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:29.455208 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 87/175] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:39:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:39:29.461100 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd7be73-9d4c-4644-85e3-0f2f600e18aa None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:29.517339 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef0bf9d-54a4-4462-8aac-0c050a4b6461 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:29.530309 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:29.572568 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ae7602-1b12-4dbb-b3d6-d58879724fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:29.573867 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ae7602-1b12-4dbb-b3d6-d58879724fe7 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:29.574414 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ae7602-1b12-4dbb-b3d6-d58879724fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:29.574921 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ae7602-1b12-4dbb-b3d6-d58879724fe7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:29.588916 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ae7602-1b12-4dbb-b3d6-d58879724fe7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:39:29.597783 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-30ae7602-1b12-4dbb-b3d6-d58879724fe7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 17:39:29.597783 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:39:29.597783 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:39:29.597783 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:39:29.597783 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:39:29.597783 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:39:29.597783 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:39:29.597783 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:39:29.597783 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:39:29.597783 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:39:29.597783 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:39:29.597783 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:39:29.597783 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:39:29.597783 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:39:29.597783 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:39:29.597783 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:39:29.598887 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:39:29.598887 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:39:29.598887 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:39:29.598887 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:39:29.598887 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:39:29.598887 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:39:29.598887 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:39:29.598887 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:39:29.598887 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:39:29.598887 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:39:29.598887 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:39:29.598887 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:39:29.598887 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:39:29.598887 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:39:29.598887 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:39:29.598887 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:39:29.599715 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:39:29.599715 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:39:29.599715 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:39:29.599715 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:39:29.599715 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:39:29.599715 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:39:29.599715 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:39:29.599715 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:39:29.599715 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:39:29.599715 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:39:29.599715 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 17:39:29.599715 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:39:29.602757 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 89/176] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 14 17:39:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:39:29.603951 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ae7602-1b12-4dbb-b3d6-d58879724fe7 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:29.612526 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd7be73-9d4c-4644-85e3-0f2f600e18aa None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:29.654077 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c034ca22-b739-473c-aef2-562bb67ca0bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:29.654741 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c034ca22-b739-473c-aef2-562bb67ca0bb None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:29.655026 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c034ca22-b739-473c-aef2-562bb67ca0bb None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:29.655917 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c034ca22-b739-473c-aef2-562bb67ca0bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:29.702728 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:29.731174 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ae7602-1b12-4dbb-b3d6-d58879724fe7 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:29.750624 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c034ca22-b739-473c-aef2-562bb67ca0bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:29.752098 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c034ca22-b739-473c-aef2-562bb67ca0bb None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:29.775029 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdc1918-8f0b-4fba-9075-499837d9aa2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:29.775740 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc1918-8f0b-4fba-9075-499837d9aa2b None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:29.776096 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc1918-8f0b-4fba-9075-499837d9aa2b None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:29.776447 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc1918-8f0b-4fba-9075-499837d9aa2b None admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:29.777283 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdc1918-8f0b-4fba-9075-499837d9aa2b None admin] RBAC: Adding query filter params (name=member) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:39:29.777711 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdc1918-8f0b-4fba-9075-499837d9aa2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:29.779170 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdc1918-8f0b-4fba-9075-499837d9aa2b None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:29.788403 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 90/177] 10.222.0.67 () {56 vars in 1101 bytes} [Thu Jul 14 17:39:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:29.789900 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a3e650-804b-478b-ac1b-7a562569a981 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:29.790266 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a3e650-804b-478b-ac1b-7a562569a981 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:29.790622 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a3e650-804b-478b-ac1b-7a562569a981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:29.805579 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:29.808266 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-b5a3e650-804b-478b-ac1b-7a562569a981 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:39:29.809475 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-b5a3e650-804b-478b-ac1b-7a562569a981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:39:29.859473 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 88/178] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 14 17:39:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 17:39:29.861068 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4835d6-e83c-4485-bf45-397430d3d46e None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:29.861356 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4835d6-e83c-4485-bf45-397430d3d46e None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:29.861655 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4835d6-e83c-4485-bf45-397430d3d46e None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:29.863056 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 89/179] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:39:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:39:29.866382 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4835d6-e83c-4485-bf45-397430d3d46e None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:29.878745 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 91/180] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:39:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:39:29.878745 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a3e650-804b-478b-ac1b-7a562569a981 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:29.946003 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:29.980327 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a3e650-804b-478b-ac1b-7a562569a981 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:29.984080 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4835d6-e83c-4485-bf45-397430d3d46e None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:30.014376 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785b2011-e09c-4de6-bf40-058bc93b7c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:30.015255 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b2011-e09c-4de6-bf40-058bc93b7c77 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:30.015536 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b2011-e09c-4de6-bf40-058bc93b7c77 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:30.015809 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b2011-e09c-4de6-bf40-058bc93b7c77 None admin] PATH_INFO: `/v3/users/07cbc28bcd2b49ae85b2ff52eb00af9b` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:30.017002 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785b2011-e09c-4de6-bf40-058bc93b7c77 None admin] RBAC: Authorizing `identity:get_user(user_id=07cbc28bcd2b49ae85b2ff52eb00af9b)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:30.018487 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785b2011-e09c-4de6-bf40-058bc93b7c77 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:30.020116 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 92/181] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 14 17:39:29 2022] GET /identity/v3/users/07cbc28bcd2b49ae85b2ff52eb00af9b => generated 275 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:30.020116 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a76d0-0888-40f0-a3b8-301181614c46 None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:30.020116 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a76d0-0888-40f0-a3b8-301181614c46 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:30.020116 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a76d0-0888-40f0-a3b8-301181614c46 None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:30.020116 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 93/182] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:39:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:39:30.020116 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11a76d0-0888-40f0-a3b8-301181614c46 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:30.040898 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdb9a4e-3d77-4991-9457-da2788818669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:30.041493 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb9a4e-3d77-4991-9457-da2788818669 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:30.041804 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb9a4e-3d77-4991-9457-da2788818669 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:30.042076 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb9a4e-3d77-4991-9457-da2788818669 None admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:30.042827 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdb9a4e-3d77-4991-9457-da2788818669 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:39:30.043137 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdb9a4e-3d77-4991-9457-da2788818669 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:30.044503 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdb9a4e-3d77-4991-9457-da2788818669 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:30.052877 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 90/183] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 14 17:39:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:30.054222 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3473ac3-0c2f-43ca-88d1-975232ee7b12 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:30.054517 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3473ac3-0c2f-43ca-88d1-975232ee7b12 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:30.058652 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3473ac3-0c2f-43ca-88d1-975232ee7b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:30.067551 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:30.073669 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-e3473ac3-0c2f-43ca-88d1-975232ee7b12 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:39:30.074886 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-e3473ac3-0c2f-43ca-88d1-975232ee7b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:39:30.134783 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11a76d0-0888-40f0-a3b8-301181614c46 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:30.145228 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 91/184] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:39:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:39:30.146613 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3473ac3-0c2f-43ca-88d1-975232ee7b12 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:30.178953 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d51cb7-74c4-4b36-8ebb-e38b25161765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:30.180478 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d51cb7-74c4-4b36-8ebb-e38b25161765 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:30.180984 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d51cb7-74c4-4b36-8ebb-e38b25161765 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:30.181485 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d51cb7-74c4-4b36-8ebb-e38b25161765 None admin] PATH_INFO: `/v3/projects/4942e68ff7384c3aadf824bb57309ea4` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:30.183483 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d51cb7-74c4-4b36-8ebb-e38b25161765 None admin] RBAC: Authorizing `identity:get_project(project_id=4942e68ff7384c3aadf824bb57309ea4)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:30.186120 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d51cb7-74c4-4b36-8ebb-e38b25161765 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:30.194216 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 94/185] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 14 17:39:30 2022] GET /identity/v3/projects/4942e68ff7384c3aadf824bb57309ea4 => generated 312 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:30.194216 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d51cb7-74c4-4b36-8ebb-e38b25161765 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:30.197306 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:30.255959 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3473ac3-0c2f-43ca-88d1-975232ee7b12 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:30.290133 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd09313e-cee2-4f0c-96fa-3ec4f46ff35c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:30.290996 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd09313e-cee2-4f0c-96fa-3ec4f46ff35c None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:30.291219 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd09313e-cee2-4f0c-96fa-3ec4f46ff35c None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:30.291491 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd09313e-cee2-4f0c-96fa-3ec4f46ff35c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:30.294191 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:30.301927 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d51cb7-74c4-4b36-8ebb-e38b25161765 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:30.303068 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd09313e-cee2-4f0c-96fa-3ec4f46ff35c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:39:30.311009 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-fd09313e-cee2-4f0c-96fa-3ec4f46ff35c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 17:39:30.311009 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:39:30.311009 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:39:30.311009 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:39:30.311009 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:39:30.311009 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:39:30.311009 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:39:30.311009 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:39:30.311009 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:39:30.311009 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:39:30.311009 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:39:30.311009 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:39:30.311009 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:39:30.311009 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:39:30.311009 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:39:30.311009 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:39:30.312133 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:39:30.312133 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:39:30.312133 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:39:30.312133 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:39:30.312133 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:39:30.312133 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:39:30.312133 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:39:30.312133 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:39:30.312133 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:39:30.312133 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:39:30.312133 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:39:30.312133 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:39:30.312133 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:39:30.312133 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:39:30.312133 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:39:30.312133 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:39:30.319107 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:39:30.319107 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:39:30.319107 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:39:30.319107 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:39:30.319107 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:39:30.319107 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:39:30.319107 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:39:30.319107 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:39:30.319107 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:39:30.319107 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:39:30.319107 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 17:39:30.319107 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:39:30.319107 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 92/186] 10.222.0.67 () {56 vars in 1114 bytes} [Thu Jul 14 17:39:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:39:30.319107 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b8b2b-655c-45f3-8660-af32d1ca50a2 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:30.319849 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b8b2b-655c-45f3-8660-af32d1ca50a2 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:30.319849 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b8b2b-655c-45f3-8660-af32d1ca50a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:30.331632 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-5e0b8b2b-655c-45f3-8660-af32d1ca50a2 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:39:30.332884 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-5e0b8b2b-655c-45f3-8660-af32d1ca50a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:39:30.343346 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b057c7c-491d-4eb9-8cd7-42d41e089819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:30.344014 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b057c7c-491d-4eb9-8cd7-42d41e089819 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:30.344301 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b057c7c-491d-4eb9-8cd7-42d41e089819 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:30.344578 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b057c7c-491d-4eb9-8cd7-42d41e089819 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:30.402169 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 93/187] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:39:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:39:30.403017 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0b8b2b-655c-45f3-8660-af32d1ca50a2 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:30.416184 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b057c7c-491d-4eb9-8cd7-42d41e089819 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:30.417977 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b057c7c-491d-4eb9-8cd7-42d41e089819 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:30.422227 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:30.510143 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0b8b2b-655c-45f3-8660-af32d1ca50a2 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:30.529588 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 95/188] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 14 17:39:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 17:39:30.530434 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b057c7c-491d-4eb9-8cd7-42d41e089819 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:30.540497 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:30.549426 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ae7e38-74a0-48cb-87a5-bf850d45fa72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:30.550262 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ae7e38-74a0-48cb-87a5-bf850d45fa72 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:30.550540 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ae7e38-74a0-48cb-87a5-bf850d45fa72 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:30.550812 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ae7e38-74a0-48cb-87a5-bf850d45fa72 None admin] PATH_INFO: `/v3/users/10b037397db141058bf09f5914442da8` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:30.564275 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ae7e38-74a0-48cb-87a5-bf850d45fa72 None admin] RBAC: Authorizing `identity:get_user(user_id=10b037397db141058bf09f5914442da8)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:30.565752 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ae7e38-74a0-48cb-87a5-bf850d45fa72 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:30.567972 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 94/189] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 14 17:39:30 2022] GET /identity/v3/users/10b037397db141058bf09f5914442da8 => generated 283 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:30.568733 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ae7e38-74a0-48cb-87a5-bf850d45fa72 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:30.635577 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b057c7c-491d-4eb9-8cd7-42d41e089819 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:30.638812 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:30.669334 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a535eef-31db-48c2-a510-7c4cc880a95e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:30.670167 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a535eef-31db-48c2-a510-7c4cc880a95e None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:30.670442 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a535eef-31db-48c2-a510-7c4cc880a95e None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:30.670713 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a535eef-31db-48c2-a510-7c4cc880a95e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:30.671333 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ae7e38-74a0-48cb-87a5-bf850d45fa72 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:30.682070 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a535eef-31db-48c2-a510-7c4cc880a95e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:39:30.689844 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-5a535eef-31db-48c2-a510-7c4cc880a95e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 17:39:30.689844 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:39:30.689844 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:39:30.689844 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:39:30.689844 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:39:30.689844 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:39:30.689844 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:39:30.689844 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:39:30.689844 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:39:30.689844 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:39:30.689844 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:39:30.689844 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:39:30.689844 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:39:30.689844 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:39:30.689844 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:39:30.689844 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:39:30.690763 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:39:30.690763 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:39:30.690763 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:39:30.690763 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:39:30.690763 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:39:30.690763 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:39:30.690763 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:39:30.690763 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:39:30.690763 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:39:30.690763 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:39:30.690763 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:39:30.690763 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:39:30.690763 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:39:30.690763 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:39:30.690763 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:39:30.690763 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:39:30.691583 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:39:30.691583 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:39:30.691583 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:39:30.691583 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:39:30.691583 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:39:30.691583 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:39:30.691583 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:39:30.691583 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:39:30.691583 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:39:30.691583 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:39:30.691583 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 17:39:30.691583 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:39:30.691583 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 96/190] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 14 17:39:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:39:30.692253 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a535eef-31db-48c2-a510-7c4cc880a95e None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:30.720672 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93c7e56-96d5-4d7c-93c4-44725775ecc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:30.721331 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c7e56-96d5-4d7c-93c4-44725775ecc8 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:30.721643 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c7e56-96d5-4d7c-93c4-44725775ecc8 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:30.721926 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c7e56-96d5-4d7c-93c4-44725775ecc8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:30.722765 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93c7e56-96d5-4d7c-93c4-44725775ecc8 None admin] RBAC: Adding query filter params (role.id=95d753870f97426cb1ce32e078621a4c, scope.project.id=4942e68ff7384c3aadf824bb57309ea4, user.id=07cbc28bcd2b49ae85b2ff52eb00af9b) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:39:30.723130 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93c7e56-96d5-4d7c-93c4-44725775ecc8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:30.724616 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93c7e56-96d5-4d7c-93c4-44725775ecc8 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:30.730799 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 95/191] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 14 17:39:30 2022] GET /identity/v3/role_assignments?user.id=07cbc28bcd2b49ae85b2ff52eb00af9b&scope.project.id=4942e68ff7384c3aadf824bb57309ea4&role.id=95d753870f97426cb1ce32e078621a4c => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:30.731589 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93c7e56-96d5-4d7c-93c4-44725775ecc8 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:30.792415 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:30.812596 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a535eef-31db-48c2-a510-7c4cc880a95e None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:30.855349 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c908936-0093-4501-959f-8138aeb93462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:30.855780 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c908936-0093-4501-959f-8138aeb93462 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:30.856263 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c908936-0093-4501-959f-8138aeb93462 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:30.856365 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93c7e56-96d5-4d7c-93c4-44725775ecc8 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:30.856471 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c908936-0093-4501-959f-8138aeb93462 None admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:30.857107 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c908936-0093-4501-959f-8138aeb93462 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:39:30.857414 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c908936-0093-4501-959f-8138aeb93462 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:30.858900 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c908936-0093-4501-959f-8138aeb93462 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:30.869674 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 97/192] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 14 17:39:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:30.870579 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c908936-0093-4501-959f-8138aeb93462 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:30.906227 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:30.910657 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cbd22a-3ac5-4696-9003-88e4547da1a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:30.911635 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cbd22a-3ac5-4696-9003-88e4547da1a4 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:30.912027 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cbd22a-3ac5-4696-9003-88e4547da1a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:30.912983 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cbd22a-3ac5-4696-9003-88e4547da1a4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:30.913936 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cbd22a-3ac5-4696-9003-88e4547da1a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:30.915389 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cbd22a-3ac5-4696-9003-88e4547da1a4 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:30.917475 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 96/193] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:39:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:30.922436 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cbd22a-3ac5-4696-9003-88e4547da1a4 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:30.997745 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c908936-0093-4501-959f-8138aeb93462 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:31.031091 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94ca5d1-1e1f-49f3-807d-3ee771602d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:31.031789 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cbd22a-3ac5-4696-9003-88e4547da1a4 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:31.031980 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ca5d1-1e1f-49f3-807d-3ee771602d71 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:31.032271 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ca5d1-1e1f-49f3-807d-3ee771602d71 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:31.032551 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ca5d1-1e1f-49f3-807d-3ee771602d71 None admin] PATH_INFO: `/v3/projects/44c7c7b4ddec44b48803f27448a16a78` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:31.033871 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94ca5d1-1e1f-49f3-807d-3ee771602d71 None admin] RBAC: Authorizing `identity:get_project(project_id=44c7c7b4ddec44b48803f27448a16a78)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:31.035387 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94ca5d1-1e1f-49f3-807d-3ee771602d71 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:31.037743 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 98/194] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 14 17:39:30 2022] GET /identity/v3/projects/44c7c7b4ddec44b48803f27448a16a78 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:31.038561 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94ca5d1-1e1f-49f3-807d-3ee771602d71 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:31.054219 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:31.074451 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a53233b-3a68-46f3-8e5f-98d3fdf9cf6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:31.075027 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a53233b-3a68-46f3-8e5f-98d3fdf9cf6c None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:31.075310 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a53233b-3a68-46f3-8e5f-98d3fdf9cf6c None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:31.075586 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a53233b-3a68-46f3-8e5f-98d3fdf9cf6c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:31.139734 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:31.147664 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94ca5d1-1e1f-49f3-807d-3ee771602d71 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:31.149088 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a53233b-3a68-46f3-8e5f-98d3fdf9cf6c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:31.150670 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a53233b-3a68-46f3-8e5f-98d3fdf9cf6c None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:31.184118 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303292a6-878e-4dda-8d39-c71d2d61f368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:31.184806 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303292a6-878e-4dda-8d39-c71d2d61f368 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:31.185091 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303292a6-878e-4dda-8d39-c71d2d61f368 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:31.185374 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303292a6-878e-4dda-8d39-c71d2d61f368 None admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:31.186164 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303292a6-878e-4dda-8d39-c71d2d61f368 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:39:31.186475 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303292a6-878e-4dda-8d39-c71d2d61f368 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:31.187863 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303292a6-878e-4dda-8d39-c71d2d61f368 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:31.196441 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 99/195] 10.222.0.67 () {56 vars in 1101 bytes} [Thu Jul 14 17:39:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:31.197666 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303292a6-878e-4dda-8d39-c71d2d61f368 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:31.259804 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 97/196] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 14 17:39:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 17:39:31.261352 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a53233b-3a68-46f3-8e5f-98d3fdf9cf6c None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:31.279675 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:31.298939 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303292a6-878e-4dda-8d39-c71d2d61f368 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:31.332343 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4413fb08-3812-4cb2-8397-cd1977885189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:31.333164 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4413fb08-3812-4cb2-8397-cd1977885189 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:31.333442 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4413fb08-3812-4cb2-8397-cd1977885189 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:31.333742 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4413fb08-3812-4cb2-8397-cd1977885189 None admin] PATH_INFO: `/v3/users/10b037397db141058bf09f5914442da8` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:31.334935 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4413fb08-3812-4cb2-8397-cd1977885189 None admin] RBAC: Authorizing `identity:get_user(user_id=10b037397db141058bf09f5914442da8)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:31.336376 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4413fb08-3812-4cb2-8397-cd1977885189 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:31.338044 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 100/197] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 14 17:39:31 2022] GET /identity/v3/users/10b037397db141058bf09f5914442da8 => generated 283 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:31.339393 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4413fb08-3812-4cb2-8397-cd1977885189 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:31.363191 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a53233b-3a68-46f3-8e5f-98d3fdf9cf6c None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:31.365727 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:31.399125 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063bb287-bb47-467f-b097-017f72c3edd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:31.399973 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063bb287-bb47-467f-b097-017f72c3edd7 None admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:31.400085 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063bb287-bb47-467f-b097-017f72c3edd7 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:31.400314 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063bb287-bb47-467f-b097-017f72c3edd7 None admin] PATH_INFO: `/v3/users` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:31.401032 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063bb287-bb47-467f-b097-017f72c3edd7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:31.402513 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063bb287-bb47-467f-b097-017f72c3edd7 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:31.421849 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 98/198] 10.222.0.67 () {60 vars in 1132 bytes} [Thu Jul 14 17:39:31 2022] POST /identity/v3/users => generated 297 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:39:31.422679 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063bb287-bb47-467f-b097-017f72c3edd7 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:31.467090 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4413fb08-3812-4cb2-8397-cd1977885189 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:31.506351 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922d7f15-31bd-46ee-9a74-2cac7493a036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:31.507098 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d7f15-31bd-46ee-9a74-2cac7493a036 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:31.507391 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d7f15-31bd-46ee-9a74-2cac7493a036 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:31.507672 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d7f15-31bd-46ee-9a74-2cac7493a036 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:31.508552 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922d7f15-31bd-46ee-9a74-2cac7493a036 None admin] RBAC: Adding query filter params (role.id=95d753870f97426cb1ce32e078621a4c, scope.project.id=44c7c7b4ddec44b48803f27448a16a78, user.id=07cbc28bcd2b49ae85b2ff52eb00af9b) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:39:31.508870 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922d7f15-31bd-46ee-9a74-2cac7493a036 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:31.510424 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922d7f15-31bd-46ee-9a74-2cac7493a036 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:31.529556 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 101/199] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 14 17:39:31 2022] GET /identity/v3/role_assignments?user.id=07cbc28bcd2b49ae85b2ff52eb00af9b&scope.project.id=44c7c7b4ddec44b48803f27448a16a78&role.id=95d753870f97426cb1ce32e078621a4c => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:31.529556 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922d7f15-31bd-46ee-9a74-2cac7493a036 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:31.530604 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:31.565759 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063bb287-bb47-467f-b097-017f72c3edd7 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:31.619060 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dc0a75-c1ac-4d6e-886d-e57024870b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:31.619969 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dc0a75-c1ac-4d6e-886d-e57024870b74 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:31.620251 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dc0a75-c1ac-4d6e-886d-e57024870b74 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:31.620531 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dc0a75-c1ac-4d6e-886d-e57024870b74 None admin] PATH_INFO: `/v3/users/747d1e29cc784b14bc2534ecf99600f3` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:31.621856 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dc0a75-c1ac-4d6e-886d-e57024870b74 None admin] RBAC: Authorizing `identity:get_user(user_id=747d1e29cc784b14bc2534ecf99600f3)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:31.624220 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dc0a75-c1ac-4d6e-886d-e57024870b74 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:31.626018 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 99/200] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 14 17:39:31 2022] GET /identity/v3/users/747d1e29cc784b14bc2534ecf99600f3 => generated 289 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:31.626829 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dc0a75-c1ac-4d6e-886d-e57024870b74 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:31.667229 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:31.688111 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922d7f15-31bd-46ee-9a74-2cac7493a036 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:31.746091 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4225c2-eb0b-471b-8abe-a1b5ae046d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:31.746966 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4225c2-eb0b-471b-8abe-a1b5ae046d1c None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:31.747257 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4225c2-eb0b-471b-8abe-a1b5ae046d1c None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:31.747539 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4225c2-eb0b-471b-8abe-a1b5ae046d1c None admin] PATH_INFO: `/v3/projects/67e4c4e8f5f441c5bc8f752c9db84352` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:31.749587 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4225c2-eb0b-471b-8abe-a1b5ae046d1c None admin] RBAC: Authorizing `identity:get_project(project_id=67e4c4e8f5f441c5bc8f752c9db84352)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:31.751066 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4225c2-eb0b-471b-8abe-a1b5ae046d1c None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:31.752851 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 102/201] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 14 17:39:31 2022] GET /identity/v3/projects/67e4c4e8f5f441c5bc8f752c9db84352 => generated 302 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:31.753686 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4225c2-eb0b-471b-8abe-a1b5ae046d1c None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:31.763476 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dc0a75-c1ac-4d6e-886d-e57024870b74 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:31.813784 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c66655-09a5-40c7-994b-1123deced05b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:31.814736 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c66655-09a5-40c7-994b-1123deced05b None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:31.815025 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c66655-09a5-40c7-994b-1123deced05b None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:31.815305 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c66655-09a5-40c7-994b-1123deced05b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:31.827119 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:31.888955 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4225c2-eb0b-471b-8abe-a1b5ae046d1c None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:31.900746 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c66655-09a5-40c7-994b-1123deced05b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:31.902350 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c66655-09a5-40c7-994b-1123deced05b None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:31.929363 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c519f37-d12c-4c17-b70e-d57cb47ebd7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:31.930374 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c519f37-d12c-4c17-b70e-d57cb47ebd7e None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:31.930374 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c519f37-d12c-4c17-b70e-d57cb47ebd7e None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:31.930659 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c519f37-d12c-4c17-b70e-d57cb47ebd7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:31.957452 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:32.008436 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c519f37-d12c-4c17-b70e-d57cb47ebd7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:32.009995 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c519f37-d12c-4c17-b70e-d57cb47ebd7e None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:32.028016 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 100/202] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 14 17:39:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 17:39:32.029332 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c66655-09a5-40c7-994b-1123deced05b None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:32.074400 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:32.121565 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 103/203] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 14 17:39:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 17:39:32.126487 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c519f37-d12c-4c17-b70e-d57cb47ebd7e None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:32.148936 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c66655-09a5-40c7-994b-1123deced05b None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:32.184668 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:32.191810 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae98f03f-5875-406d-8c94-9c8ffd141a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:32.193522 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae98f03f-5875-406d-8c94-9c8ffd141a5c None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:32.193916 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae98f03f-5875-406d-8c94-9c8ffd141a5c None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:32.194268 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae98f03f-5875-406d-8c94-9c8ffd141a5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:32.195903 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae98f03f-5875-406d-8c94-9c8ffd141a5c None admin] RBAC: Adding query filter params (role.id=4651a1cc7b4d4ab7a7a9ca1e77e58e71, scope.project.id=67e4c4e8f5f441c5bc8f752c9db84352, user.id=10b037397db141058bf09f5914442da8) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:39:32.196536 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae98f03f-5875-406d-8c94-9c8ffd141a5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:32.199072 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae98f03f-5875-406d-8c94-9c8ffd141a5c None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:32.208358 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 101/204] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 14 17:39:32 2022] GET /identity/v3/role_assignments?user.id=10b037397db141058bf09f5914442da8&scope.project.id=67e4c4e8f5f441c5bc8f752c9db84352&role.id=4651a1cc7b4d4ab7a7a9ca1e77e58e71 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:32.209310 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae98f03f-5875-406d-8c94-9c8ffd141a5c None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:32.241197 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c519f37-d12c-4c17-b70e-d57cb47ebd7e None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:32.334183 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ad19d2-6361-487b-972a-9f327fd72b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:32.336682 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ad19d2-6361-487b-972a-9f327fd72b7e None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:32.337415 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ad19d2-6361-487b-972a-9f327fd72b7e None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:32.339333 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ad19d2-6361-487b-972a-9f327fd72b7e None admin] PATH_INFO: `/v3/projects/67e4c4e8f5f441c5bc8f752c9db84352` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:32.341812 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ad19d2-6361-487b-972a-9f327fd72b7e None admin] RBAC: Authorizing `identity:get_project(project_id=67e4c4e8f5f441c5bc8f752c9db84352)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:32.344275 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ad19d2-6361-487b-972a-9f327fd72b7e None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:32.347978 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 104/205] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 14 17:39:32 2022] GET /identity/v3/projects/67e4c4e8f5f441c5bc8f752c9db84352 => generated 302 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:32.359376 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ad19d2-6361-487b-972a-9f327fd72b7e None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:32.362241 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae98f03f-5875-406d-8c94-9c8ffd141a5c None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:32.369554 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:32.406372 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b2c512-8ab0-4312-873d-6893df4fa8d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:32.407184 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b2c512-8ab0-4312-873d-6893df4fa8d0 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:32.407466 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b2c512-8ab0-4312-873d-6893df4fa8d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:32.407740 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b2c512-8ab0-4312-873d-6893df4fa8d0 None admin] PATH_INFO: `/v3/projects/44c7c7b4ddec44b48803f27448a16a78` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:32.412503 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b2c512-8ab0-4312-873d-6893df4fa8d0 None admin] RBAC: Authorizing `identity:get_project(project_id=44c7c7b4ddec44b48803f27448a16a78)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:32.414051 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b2c512-8ab0-4312-873d-6893df4fa8d0 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:32.416072 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 102/206] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 14 17:39:32 2022] GET /identity/v3/projects/44c7c7b4ddec44b48803f27448a16a78 => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:32.423008 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b2c512-8ab0-4312-873d-6893df4fa8d0 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:32.534612 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ad19d2-6361-487b-972a-9f327fd72b7e None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:32.560394 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:32.579899 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbec6253-18b4-4cef-b9cd-89256c339cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:32.580575 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbec6253-18b4-4cef-b9cd-89256c339cf6 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:32.580863 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbec6253-18b4-4cef-b9cd-89256c339cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:32.581144 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbec6253-18b4-4cef-b9cd-89256c339cf6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:32.582032 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbec6253-18b4-4cef-b9cd-89256c339cf6 None admin] RBAC: Adding query filter params (role.id=fa9b6b80eda3440ca058cb77bd7f8f5c, scope.project.id=67e4c4e8f5f441c5bc8f752c9db84352, user.id=10b037397db141058bf09f5914442da8) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:39:32.582347 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbec6253-18b4-4cef-b9cd-89256c339cf6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:32.584356 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbec6253-18b4-4cef-b9cd-89256c339cf6 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:32.589552 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b2c512-8ab0-4312-873d-6893df4fa8d0 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:32.601041 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 105/207] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 14 17:39:32 2022] GET /identity/v3/role_assignments?user.id=10b037397db141058bf09f5914442da8&scope.project.id=67e4c4e8f5f441c5bc8f752c9db84352&role.id=fa9b6b80eda3440ca058cb77bd7f8f5c => generated 259 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:32.631181 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb966aae-e51b-4a12-9cd2-10afd6f903f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:32.631929 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb966aae-e51b-4a12-9cd2-10afd6f903f6 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:32.632221 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb966aae-e51b-4a12-9cd2-10afd6f903f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:32.632503 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb966aae-e51b-4a12-9cd2-10afd6f903f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:32.633382 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb966aae-e51b-4a12-9cd2-10afd6f903f6 None admin] RBAC: Adding query filter params (role.id=7e81381d29ef4d8c89fe53e977678bf6, scope.project.id=44c7c7b4ddec44b48803f27448a16a78, user.id=747d1e29cc784b14bc2534ecf99600f3) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:39:32.633731 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb966aae-e51b-4a12-9cd2-10afd6f903f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:32.635237 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb966aae-e51b-4a12-9cd2-10afd6f903f6 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:32.642758 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 103/208] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 14 17:39:32 2022] GET /identity/v3/role_assignments?user.id=747d1e29cc784b14bc2534ecf99600f3&scope.project.id=44c7c7b4ddec44b48803f27448a16a78&role.id=7e81381d29ef4d8c89fe53e977678bf6 => generated 608 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:33.781731 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a5ef0-a917-4d38-99e2-6177464d1da2 None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:33.782740 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a5ef0-a917-4d38-99e2-6177464d1da2 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:33.783231 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a5ef0-a917-4d38-99e2-6177464d1da2 None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:33.784816 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 106/209] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:39:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:39:33.790514 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b810765-6815-4ddf-ab6c-1b3061265259 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:33.791380 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b810765-6815-4ddf-ab6c-1b3061265259 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:33.791851 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b810765-6815-4ddf-ab6c-1b3061265259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:33.812020 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-5b810765-6815-4ddf-ab6c-1b3061265259 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:39:33.813595 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-5b810765-6815-4ddf-ab6c-1b3061265259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:39:33.826765 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6b2f4-c584-4c29-8a5a-82304893ff1a None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:33.827058 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6b2f4-c584-4c29-8a5a-82304893ff1a None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:33.827320 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6b2f4-c584-4c29-8a5a-82304893ff1a None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:33.828831 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 107/210] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:39:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 17:39:33.834699 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d4e1ab-39cd-4c6e-910b-a784ab3dff06 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:33.835269 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d4e1ab-39cd-4c6e-910b-a784ab3dff06 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:33.835740 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d4e1ab-39cd-4c6e-910b-a784ab3dff06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:33.850331 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:33.856319 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-30d4e1ab-39cd-4c6e-910b-a784ab3dff06 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:39:33.858604 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-30d4e1ab-39cd-4c6e-910b-a784ab3dff06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:39:33.893323 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 104/211] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:39:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:39:33.920126 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b810765-6815-4ddf-ab6c-1b3061265259 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:33.946008 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 108/212] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:39:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 17:39:33.970241 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d4e1ab-39cd-4c6e-910b-a784ab3dff06 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:34.046841 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b810765-6815-4ddf-ab6c-1b3061265259 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:34.080273 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d4e1ab-39cd-4c6e-910b-a784ab3dff06 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:34.090568 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a59f528-6ee0-4c48-88c5-73065b3507d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:34.091377 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a59f528-6ee0-4c48-88c5-73065b3507d5 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:34.091658 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a59f528-6ee0-4c48-88c5-73065b3507d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:34.091930 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a59f528-6ee0-4c48-88c5-73065b3507d5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:34.102436 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:34.105715 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a59f528-6ee0-4c48-88c5-73065b3507d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:39:34.116719 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-3a59f528-6ee0-4c48-88c5-73065b3507d5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 17:39:34.116719 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:39:34.116719 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:39:34.116719 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:39:34.116719 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:39:34.116719 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:39:34.116719 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:39:34.116719 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:39:34.116719 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:39:34.116719 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:39:34.116719 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:39:34.116719 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:39:34.116719 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:39:34.116719 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:39:34.116719 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:39:34.116719 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:39:34.117728 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:39:34.117728 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:39:34.117728 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:39:34.117728 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:39:34.117728 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:39:34.117728 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:39:34.117728 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:39:34.117728 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:39:34.117728 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:39:34.117728 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:39:34.117728 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:39:34.117728 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:39:34.117728 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:39:34.117728 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:39:34.117728 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:39:34.117728 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:39:34.118531 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:39:34.118531 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:39:34.118531 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:39:34.118531 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:39:34.118531 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:39:34.118531 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:39:34.118531 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:39:34.118531 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:39:34.118531 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:39:34.118531 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:39:34.118531 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 17:39:34.118531 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:39:34.118531 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 105/213] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 14 17:39:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 17:39:34.125209 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a59f528-6ee0-4c48-88c5-73065b3507d5 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:34.127228 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534b6049-1bda-4282-a971-92d560d1c6af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:34.128316 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534b6049-1bda-4282-a971-92d560d1c6af None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:34.128739 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534b6049-1bda-4282-a971-92d560d1c6af None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:34.129330 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534b6049-1bda-4282-a971-92d560d1c6af None admin] PATH_INFO: `/v3/domains/default` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:34.131286 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534b6049-1bda-4282-a971-92d560d1c6af None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:34.132905 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534b6049-1bda-4282-a971-92d560d1c6af None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:34.139294 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 109/214] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:39:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:39:34.140866 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534b6049-1bda-4282-a971-92d560d1c6af None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:34.156213 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:34.232391 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a59f528-6ee0-4c48-88c5-73065b3507d5 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:34.255456 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534b6049-1bda-4282-a971-92d560d1c6af None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:34.268757 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff95197-6be4-4daa-9dcc-e5a1b924541d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:34.269582 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff95197-6be4-4daa-9dcc-e5a1b924541d None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:34.269966 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff95197-6be4-4daa-9dcc-e5a1b924541d None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:34.270351 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff95197-6be4-4daa-9dcc-e5a1b924541d None admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:34.271318 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff95197-6be4-4daa-9dcc-e5a1b924541d None admin] RBAC: Adding query filter params (name=member) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:39:34.271720 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff95197-6be4-4daa-9dcc-e5a1b924541d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:34.273190 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff95197-6be4-4daa-9dcc-e5a1b924541d None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:34.282291 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 106/215] 10.222.0.67 () {56 vars in 1101 bytes} [Thu Jul 14 17:39:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:39:34.288526 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff95197-6be4-4daa-9dcc-e5a1b924541d None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:34.296811 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee918f1-dc02-4678-a61a-a3f2e5fd88b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:34.297884 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee918f1-dc02-4678-a61a-a3f2e5fd88b9 None admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:34.298302 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee918f1-dc02-4678-a61a-a3f2e5fd88b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:34.298739 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee918f1-dc02-4678-a61a-a3f2e5fd88b9 None admin] PATH_INFO: `/v3/users` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:34.299611 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee918f1-dc02-4678-a61a-a3f2e5fd88b9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:34.301344 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee918f1-dc02-4678-a61a-a3f2e5fd88b9 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:34.327934 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 110/216] 10.222.0.67 () {60 vars in 1132 bytes} [Thu Jul 14 17:39:34 2022] POST /identity/v3/users => generated 297 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 17:39:34.402020 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:34.417035 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff95197-6be4-4daa-9dcc-e5a1b924541d None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:34.463355 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f4c88b-f270-450b-9623-65e4ef518256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:34.464256 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4c88b-f270-450b-9623-65e4ef518256 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:34.464534 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4c88b-f270-450b-9623-65e4ef518256 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:34.464808 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4c88b-f270-450b-9623-65e4ef518256 None admin] PATH_INFO: `/v3/users/110fdac68c844ae3b627674e69504b70` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:34.481951 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f4c88b-f270-450b-9623-65e4ef518256 None admin] RBAC: Authorizing `identity:get_user(user_id=110fdac68c844ae3b627674e69504b70)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:34.483446 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f4c88b-f270-450b-9623-65e4ef518256 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:34.485584 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 107/217] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 14 17:39:34 2022] GET /identity/v3/users/110fdac68c844ae3b627674e69504b70 => generated 297 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:39:34.491258 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee918f1-dc02-4678-a61a-a3f2e5fd88b9 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:34.542677 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:34.575765 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6855684f-075f-40a3-9fd0-cf338946e347 None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:34.575962 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6855684f-075f-40a3-9fd0-cf338946e347 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:34.576237 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6855684f-075f-40a3-9fd0-cf338946e347 None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:34.577915 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 108/218] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:39:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:39:34.585095 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7627d4-a10f-479d-b4c6-511fc83e6cd5 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:34.585398 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7627d4-a10f-479d-b4c6-511fc83e6cd5 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:34.585699 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7627d4-a10f-479d-b4c6-511fc83e6cd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:34.609895 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee918f1-dc02-4678-a61a-a3f2e5fd88b9 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:34.612316 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-ee7627d4-a10f-479d-b4c6-511fc83e6cd5 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:39:34.613669 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-ee7627d4-a10f-479d-b4c6-511fc83e6cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:39:34.649840 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca81a25-3e14-46de-a26e-9a3d00624881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:34.650892 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca81a25-3e14-46de-a26e-9a3d00624881 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:34.651302 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca81a25-3e14-46de-a26e-9a3d00624881 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:34.652059 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca81a25-3e14-46de-a26e-9a3d00624881 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:34.701604 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 109/219] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:39:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:39:34.726124 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7627d4-a10f-479d-b4c6-511fc83e6cd5 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:34.750239 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca81a25-3e14-46de-a26e-9a3d00624881 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:34.751790 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca81a25-3e14-46de-a26e-9a3d00624881 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:34.829992 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:34.841821 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:34.875728 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7627d4-a10f-479d-b4c6-511fc83e6cd5 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:34.882937 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 111/220] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 14 17:39:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 17:39:34.888025 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca81a25-3e14-46de-a26e-9a3d00624881 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:34.944555 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f324c7-7874-4413-bd44-fa4f2b3f8146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:34.945760 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f324c7-7874-4413-bd44-fa4f2b3f8146 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:34.946267 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f324c7-7874-4413-bd44-fa4f2b3f8146 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:34.946763 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f324c7-7874-4413-bd44-fa4f2b3f8146 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:34.959184 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f324c7-7874-4413-bd44-fa4f2b3f8146 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:39:34.967814 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-d4f324c7-7874-4413-bd44-fa4f2b3f8146 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 17:39:34.967814 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:39:34.967814 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:39:34.967814 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:39:34.967814 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:39:34.967814 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:39:34.967814 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:39:34.967814 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:39:34.967814 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:39:34.967814 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:39:34.967814 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:39:34.967814 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:39:34.967814 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:39:34.967814 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:39:34.967814 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:39:34.967814 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:39:34.968953 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:39:34.968953 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:39:34.968953 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:39:34.968953 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:39:34.968953 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:39:34.968953 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:39:34.968953 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:39:34.968953 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:39:34.968953 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:39:34.968953 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:39:34.968953 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:39:34.968953 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:39:34.968953 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:39:34.968953 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:39:34.968953 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:39:34.968953 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:39:34.969989 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:39:34.969989 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:39:34.969989 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:39:34.969989 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:39:34.969989 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:39:34.969989 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:39:34.969989 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:39:34.969989 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:39:34.969989 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:39:34.969989 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:39:34.969989 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 17:39:34.969989 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:39:34.972300 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 110/221] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 14 17:39:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 17:39:34.974678 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4fac31-79c6-4124-9dbc-824b492c8343 None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:34.975294 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4fac31-79c6-4124-9dbc-824b492c8343 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:34.975637 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4fac31-79c6-4124-9dbc-824b492c8343 None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:34.977169 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 111/222] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:39:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:39:34.982470 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4fac31-79c6-4124-9dbc-824b492c8343 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:35.043144 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca81a25-3e14-46de-a26e-9a3d00624881 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:35.086893 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c4d38c-396e-4eae-b8a8-0a46ee0022de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:35.088134 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c4d38c-396e-4eae-b8a8-0a46ee0022de None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:35.088592 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c4d38c-396e-4eae-b8a8-0a46ee0022de None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:35.089084 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c4d38c-396e-4eae-b8a8-0a46ee0022de None admin] PATH_INFO: `/v3/projects/67e4c4e8f5f441c5bc8f752c9db84352` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:35.090573 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c4d38c-396e-4eae-b8a8-0a46ee0022de None admin] RBAC: Authorizing `identity:get_project(project_id=67e4c4e8f5f441c5bc8f752c9db84352)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:35.092206 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c4d38c-396e-4eae-b8a8-0a46ee0022de None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:35.094580 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 112/223] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 14 17:39:34 2022] GET /identity/v3/projects/67e4c4e8f5f441c5bc8f752c9db84352 => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:39:35.096272 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b1560-dc53-4461-a7f1-e219398bc9d3 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:35.096760 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b1560-dc53-4461-a7f1-e219398bc9d3 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:35.097208 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b1560-dc53-4461-a7f1-e219398bc9d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:35.115213 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4fac31-79c6-4124-9dbc-824b492c8343 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:35.116447 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-fa4b1560-dc53-4461-a7f1-e219398bc9d3 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:39:35.117892 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-fa4b1560-dc53-4461-a7f1-e219398bc9d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:39:35.121880 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:35.163940 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f9efe1-bc31-4aa2-b325-2977fbe6a591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:35.165622 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f9efe1-bc31-4aa2-b325-2977fbe6a591 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:35.166139 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f9efe1-bc31-4aa2-b325-2977fbe6a591 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:35.166621 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f9efe1-bc31-4aa2-b325-2977fbe6a591 None admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:35.168143 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f9efe1-bc31-4aa2-b325-2977fbe6a591 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:39:35.168661 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f9efe1-bc31-4aa2-b325-2977fbe6a591 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:35.171003 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f9efe1-bc31-4aa2-b325-2977fbe6a591 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:35.174894 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:35.189874 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 112/224] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 14 17:39:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:35.190982 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f9efe1-bc31-4aa2-b325-2977fbe6a591 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:35.202451 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 113/225] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:39:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:39:35.209667 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4b1560-dc53-4461-a7f1-e219398bc9d3 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:35.303352 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f9efe1-bc31-4aa2-b325-2977fbe6a591 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:35.334862 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4b1560-dc53-4461-a7f1-e219398bc9d3 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:35.341006 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530f8634-acd4-424d-bcdd-b2cbe7408306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:35.341989 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530f8634-acd4-424d-bcdd-b2cbe7408306 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:35.342600 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530f8634-acd4-424d-bcdd-b2cbe7408306 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:35.343076 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530f8634-acd4-424d-bcdd-b2cbe7408306 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:35.344120 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530f8634-acd4-424d-bcdd-b2cbe7408306 None admin] RBAC: Adding query filter params (role.id=95d753870f97426cb1ce32e078621a4c, scope.project.id=67e4c4e8f5f441c5bc8f752c9db84352, user.id=110fdac68c844ae3b627674e69504b70) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:39:35.344748 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530f8634-acd4-424d-bcdd-b2cbe7408306 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:35.346600 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530f8634-acd4-424d-bcdd-b2cbe7408306 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:35.353240 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 113/226] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 14 17:39:35 2022] GET /identity/v3/role_assignments?user.id=110fdac68c844ae3b627674e69504b70&scope.project.id=67e4c4e8f5f441c5bc8f752c9db84352&role.id=95d753870f97426cb1ce32e078621a4c => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:35.354515 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530f8634-acd4-424d-bcdd-b2cbe7408306 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:35.374392 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e85184-9824-4570-96b7-abe4311c2a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:35.375279 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e85184-9824-4570-96b7-abe4311c2a2f None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:35.375566 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e85184-9824-4570-96b7-abe4311c2a2f None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:35.375842 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e85184-9824-4570-96b7-abe4311c2a2f None admin] PATH_INFO: `/v3/users/10b037397db141058bf09f5914442da8` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:35.377173 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e85184-9824-4570-96b7-abe4311c2a2f None admin] RBAC: Authorizing `identity:get_user(user_id=10b037397db141058bf09f5914442da8)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:35.386742 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e85184-9824-4570-96b7-abe4311c2a2f None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:35.388825 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 114/227] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 14 17:39:35 2022] GET /identity/v3/users/10b037397db141058bf09f5914442da8 => generated 283 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:35.395377 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e85184-9824-4570-96b7-abe4311c2a2f None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:35.412159 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:35.436820 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:35.485962 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530f8634-acd4-424d-bcdd-b2cbe7408306 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:35.528684 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f8b0ec-bd23-4502-9217-bc7126e28949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:35.529909 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f8b0ec-bd23-4502-9217-bc7126e28949 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:35.530449 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f8b0ec-bd23-4502-9217-bc7126e28949 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:35.530925 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f8b0ec-bd23-4502-9217-bc7126e28949 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:35.543948 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f8b0ec-bd23-4502-9217-bc7126e28949 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:39:35.553873 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-07f8b0ec-bd23-4502-9217-bc7126e28949 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 17:39:35.553873 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:39:35.553873 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:39:35.553873 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:39:35.553873 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:39:35.553873 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:39:35.553873 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:39:35.553873 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:39:35.553873 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:39:35.553873 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:39:35.553873 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:39:35.553873 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:39:35.553873 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:39:35.553873 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:39:35.553873 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:39:35.553873 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:39:35.554844 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:39:35.554844 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:39:35.554844 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:39:35.554844 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:39:35.554844 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:39:35.554844 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:39:35.554844 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:39:35.554844 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:39:35.554844 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:39:35.554844 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:39:35.554844 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:39:35.554844 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:39:35.554844 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:39:35.554844 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:39:35.554844 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:39:35.554844 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:39:35.555654 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:39:35.555654 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:39:35.555654 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:39:35.555654 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:39:35.555654 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:39:35.555654 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:39:35.555654 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:39:35.555654 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:39:35.555654 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:39:35.555654 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:39:35.555654 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 17:39:35.555654 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:39:35.558432 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 114/228] 10.222.0.67 () {56 vars in 1114 bytes} [Thu Jul 14 17:39:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:39:35.568810 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f8b0ec-bd23-4502-9217-bc7126e28949 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:35.653327 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e85184-9824-4570-96b7-abe4311c2a2f None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:35.707348 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f764fe1f-3f94-4dd4-901f-996d5a522f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:35.708706 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f764fe1f-3f94-4dd4-901f-996d5a522f26 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:35.709226 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f764fe1f-3f94-4dd4-901f-996d5a522f26 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:35.709735 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f764fe1f-3f94-4dd4-901f-996d5a522f26 None admin] PATH_INFO: `/v3/projects/67e4c4e8f5f441c5bc8f752c9db84352` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:35.711288 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f764fe1f-3f94-4dd4-901f-996d5a522f26 None admin] RBAC: Authorizing `identity:get_project(project_id=67e4c4e8f5f441c5bc8f752c9db84352)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:35.712951 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f764fe1f-3f94-4dd4-901f-996d5a522f26 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:35.715100 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 115/229] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 14 17:39:35 2022] GET /identity/v3/projects/67e4c4e8f5f441c5bc8f752c9db84352 => generated 302 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:39:35.721781 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f764fe1f-3f94-4dd4-901f-996d5a522f26 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:35.758419 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f8b0ec-bd23-4502-9217-bc7126e28949 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:35.784864 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:35.801386 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2808011-85b9-4543-85f0-12788f0675b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:35.803527 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2808011-85b9-4543-85f0-12788f0675b8 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:35.804058 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2808011-85b9-4543-85f0-12788f0675b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:35.804536 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2808011-85b9-4543-85f0-12788f0675b8 None admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:35.805624 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2808011-85b9-4543-85f0-12788f0675b8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:39:35.806158 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2808011-85b9-4543-85f0-12788f0675b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:35.808183 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2808011-85b9-4543-85f0-12788f0675b8 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:35.825288 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 115/230] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 14 17:39:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:35.827088 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2808011-85b9-4543-85f0-12788f0675b8 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:35.921219 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:35.979351 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f764fe1f-3f94-4dd4-901f-996d5a522f26 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:36.009124 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2808011-85b9-4543-85f0-12788f0675b8 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:36.050027 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043c130c-d335-4161-8f68-1422e381f178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:36.050380 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e992e195-e418-4d08-8580-6a54ed645d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:36.051354 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c130c-d335-4161-8f68-1422e381f178 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:36.051483 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e992e195-e418-4d08-8580-6a54ed645d8f None admin] REQUEST_METHOD: `PUT` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:36.051892 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e992e195-e418-4d08-8580-6a54ed645d8f None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:36.052071 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c130c-d335-4161-8f68-1422e381f178 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:36.052370 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e992e195-e418-4d08-8580-6a54ed645d8f None admin] PATH_INFO: `/v3/projects/67e4c4e8f5f441c5bc8f752c9db84352/users/10b037397db141058bf09f5914442da8/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:36.052629 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c130c-d335-4161-8f68-1422e381f178 None admin] PATH_INFO: `/v3/users/10b037397db141058bf09f5914442da8` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:36.054275 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043c130c-d335-4161-8f68-1422e381f178 None admin] RBAC: Authorizing `identity:get_user(user_id=10b037397db141058bf09f5914442da8)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:36.054807 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e992e195-e418-4d08-8580-6a54ed645d8f None admin] RBAC: Authorizing `identity:create_grant(project_id=67e4c4e8f5f441c5bc8f752c9db84352, user_id=10b037397db141058bf09f5914442da8, role_id=4651a1cc7b4d4ab7a7a9ca1e77e58e71)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:36.056128 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043c130c-d335-4161-8f68-1422e381f178 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:36.056458 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e992e195-e418-4d08-8580-6a54ed645d8f None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:36.061837 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 116/231] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 14 17:39:35 2022] GET /identity/v3/users/10b037397db141058bf09f5914442da8 => generated 283 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:36.065126 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043c130c-d335-4161-8f68-1422e381f178 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:36.080456 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 116/232] 10.222.0.67 () {58 vars in 1439 bytes} [Thu Jul 14 17:39:35 2022] PUT /identity/v3/projects/67e4c4e8f5f441c5bc8f752c9db84352/users/10b037397db141058bf09f5914442da8/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 17:39:36.128523 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:36.185656 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043c130c-d335-4161-8f68-1422e381f178 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:36.226101 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28526d30-0302-4f62-a8b9-d82396169e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:36.227308 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28526d30-0302-4f62-a8b9-d82396169e5d None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:36.227778 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28526d30-0302-4f62-a8b9-d82396169e5d None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:36.228331 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28526d30-0302-4f62-a8b9-d82396169e5d None admin] PATH_INFO: `/v3/projects/67e4c4e8f5f441c5bc8f752c9db84352` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:36.230001 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28526d30-0302-4f62-a8b9-d82396169e5d None admin] RBAC: Authorizing `identity:get_project(project_id=67e4c4e8f5f441c5bc8f752c9db84352)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:36.231755 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28526d30-0302-4f62-a8b9-d82396169e5d None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:36.237689 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 117/233] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 14 17:39:36 2022] GET /identity/v3/projects/67e4c4e8f5f441c5bc8f752c9db84352 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:36.240786 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e992e195-e418-4d08-8580-6a54ed645d8f None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:36.358154 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e992e195-e418-4d08-8580-6a54ed645d8f None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:36.406873 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503e3c5f-9564-4e80-b846-deb1a25cdee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:36.407800 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503e3c5f-9564-4e80-b846-deb1a25cdee2 None admin] REQUEST_METHOD: `PUT` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:36.408076 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503e3c5f-9564-4e80-b846-deb1a25cdee2 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:36.408345 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503e3c5f-9564-4e80-b846-deb1a25cdee2 None admin] PATH_INFO: `/v3/projects/67e4c4e8f5f441c5bc8f752c9db84352/users/10b037397db141058bf09f5914442da8/roles/fa9b6b80eda3440ca058cb77bd7f8f5c` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:36.415723 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503e3c5f-9564-4e80-b846-deb1a25cdee2 None admin] RBAC: Authorizing `identity:create_grant(project_id=67e4c4e8f5f441c5bc8f752c9db84352, user_id=10b037397db141058bf09f5914442da8, role_id=fa9b6b80eda3440ca058cb77bd7f8f5c)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:36.417226 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503e3c5f-9564-4e80-b846-deb1a25cdee2 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:36.427482 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:36.447646 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 117/234] 10.222.0.67 () {58 vars in 1439 bytes} [Thu Jul 14 17:39:36 2022] PUT /identity/v3/projects/67e4c4e8f5f441c5bc8f752c9db84352/users/10b037397db141058bf09f5914442da8/roles/fa9b6b80eda3440ca058cb77bd7f8f5c => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:39:37.142887 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f30bdc1-a4a5-49c1-ab3f-ce9119d714b2 None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:37.143438 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f30bdc1-a4a5-49c1-ab3f-ce9119d714b2 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:37.143438 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f30bdc1-a4a5-49c1-ab3f-ce9119d714b2 None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:37.144935 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 118/235] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:39:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:39:37.148066 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817e6712-b0a8-4e59-bd40-3fe630f2678a None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:37.148893 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817e6712-b0a8-4e59-bd40-3fe630f2678a None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:37.150413 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6954c5-e03e-499e-af1d-17cd9fc249c6 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:37.150902 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6954c5-e03e-499e-af1d-17cd9fc249c6 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:37.151383 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6954c5-e03e-499e-af1d-17cd9fc249c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:37.154894 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817e6712-b0a8-4e59-bd40-3fe630f2678a None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:37.156433 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 118/236] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:39:37 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:39:37.162929 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d73655e-9edd-4ada-9b94-02fa8e4aa8cf None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:37.164333 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d73655e-9edd-4ada-9b94-02fa8e4aa8cf None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:37.164811 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d73655e-9edd-4ada-9b94-02fa8e4aa8cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:37.186686 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-6f6954c5-e03e-499e-af1d-17cd9fc249c6 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:39:37.188183 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-6f6954c5-e03e-499e-af1d-17cd9fc249c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:39:37.197039 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-3d73655e-9edd-4ada-9b94-02fa8e4aa8cf None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:39:37.202730 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-3d73655e-9edd-4ada-9b94-02fa8e4aa8cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:39:37.312741 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 119/237] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:39:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:39:37.332732 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 119/238] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:39:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:39:37.338296 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d73655e-9edd-4ada-9b94-02fa8e4aa8cf None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:37.419036 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6954c5-e03e-499e-af1d-17cd9fc249c6 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:37.486604 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d73655e-9edd-4ada-9b94-02fa8e4aa8cf None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:37.517434 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:37.537851 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:37.555628 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7941897b-5c59-4741-b881-dbf4351fadb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:37.556826 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7941897b-5c59-4741-b881-dbf4351fadb7 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:37.557111 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7941897b-5c59-4741-b881-dbf4351fadb7 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:37.557727 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7941897b-5c59-4741-b881-dbf4351fadb7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:37.558944 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7941897b-5c59-4741-b881-dbf4351fadb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:37.560488 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7941897b-5c59-4741-b881-dbf4351fadb7 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:37.562669 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 120/239] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:39:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:37.570717 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7941897b-5c59-4741-b881-dbf4351fadb7 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:37.592418 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6954c5-e03e-499e-af1d-17cd9fc249c6 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:37.629516 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8393a7-7caa-4f4d-b676-c7fd65d60b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:37.630488 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8393a7-7caa-4f4d-b676-c7fd65d60b86 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:37.630779 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8393a7-7caa-4f4d-b676-c7fd65d60b86 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:37.631054 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8393a7-7caa-4f4d-b676-c7fd65d60b86 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:37.641964 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8393a7-7caa-4f4d-b676-c7fd65d60b86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:39:37.650426 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-0d8393a7-7caa-4f4d-b676-c7fd65d60b86 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 17:39:37.650426 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:39:37.650426 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:39:37.650426 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:39:37.650426 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:39:37.650426 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:39:37.650426 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:39:37.650426 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:39:37.650426 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:39:37.650426 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:39:37.650426 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:39:37.650426 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:39:37.650426 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:39:37.650426 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:39:37.650426 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:39:37.650426 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:39:37.651330 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:39:37.651330 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:39:37.651330 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:39:37.651330 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:39:37.651330 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:39:37.651330 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:39:37.651330 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:39:37.651330 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:39:37.651330 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:39:37.651330 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:39:37.651330 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:39:37.651330 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:39:37.651330 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:39:37.651330 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:39:37.651330 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:39:37.651330 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:39:37.652116 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:39:37.652116 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:39:37.652116 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:39:37.652116 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:39:37.652116 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:39:37.652116 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:39:37.652116 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:39:37.652116 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:39:37.652116 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:39:37.652116 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:39:37.652116 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 17:39:37.652116 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:39:37.652116 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 120/240] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 14 17:39:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 17:39:37.662155 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8393a7-7caa-4f4d-b676-c7fd65d60b86 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:37.745469 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7941897b-5c59-4741-b881-dbf4351fadb7 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:37.770478 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8393a7-7caa-4f4d-b676-c7fd65d60b86 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:37.781879 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:37.800001 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb49e7b-3901-4df8-9dd3-c3ab2119068f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:37.801048 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb49e7b-3901-4df8-9dd3-c3ab2119068f None admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:37.801555 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb49e7b-3901-4df8-9dd3-c3ab2119068f None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:37.802053 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb49e7b-3901-4df8-9dd3-c3ab2119068f None admin] PATH_INFO: `/v3/users` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:37.802962 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb49e7b-3901-4df8-9dd3-c3ab2119068f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:37.804589 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb49e7b-3901-4df8-9dd3-c3ab2119068f None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:37.808433 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b620cb4-bd01-4e19-aa6e-cc961cab75be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:37.809101 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b620cb4-bd01-4e19-aa6e-cc961cab75be None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:37.809383 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b620cb4-bd01-4e19-aa6e-cc961cab75be None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:37.809686 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b620cb4-bd01-4e19-aa6e-cc961cab75be None admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:37.810436 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b620cb4-bd01-4e19-aa6e-cc961cab75be None admin] RBAC: Adding query filter params (name=reader) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:39:37.810738 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b620cb4-bd01-4e19-aa6e-cc961cab75be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:37.812099 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b620cb4-bd01-4e19-aa6e-cc961cab75be None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:37.822513 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 121/241] 10.222.0.67 () {56 vars in 1101 bytes} [Thu Jul 14 17:39:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:39:37.829392 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b801ada-e6b4-4ba2-a500-9ff299ed41ae None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:37.829392 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b801ada-e6b4-4ba2-a500-9ff299ed41ae None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:37.829392 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b801ada-e6b4-4ba2-a500-9ff299ed41ae None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:37.829392 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 122/242] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:39:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:39:37.831701 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b801ada-e6b4-4ba2-a500-9ff299ed41ae None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:37.841997 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 121/243] 10.222.0.67 () {60 vars in 1132 bytes} [Thu Jul 14 17:39:37 2022] POST /identity/v3/users => generated 293 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 17:39:37.843270 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beeb948-652d-49f1-bea2-0c3a52fb7a7c None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:37.843555 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beeb948-652d-49f1-bea2-0c3a52fb7a7c None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:37.843834 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beeb948-652d-49f1-bea2-0c3a52fb7a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:37.894698 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-6beeb948-652d-49f1-bea2-0c3a52fb7a7c None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:39:37.896476 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-6beeb948-652d-49f1-bea2-0c3a52fb7a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:39:37.972690 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b801ada-e6b4-4ba2-a500-9ff299ed41ae None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:38.016486 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52e1b11-b5a1-4012-af65-03dcef8518a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:38.017776 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e1b11-b5a1-4012-af65-03dcef8518a8 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:38.018261 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e1b11-b5a1-4012-af65-03dcef8518a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:38.018727 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e1b11-b5a1-4012-af65-03dcef8518a8 None admin] PATH_INFO: `/v3/users/176e4aa06b5e4c549375bd1774432a6d` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:38.035800 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52e1b11-b5a1-4012-af65-03dcef8518a8 None admin] RBAC: Authorizing `identity:get_user(user_id=176e4aa06b5e4c549375bd1774432a6d)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:38.037012 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:38.038625 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52e1b11-b5a1-4012-af65-03dcef8518a8 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:38.040691 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 123/244] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 14 17:39:37 2022] GET /identity/v3/users/176e4aa06b5e4c549375bd1774432a6d => generated 297 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:38.047133 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52e1b11-b5a1-4012-af65-03dcef8518a8 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:38.084545 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:38.095406 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 122/245] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:39:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:39:38.123848 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beeb948-652d-49f1-bea2-0c3a52fb7a7c None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:38.190229 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52e1b11-b5a1-4012-af65-03dcef8518a8 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:38.255801 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6bf26b-340f-418d-b851-d29442b4e53c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:38.256465 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6bf26b-340f-418d-b851-d29442b4e53c None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:38.256746 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6bf26b-340f-418d-b851-d29442b4e53c None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:38.257022 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6bf26b-340f-418d-b851-d29442b4e53c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:38.259686 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beeb948-652d-49f1-bea2-0c3a52fb7a7c None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:38.312606 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800e75a2-e562-42e5-8057-79e286694f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:38.313936 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e75a2-e562-42e5-8057-79e286694f44 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:38.314219 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e75a2-e562-42e5-8057-79e286694f44 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:38.314496 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e75a2-e562-42e5-8057-79e286694f44 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:38.329695 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800e75a2-e562-42e5-8057-79e286694f44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:39:38.339514 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-800e75a2-e562-42e5-8057-79e286694f44 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 17:39:38.339514 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:39:38.339514 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:39:38.339514 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:39:38.339514 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:39:38.339514 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:39:38.339514 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:39:38.339514 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:39:38.339514 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:39:38.339514 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:39:38.339514 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:39:38.339514 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:39:38.339514 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:39:38.339514 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:39:38.339514 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:39:38.339514 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:39:38.340485 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:39:38.340485 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:39:38.340485 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:39:38.340485 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:39:38.340485 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:39:38.340485 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:39:38.340485 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:39:38.340485 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:39:38.340485 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:39:38.340485 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:39:38.340485 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:39:38.340485 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:39:38.340485 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:39:38.340485 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:39:38.340485 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:39:38.340485 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:39:38.341293 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:39:38.341293 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:39:38.341293 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:39:38.341293 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:39:38.341293 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:39:38.341293 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:39:38.341293 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:39:38.341293 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:39:38.341293 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:39:38.341293 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:39:38.341293 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 17:39:38.341293 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:39:38.342499 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 123/246] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 14 17:39:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 17:39:38.350393 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6bf26b-340f-418d-b851-d29442b4e53c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:38.351893 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6bf26b-340f-418d-b851-d29442b4e53c None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:38.355919 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800e75a2-e562-42e5-8057-79e286694f44 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:38.385649 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:38.405337 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:38.467388 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 124/247] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 14 17:39:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 17:39:38.472884 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6bf26b-340f-418d-b851-d29442b4e53c None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:38.476478 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800e75a2-e562-42e5-8057-79e286694f44 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:38.515174 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a430d38-ec45-4284-8a86-81f1b31a23a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:38.515864 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a430d38-ec45-4284-8a86-81f1b31a23a9 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:38.516131 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a430d38-ec45-4284-8a86-81f1b31a23a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:38.516408 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a430d38-ec45-4284-8a86-81f1b31a23a9 None admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:38.517174 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a430d38-ec45-4284-8a86-81f1b31a23a9 None admin] RBAC: Adding query filter params (name=member) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:39:38.517477 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a430d38-ec45-4284-8a86-81f1b31a23a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:38.518903 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a430d38-ec45-4284-8a86-81f1b31a23a9 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:38.528860 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 124/248] 10.222.0.67 () {56 vars in 1101 bytes} [Thu Jul 14 17:39:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:39:38.534410 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a430d38-ec45-4284-8a86-81f1b31a23a9 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:38.586697 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6bf26b-340f-418d-b851-d29442b4e53c None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:38.619197 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:38.627111 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c605a5d-5345-480e-99ca-4f88a34cfe36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:38.628134 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c605a5d-5345-480e-99ca-4f88a34cfe36 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:38.628418 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c605a5d-5345-480e-99ca-4f88a34cfe36 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:38.628702 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c605a5d-5345-480e-99ca-4f88a34cfe36 None admin] PATH_INFO: `/v3/projects/67e4c4e8f5f441c5bc8f752c9db84352` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:38.630288 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c605a5d-5345-480e-99ca-4f88a34cfe36 None admin] RBAC: Authorizing `identity:get_project(project_id=67e4c4e8f5f441c5bc8f752c9db84352)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:38.631750 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c605a5d-5345-480e-99ca-4f88a34cfe36 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:38.633996 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 125/249] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 14 17:39:38 2022] GET /identity/v3/projects/67e4c4e8f5f441c5bc8f752c9db84352 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:39:38.635349 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58ad88c-c30a-41b4-a4b9-ae8ad4985faf None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:38.635633 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58ad88c-c30a-41b4-a4b9-ae8ad4985faf None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:38.635935 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58ad88c-c30a-41b4-a4b9-ae8ad4985faf None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:38.641937 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 126/250] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:39:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:39:38.644413 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58ad88c-c30a-41b4-a4b9-ae8ad4985faf None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:38.647894 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a430d38-ec45-4284-8a86-81f1b31a23a9 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:38.649494 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:38.686296 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301de1a9-0836-404a-8b65-06f432e34bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:38.687194 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301de1a9-0836-404a-8b65-06f432e34bbd None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:38.687472 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301de1a9-0836-404a-8b65-06f432e34bbd None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:38.687749 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301de1a9-0836-404a-8b65-06f432e34bbd None admin] PATH_INFO: `/v3/users/110fdac68c844ae3b627674e69504b70` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:38.688998 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301de1a9-0836-404a-8b65-06f432e34bbd None admin] RBAC: Authorizing `identity:get_user(user_id=110fdac68c844ae3b627674e69504b70)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:38.690484 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301de1a9-0836-404a-8b65-06f432e34bbd None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:38.692414 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 125/251] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 14 17:39:38 2022] GET /identity/v3/users/110fdac68c844ae3b627674e69504b70 => generated 297 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:39:38.693415 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c571d0-5187-4a9d-b84b-734df487000e None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:38.697849 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c571d0-5187-4a9d-b84b-734df487000e None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:38.698168 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c571d0-5187-4a9d-b84b-734df487000e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:38.715850 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-27c571d0-5187-4a9d-b84b-734df487000e None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:39:38.717109 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-27c571d0-5187-4a9d-b84b-734df487000e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:39:38.765664 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58ad88c-c30a-41b4-a4b9-ae8ad4985faf None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:38.822584 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 126/252] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:39:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:39:38.826760 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c571d0-5187-4a9d-b84b-734df487000e None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:38.850595 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3be120e-8aaf-4c7a-be8e-938563d1743a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:38.851245 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3be120e-8aaf-4c7a-be8e-938563d1743a None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:38.851521 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3be120e-8aaf-4c7a-be8e-938563d1743a None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:38.851792 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3be120e-8aaf-4c7a-be8e-938563d1743a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:38.852733 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3be120e-8aaf-4c7a-be8e-938563d1743a None admin] RBAC: Adding query filter params (role.id=7e81381d29ef4d8c89fe53e977678bf6, scope.project.id=67e4c4e8f5f441c5bc8f752c9db84352, user.id=176e4aa06b5e4c549375bd1774432a6d) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:39:38.853050 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3be120e-8aaf-4c7a-be8e-938563d1743a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:38.854573 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3be120e-8aaf-4c7a-be8e-938563d1743a None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:38.868617 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 127/253] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 14 17:39:38 2022] GET /identity/v3/role_assignments?user.id=176e4aa06b5e4c549375bd1774432a6d&scope.project.id=67e4c4e8f5f441c5bc8f752c9db84352&role.id=7e81381d29ef4d8c89fe53e977678bf6 => generated 259 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:39:38.869462 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3be120e-8aaf-4c7a-be8e-938563d1743a None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:39.038428 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:39.062727 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:39.070403 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c571d0-5187-4a9d-b84b-734df487000e None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:39.134135 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8243a11-187f-4dde-a357-68a06924d2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:39.135022 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8243a11-187f-4dde-a357-68a06924d2e6 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:39.135300 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8243a11-187f-4dde-a357-68a06924d2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:39.135579 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8243a11-187f-4dde-a357-68a06924d2e6 None admin] PATH_INFO: `/v3/projects/67e4c4e8f5f441c5bc8f752c9db84352` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:39.137961 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3be120e-8aaf-4c7a-be8e-938563d1743a None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:39.140138 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8243a11-187f-4dde-a357-68a06924d2e6 None admin] RBAC: Authorizing `identity:get_project(project_id=67e4c4e8f5f441c5bc8f752c9db84352)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:39.141646 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8243a11-187f-4dde-a357-68a06924d2e6 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:39.143677 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 127/254] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 14 17:39:38 2022] GET /identity/v3/projects/67e4c4e8f5f441c5bc8f752c9db84352 => generated 302 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:39.144815 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c9ffff-e066-47aa-a0e5-0ec787f9ee8c None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:39.145102 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c9ffff-e066-47aa-a0e5-0ec787f9ee8c None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:39.145377 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c9ffff-e066-47aa-a0e5-0ec787f9ee8c None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:39.146879 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 128/255] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:39:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:39:39.151413 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c9ffff-e066-47aa-a0e5-0ec787f9ee8c None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:39.203053 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a7c08f-0519-4556-a207-09aedd75196a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:39.204797 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a7c08f-0519-4556-a207-09aedd75196a None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:39.205230 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a7c08f-0519-4556-a207-09aedd75196a None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:39.205603 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a7c08f-0519-4556-a207-09aedd75196a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:39.219158 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a7c08f-0519-4556-a207-09aedd75196a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:39:39.229593 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-47a7c08f-0519-4556-a207-09aedd75196a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 17:39:39.229593 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:39:39.229593 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:39:39.229593 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:39:39.229593 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:39:39.229593 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:39:39.229593 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:39:39.229593 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:39:39.229593 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:39:39.229593 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:39:39.229593 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:39:39.229593 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:39:39.229593 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:39:39.229593 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:39:39.229593 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:39:39.229593 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:39:39.230556 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:39:39.230556 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:39:39.230556 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:39:39.230556 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:39:39.230556 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:39:39.230556 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:39:39.230556 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:39:39.230556 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:39:39.230556 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:39:39.230556 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:39:39.230556 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:39:39.230556 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:39:39.230556 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:39:39.230556 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:39:39.230556 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:39:39.230556 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:39:39.231618 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:39:39.231618 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:39:39.231618 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:39:39.231618 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:39:39.231618 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:39:39.231618 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:39:39.231618 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:39:39.231618 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:39:39.231618 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:39:39.231618 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:39:39.231618 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 17:39:39.231618 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:39:39.231618 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 128/256] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 14 17:39:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 362 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:39:39.232423 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8203fbf-f386-49f0-882f-1c1d538bd8e6 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:39.233034 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8203fbf-f386-49f0-882f-1c1d538bd8e6 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:39.233375 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8203fbf-f386-49f0-882f-1c1d538bd8e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:39.265896 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-a8203fbf-f386-49f0-882f-1c1d538bd8e6 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:39:39.267119 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-a8203fbf-f386-49f0-882f-1c1d538bd8e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:39:39.314061 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c9ffff-e066-47aa-a0e5-0ec787f9ee8c None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:39.378958 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 129/257] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:39:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:39:39.382367 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc12bfc-428e-4a2f-9057-50f0e321ab93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:39.382620 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8203fbf-f386-49f0-882f-1c1d538bd8e6 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:39.383721 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc12bfc-428e-4a2f-9057-50f0e321ab93 None admin] REQUEST_METHOD: `PUT` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:39.384277 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc12bfc-428e-4a2f-9057-50f0e321ab93 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:39.384747 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc12bfc-428e-4a2f-9057-50f0e321ab93 None admin] PATH_INFO: `/v3/projects/67e4c4e8f5f441c5bc8f752c9db84352/users/110fdac68c844ae3b627674e69504b70/roles/95d753870f97426cb1ce32e078621a4c` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:39.398541 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc12bfc-428e-4a2f-9057-50f0e321ab93 None admin] RBAC: Authorizing `identity:create_grant(project_id=67e4c4e8f5f441c5bc8f752c9db84352, user_id=110fdac68c844ae3b627674e69504b70, role_id=95d753870f97426cb1ce32e078621a4c)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:39.400483 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc12bfc-428e-4a2f-9057-50f0e321ab93 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:39.447805 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 129/258] 10.222.0.67 () {58 vars in 1439 bytes} [Thu Jul 14 17:39:39 2022] PUT /identity/v3/projects/67e4c4e8f5f441c5bc8f752c9db84352/users/110fdac68c844ae3b627674e69504b70/roles/95d753870f97426cb1ce32e078621a4c => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:39:39.448650 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc12bfc-428e-4a2f-9057-50f0e321ab93 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:39.473106 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:39.554812 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:39.567726 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8203fbf-f386-49f0-882f-1c1d538bd8e6 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:39.650503 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7606801-d853-4a94-9a02-200648b0f4b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:39.651120 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7606801-d853-4a94-9a02-200648b0f4b8 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:39.651454 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7606801-d853-4a94-9a02-200648b0f4b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:39.651774 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7606801-d853-4a94-9a02-200648b0f4b8 None admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:39.652548 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7606801-d853-4a94-9a02-200648b0f4b8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:39:39.652851 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7606801-d853-4a94-9a02-200648b0f4b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:39.654278 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7606801-d853-4a94-9a02-200648b0f4b8 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:39.668146 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 130/259] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 14 17:39:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:39.673724 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7606801-d853-4a94-9a02-200648b0f4b8 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:39.743700 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc12bfc-428e-4a2f-9057-50f0e321ab93 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:39.811175 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f5fa0-fe45-457b-b0e4-548b137c34dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:39.812015 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f5fa0-fe45-457b-b0e4-548b137c34dc None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:39.812294 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f5fa0-fe45-457b-b0e4-548b137c34dc None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:39.812565 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f5fa0-fe45-457b-b0e4-548b137c34dc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:39.840698 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9f5fa0-fe45-457b-b0e4-548b137c34dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:39:39.851112 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-6d9f5fa0-fe45-457b-b0e4-548b137c34dc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 17:39:39.851112 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:39:39.851112 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:39:39.851112 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:39:39.851112 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:39:39.851112 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:39:39.851112 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:39:39.851112 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:39:39.851112 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:39:39.851112 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:39:39.851112 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:39:39.851112 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:39:39.851112 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:39:39.851112 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:39:39.851112 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:39:39.851112 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:39:39.852081 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:39:39.852081 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:39:39.852081 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:39:39.852081 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:39:39.852081 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:39:39.852081 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:39:39.852081 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:39:39.852081 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:39:39.852081 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:39:39.852081 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:39:39.852081 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:39:39.852081 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:39:39.852081 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:39:39.852081 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:39:39.852081 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:39:39.852081 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:39:39.852900 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:39:39.852900 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:39:39.852900 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:39:39.852900 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:39:39.852900 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:39:39.852900 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:39:39.852900 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:39:39.852900 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:39:39.852900 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:39:39.852900 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:39:39.852900 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 17:39:39.852900 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:39:39.852900 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 130/260] 10.222.0.67 () {56 vars in 1114 bytes} [Thu Jul 14 17:39:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 404 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:39:39.859924 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f5fa0-fe45-457b-b0e4-548b137c34dc None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:39.895080 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7606801-d853-4a94-9a02-200648b0f4b8 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:39.922749 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:39.962805 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd221fa-f2e3-4dbd-9a8f-d2593a7e1cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:39.963796 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd221fa-f2e3-4dbd-9a8f-d2593a7e1cf3 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:39.964077 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd221fa-f2e3-4dbd-9a8f-d2593a7e1cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:39.964349 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd221fa-f2e3-4dbd-9a8f-d2593a7e1cf3 None admin] PATH_INFO: `/v3/users/10b037397db141058bf09f5914442da8` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:39.970786 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd221fa-f2e3-4dbd-9a8f-d2593a7e1cf3 None admin] RBAC: Authorizing `identity:get_user(user_id=10b037397db141058bf09f5914442da8)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:39.972373 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd221fa-f2e3-4dbd-9a8f-d2593a7e1cf3 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:39.975237 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 131/261] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 14 17:39:39 2022] GET /identity/v3/users/10b037397db141058bf09f5914442da8 => generated 283 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:39:39.981203 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd221fa-f2e3-4dbd-9a8f-d2593a7e1cf3 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:39.993918 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:40.020254 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f5fa0-fe45-457b-b0e4-548b137c34dc None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:40.102270 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279cc497-5016-4269-ad42-4cb9b3414163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:40.102976 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279cc497-5016-4269-ad42-4cb9b3414163 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:40.103269 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279cc497-5016-4269-ad42-4cb9b3414163 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:40.103550 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279cc497-5016-4269-ad42-4cb9b3414163 None admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:40.104329 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279cc497-5016-4269-ad42-4cb9b3414163 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:39:40.104642 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279cc497-5016-4269-ad42-4cb9b3414163 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:40.106096 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279cc497-5016-4269-ad42-4cb9b3414163 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:40.127929 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 131/262] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 14 17:39:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:40.138232 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279cc497-5016-4269-ad42-4cb9b3414163 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:40.151003 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd221fa-f2e3-4dbd-9a8f-d2593a7e1cf3 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:40.186710 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021bac5e-b962-4e0e-9c65-699ae1a8116a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:40.187288 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021bac5e-b962-4e0e-9c65-699ae1a8116a None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:40.187569 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021bac5e-b962-4e0e-9c65-699ae1a8116a None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:40.187842 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021bac5e-b962-4e0e-9c65-699ae1a8116a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:40.246217 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:40.266996 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021bac5e-b962-4e0e-9c65-699ae1a8116a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:40.268482 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021bac5e-b962-4e0e-9c65-699ae1a8116a None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:40.374109 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 132/263] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 14 17:39:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 17:39:40.379963 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021bac5e-b962-4e0e-9c65-699ae1a8116a None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:40.470096 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:40.483571 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279cc497-5016-4269-ad42-4cb9b3414163 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:40.490778 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021bac5e-b962-4e0e-9c65-699ae1a8116a None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:40.545044 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f79633-6e85-4cf7-be2c-567ff2a439a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:40.546398 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f79633-6e85-4cf7-be2c-567ff2a439a0 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:40.546884 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f79633-6e85-4cf7-be2c-567ff2a439a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:40.547354 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f79633-6e85-4cf7-be2c-567ff2a439a0 None admin] PATH_INFO: `/v3/users/10b037397db141058bf09f5914442da8` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:40.554324 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f79633-6e85-4cf7-be2c-567ff2a439a0 None admin] RBAC: Authorizing `identity:get_user(user_id=10b037397db141058bf09f5914442da8)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:40.555788 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f79633-6e85-4cf7-be2c-567ff2a439a0 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:40.557499 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 132/264] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 14 17:39:40 2022] GET /identity/v3/users/10b037397db141058bf09f5914442da8 => generated 283 bytes in 420 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:40.564170 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa155040-66a2-4e0e-8586-5d3faf4eeb1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:40.565051 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa155040-66a2-4e0e-8586-5d3faf4eeb1e None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:40.565332 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa155040-66a2-4e0e-8586-5d3faf4eeb1e None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:40.565628 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa155040-66a2-4e0e-8586-5d3faf4eeb1e None admin] PATH_INFO: `/v3/projects/67e4c4e8f5f441c5bc8f752c9db84352` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:40.567566 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa155040-66a2-4e0e-8586-5d3faf4eeb1e None admin] RBAC: Authorizing `identity:get_project(project_id=67e4c4e8f5f441c5bc8f752c9db84352)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:40.569013 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa155040-66a2-4e0e-8586-5d3faf4eeb1e None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:40.570727 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 133/265] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 14 17:39:40 2022] GET /identity/v3/projects/67e4c4e8f5f441c5bc8f752c9db84352 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:39:40.571659 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f79633-6e85-4cf7-be2c-567ff2a439a0 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:40.581330 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa155040-66a2-4e0e-8586-5d3faf4eeb1e None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:40.621912 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:40.780580 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f79633-6e85-4cf7-be2c-567ff2a439a0 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:40.819710 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa155040-66a2-4e0e-8586-5d3faf4eeb1e None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:40.862377 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40119fb5-c32e-426f-bb4d-9bddca79dff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:40.863053 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40119fb5-c32e-426f-bb4d-9bddca79dff6 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:40.863334 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40119fb5-c32e-426f-bb4d-9bddca79dff6 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:40.863604 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40119fb5-c32e-426f-bb4d-9bddca79dff6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:40.898306 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39536a82-3728-4e40-a241-935a1002bd55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:40.898994 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39536a82-3728-4e40-a241-935a1002bd55 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:40.899285 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39536a82-3728-4e40-a241-935a1002bd55 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:40.899570 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39536a82-3728-4e40-a241-935a1002bd55 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:40.900432 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39536a82-3728-4e40-a241-935a1002bd55 None admin] RBAC: Adding query filter params (role.id=4651a1cc7b4d4ab7a7a9ca1e77e58e71, scope.project.id=67e4c4e8f5f441c5bc8f752c9db84352, user.id=10b037397db141058bf09f5914442da8) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:39:40.900750 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39536a82-3728-4e40-a241-935a1002bd55 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:40.902274 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39536a82-3728-4e40-a241-935a1002bd55 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:40.920163 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 134/266] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 14 17:39:40 2022] GET /identity/v3/role_assignments?user.id=10b037397db141058bf09f5914442da8&scope.project.id=67e4c4e8f5f441c5bc8f752c9db84352&role.id=4651a1cc7b4d4ab7a7a9ca1e77e58e71 => generated 608 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:40.962588 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40119fb5-c32e-426f-bb4d-9bddca79dff6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:40.964070 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40119fb5-c32e-426f-bb4d-9bddca79dff6 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:40.968680 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f5331d-135a-43df-a380-59069ae10c68 None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:40.969041 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f5331d-135a-43df-a380-59069ae10c68 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:40.969327 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f5331d-135a-43df-a380-59069ae10c68 None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:40.971015 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 135/267] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:39:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:39:40.976782 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f017914-52bc-49b3-bf14-c3caaed462cd None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:40.977075 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f017914-52bc-49b3-bf14-c3caaed462cd None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:40.977349 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f017914-52bc-49b3-bf14-c3caaed462cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:40.983892 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:41.026788 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-6f017914-52bc-49b3-bf14-c3caaed462cd None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:39:41.028056 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-6f017914-52bc-49b3-bf14-c3caaed462cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:39:41.050551 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:41.078561 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 133/268] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 14 17:39:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 17:39:41.084566 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40119fb5-c32e-426f-bb4d-9bddca79dff6 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:41.219309 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 136/269] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:39:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:39:41.242579 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f017914-52bc-49b3-bf14-c3caaed462cd None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:41.322036 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40119fb5-c32e-426f-bb4d-9bddca79dff6 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:41.345902 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:41.366207 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56639525-3e0f-4d41-8199-a8ddd3e8ecb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:41.367595 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56639525-3e0f-4d41-8199-a8ddd3e8ecb9 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:41.368321 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56639525-3e0f-4d41-8199-a8ddd3e8ecb9 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:41.369182 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56639525-3e0f-4d41-8199-a8ddd3e8ecb9 None admin] PATH_INFO: `/v3/projects/67e4c4e8f5f441c5bc8f752c9db84352` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:41.370747 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56639525-3e0f-4d41-8199-a8ddd3e8ecb9 None admin] RBAC: Authorizing `identity:get_project(project_id=67e4c4e8f5f441c5bc8f752c9db84352)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:41.373757 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56639525-3e0f-4d41-8199-a8ddd3e8ecb9 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:41.377760 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 134/270] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 14 17:39:41 2022] GET /identity/v3/projects/67e4c4e8f5f441c5bc8f752c9db84352 => generated 302 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:41.378074 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5712185b-53cf-41c0-beb6-c141baf8fbe7 None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:41.378482 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5712185b-53cf-41c0-beb6-c141baf8fbe7 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:41.378673 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5712185b-53cf-41c0-beb6-c141baf8fbe7 None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:41.381620 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 135/271] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:39:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:39:41.386861 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5712185b-53cf-41c0-beb6-c141baf8fbe7 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:41.407824 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f017914-52bc-49b3-bf14-c3caaed462cd None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:41.482260 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095a7c30-3588-445e-b86d-d19e3a08283e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:41.483367 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a7c30-3588-445e-b86d-d19e3a08283e None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:41.483847 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a7c30-3588-445e-b86d-d19e3a08283e None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:41.484288 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a7c30-3588-445e-b86d-d19e3a08283e None admin] PATH_INFO: `/v3/roles/member` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:41.516416 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095a7c30-3588-445e-b86d-d19e3a08283e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:39:41.524212 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5712185b-53cf-41c0-beb6-c141baf8fbe7 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:41.525763 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-095a7c30-3588-445e-b86d-d19e3a08283e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 17:39:41.525763 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:39:41.525763 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:39:41.525763 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:39:41.525763 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:39:41.525763 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:39:41.525763 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:39:41.525763 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:39:41.525763 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:39:41.525763 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:39:41.525763 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:39:41.525763 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:39:41.525763 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:39:41.525763 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:39:41.525763 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:39:41.525763 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:39:41.526860 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:39:41.526860 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:39:41.526860 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:39:41.526860 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:39:41.526860 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:39:41.526860 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:39:41.526860 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:39:41.526860 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:39:41.526860 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:39:41.526860 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:39:41.526860 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:39:41.526860 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:39:41.526860 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:39:41.526860 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:39:41.526860 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:39:41.526860 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:39:41.527777 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:39:41.527777 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:39:41.527777 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:39:41.527777 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:39:41.527777 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:39:41.527777 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:39:41.527777 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:39:41.527777 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:39:41.527777 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:39:41.527777 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:39:41.527777 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 17:39:41.527777 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:39:41.529887 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 137/272] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 14 17:39:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 17:39:41.531240 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe8ee8-35d4-40e5-9586-e3383657fbba None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:41.531666 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe8ee8-35d4-40e5-9586-e3383657fbba None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:41.532123 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe8ee8-35d4-40e5-9586-e3383657fbba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:41.539146 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:41.551807 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-ccfe8ee8-35d4-40e5-9586-e3383657fbba None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:39:41.553848 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-ccfe8ee8-35d4-40e5-9586-e3383657fbba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:39:41.564760 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dc2826-e0a8-40b3-b33e-44a16dcbbefa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:41.565754 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc2826-e0a8-40b3-b33e-44a16dcbbefa None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:41.566207 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc2826-e0a8-40b3-b33e-44a16dcbbefa None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:41.566732 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc2826-e0a8-40b3-b33e-44a16dcbbefa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:41.567849 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dc2826-e0a8-40b3-b33e-44a16dcbbefa None admin] RBAC: Adding query filter params (role.id=fa9b6b80eda3440ca058cb77bd7f8f5c, scope.project.id=67e4c4e8f5f441c5bc8f752c9db84352, user.id=10b037397db141058bf09f5914442da8) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:39:41.568313 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dc2826-e0a8-40b3-b33e-44a16dcbbefa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:41.570045 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dc2826-e0a8-40b3-b33e-44a16dcbbefa None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:41.576954 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 136/273] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 14 17:39:41 2022] GET /identity/v3/role_assignments?user.id=10b037397db141058bf09f5914442da8&scope.project.id=67e4c4e8f5f441c5bc8f752c9db84352&role.id=fa9b6b80eda3440ca058cb77bd7f8f5c => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:39:41.578204 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dc2826-e0a8-40b3-b33e-44a16dcbbefa None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:41.633203 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 138/274] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:39:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:39:41.641999 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:41.676246 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfe8ee8-35d4-40e5-9586-e3383657fbba None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:41.694361 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dc2826-e0a8-40b3-b33e-44a16dcbbefa None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:41.732924 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade7c422-4ab1-4e11-b4d4-826d16ad190c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:41.733932 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade7c422-4ab1-4e11-b4d4-826d16ad190c None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:41.734395 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade7c422-4ab1-4e11-b4d4-826d16ad190c None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:41.734845 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade7c422-4ab1-4e11-b4d4-826d16ad190c None admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:41.735807 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade7c422-4ab1-4e11-b4d4-826d16ad190c None admin] RBAC: Adding query filter params (name=member) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:39:41.736288 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade7c422-4ab1-4e11-b4d4-826d16ad190c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:41.737868 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade7c422-4ab1-4e11-b4d4-826d16ad190c None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:41.748398 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 137/275] 10.222.0.67 () {56 vars in 1101 bytes} [Thu Jul 14 17:39:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:41.753794 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade7c422-4ab1-4e11-b4d4-826d16ad190c None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:41.808481 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfe8ee8-35d4-40e5-9586-e3383657fbba None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:41.847305 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00eb5ff-3cec-4cd3-89c4-84de5ffd00f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:41.847991 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00eb5ff-3cec-4cd3-89c4-84de5ffd00f1 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:41.848340 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00eb5ff-3cec-4cd3-89c4-84de5ffd00f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:41.849194 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00eb5ff-3cec-4cd3-89c4-84de5ffd00f1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:41.850510 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00eb5ff-3cec-4cd3-89c4-84de5ffd00f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:41.852317 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00eb5ff-3cec-4cd3-89c4-84de5ffd00f1 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:41.854437 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 139/276] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:39:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:41.866727 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00eb5ff-3cec-4cd3-89c4-84de5ffd00f1 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:41.869747 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:41.874723 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade7c422-4ab1-4e11-b4d4-826d16ad190c None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:41.889126 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:41.916479 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38639349-3771-4c03-8880-9db3b6f7c481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:41.917951 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38639349-3771-4c03-8880-9db3b6f7c481 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:41.918385 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38639349-3771-4c03-8880-9db3b6f7c481 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:41.918802 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38639349-3771-4c03-8880-9db3b6f7c481 None admin] PATH_INFO: `/v3/users/837f29b39e8945f9abe74bf343a8d80a` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:41.936135 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38639349-3771-4c03-8880-9db3b6f7c481 None admin] RBAC: Authorizing `identity:get_user(user_id=837f29b39e8945f9abe74bf343a8d80a)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:41.937938 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38639349-3771-4c03-8880-9db3b6f7c481 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:41.940327 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 138/277] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 14 17:39:41 2022] GET /identity/v3/users/837f29b39e8945f9abe74bf343a8d80a => generated 293 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:39:41.950583 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38639349-3771-4c03-8880-9db3b6f7c481 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:41.982841 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00eb5ff-3cec-4cd3-89c4-84de5ffd00f1 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:42.033117 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6886b994-ab5d-49b8-b5b9-a8034d7dadea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:42.033832 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6886b994-ab5d-49b8-b5b9-a8034d7dadea None admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:42.034143 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6886b994-ab5d-49b8-b5b9-a8034d7dadea None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:42.034505 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6886b994-ab5d-49b8-b5b9-a8034d7dadea None admin] PATH_INFO: `/v3/users` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:42.035231 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6886b994-ab5d-49b8-b5b9-a8034d7dadea None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:42.037271 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6886b994-ab5d-49b8-b5b9-a8034d7dadea None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:42.064842 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 140/278] 10.222.0.67 () {60 vars in 1132 bytes} [Thu Jul 14 17:39:41 2022] POST /identity/v3/users => generated 293 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:39:42.066532 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25efd00a-a2f1-479c-a994-aa0e391949f9 None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:42.066870 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25efd00a-a2f1-479c-a994-aa0e391949f9 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:42.067161 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25efd00a-a2f1-479c-a994-aa0e391949f9 None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:42.068690 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 141/279] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:39:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:39:42.074822 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c2c2cd-9827-4f7e-996f-b8392557592e None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:42.075168 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c2c2cd-9827-4f7e-996f-b8392557592e None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:42.075452 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c2c2cd-9827-4f7e-996f-b8392557592e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:42.093229 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38639349-3771-4c03-8880-9db3b6f7c481 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:42.097834 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-06c2c2cd-9827-4f7e-996f-b8392557592e None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:39:42.099537 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-06c2c2cd-9827-4f7e-996f-b8392557592e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:39:42.148574 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd8444c-f7d0-4689-91e5-bb480ecfb9ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:42.149658 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd8444c-f7d0-4689-91e5-bb480ecfb9ac None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:42.150968 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd8444c-f7d0-4689-91e5-bb480ecfb9ac None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:42.151511 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd8444c-f7d0-4689-91e5-bb480ecfb9ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:42.152648 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd8444c-f7d0-4689-91e5-bb480ecfb9ac None admin] RBAC: Adding query filter params (role.id=95d753870f97426cb1ce32e078621a4c, user.id=837f29b39e8945f9abe74bf343a8d80a, scope.system=all) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:39:42.153208 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd8444c-f7d0-4689-91e5-bb480ecfb9ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:42.156187 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd8444c-f7d0-4689-91e5-bb480ecfb9ac None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:42.164970 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 139/280] 10.222.0.67 () {56 vars in 1308 bytes} [Thu Jul 14 17:39:41 2022] GET /identity/v3/role_assignments?user.id=837f29b39e8945f9abe74bf343a8d80a&scope.system=all&role.id=95d753870f97426cb1ce32e078621a4c => generated 226 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:42.170775 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:42.191344 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 142/281] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:39:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 17:39:42.215435 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd8444c-f7d0-4689-91e5-bb480ecfb9ac None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:42.269556 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:42.358945 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd8444c-f7d0-4689-91e5-bb480ecfb9ac None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:42.397270 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46998c8-2337-48f1-9a9e-c15fa9ea172b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:42.398165 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46998c8-2337-48f1-9a9e-c15fa9ea172b None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:42.398455 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46998c8-2337-48f1-9a9e-c15fa9ea172b None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:42.398735 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46998c8-2337-48f1-9a9e-c15fa9ea172b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:42.410760 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46998c8-2337-48f1-9a9e-c15fa9ea172b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:39:42.419501 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-f46998c8-2337-48f1-9a9e-c15fa9ea172b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 17:39:42.419501 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:39:42.419501 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:39:42.419501 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:39:42.419501 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:39:42.419501 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:39:42.419501 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:39:42.419501 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:39:42.419501 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:39:42.419501 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:39:42.419501 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:39:42.419501 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:39:42.419501 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:39:42.419501 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:39:42.419501 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:39:42.419501 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:39:42.420675 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:39:42.420675 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:39:42.420675 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:39:42.420675 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:39:42.420675 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:39:42.420675 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:39:42.420675 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:39:42.420675 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:39:42.420675 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:39:42.420675 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:39:42.420675 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:39:42.420675 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:39:42.420675 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:39:42.420675 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:39:42.420675 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:39:42.420675 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:39:42.421519 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:39:42.421519 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:39:42.421519 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:39:42.421519 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:39:42.421519 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:39:42.421519 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:39:42.421519 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:39:42.421519 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:39:42.421519 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:39:42.421519 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:39:42.421519 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 17:39:42.421519 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:39:42.421519 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 140/282] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 14 17:39:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:39:42.427634 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c2c2cd-9827-4f7e-996f-b8392557592e None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:42.446945 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65149a3-9ced-4b4a-b872-73b52fc17a86 None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:42.447267 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65149a3-9ced-4b4a-b872-73b52fc17a86 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:42.447545 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65149a3-9ced-4b4a-b872-73b52fc17a86 None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:42.449343 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 141/283] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:39:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 17:39:42.465308 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b552af77-db77-4c50-97ae-a6f124e71c15 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:42.465864 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b552af77-db77-4c50-97ae-a6f124e71c15 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:42.466501 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b552af77-db77-4c50-97ae-a6f124e71c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:42.486865 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-b552af77-db77-4c50-97ae-a6f124e71c15 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:39:42.487865 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-b552af77-db77-4c50-97ae-a6f124e71c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:39:42.568763 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c2c2cd-9827-4f7e-996f-b8392557592e None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:42.573076 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 142/284] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:39:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 17:39:42.604064 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b552af77-db77-4c50-97ae-a6f124e71c15 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:42.612412 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f58af6-3cd5-4a73-928e-b3dca8b60e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:42.613905 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f58af6-3cd5-4a73-928e-b3dca8b60e9e None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:42.614482 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f58af6-3cd5-4a73-928e-b3dca8b60e9e None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:42.615447 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f58af6-3cd5-4a73-928e-b3dca8b60e9e None admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:42.617053 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f58af6-3cd5-4a73-928e-b3dca8b60e9e None admin] RBAC: Adding query filter params (name=reader) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:39:42.617921 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f58af6-3cd5-4a73-928e-b3dca8b60e9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:42.619904 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f58af6-3cd5-4a73-928e-b3dca8b60e9e None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:42.631668 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 143/285] 10.222.0.67 () {56 vars in 1101 bytes} [Thu Jul 14 17:39:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:42.633604 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:42.637446 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f58af6-3cd5-4a73-928e-b3dca8b60e9e None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:42.691982 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:42.725591 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b552af77-db77-4c50-97ae-a6f124e71c15 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:42.767410 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283fa3d5-bf75-4b34-8e14-c5944ac4324d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:42.768465 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283fa3d5-bf75-4b34-8e14-c5944ac4324d None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:42.768900 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283fa3d5-bf75-4b34-8e14-c5944ac4324d None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:42.769347 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283fa3d5-bf75-4b34-8e14-c5944ac4324d None admin] PATH_INFO: `/v3/roles/member` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:42.781923 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283fa3d5-bf75-4b34-8e14-c5944ac4324d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:39:42.790792 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-283fa3d5-bf75-4b34-8e14-c5944ac4324d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 17:39:42.790792 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:39:42.790792 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:39:42.790792 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:39:42.790792 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:39:42.790792 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:39:42.790792 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:39:42.790792 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:39:42.790792 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:39:42.790792 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:39:42.790792 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:39:42.790792 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:39:42.790792 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:39:42.790792 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:39:42.790792 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:39:42.790792 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:39:42.791932 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:39:42.791932 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:39:42.791932 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:39:42.791932 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:39:42.791932 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:39:42.791932 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:39:42.791932 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:39:42.791932 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:39:42.791932 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:39:42.791932 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:39:42.791932 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:39:42.791932 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:39:42.791932 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:39:42.791932 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:39:42.791932 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:39:42.791932 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:39:42.792947 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:39:42.792947 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:39:42.792947 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:39:42.792947 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:39:42.792947 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:39:42.792947 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:39:42.792947 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:39:42.792947 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:39:42.792947 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:39:42.792947 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:39:42.792947 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 17:39:42.792947 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:39:42.795058 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 143/286] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 14 17:39:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 17:39:42.801007 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283fa3d5-bf75-4b34-8e14-c5944ac4324d None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:42.805143 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f58af6-3cd5-4a73-928e-b3dca8b60e9e None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:42.896068 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:42.911312 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc9c9e0-2110-431e-ad9f-ac01df3e5427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:42.912137 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9c9e0-2110-431e-ad9f-ac01df3e5427 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:42.912686 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9c9e0-2110-431e-ad9f-ac01df3e5427 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:42.912686 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9c9e0-2110-431e-ad9f-ac01df3e5427 None admin] PATH_INFO: `/v3/users/176e4aa06b5e4c549375bd1774432a6d` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:42.915905 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283fa3d5-bf75-4b34-8e14-c5944ac4324d None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:42.918380 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc9c9e0-2110-431e-ad9f-ac01df3e5427 None admin] RBAC: Authorizing `identity:get_user(user_id=176e4aa06b5e4c549375bd1774432a6d)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:42.919874 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc9c9e0-2110-431e-ad9f-ac01df3e5427 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:42.921790 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 144/287] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 14 17:39:42 2022] GET /identity/v3/users/176e4aa06b5e4c549375bd1774432a6d => generated 297 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:39:42.927948 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc9c9e0-2110-431e-ad9f-ac01df3e5427 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:42.954947 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5a6401-2a5d-4086-aec7-2f726da206a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:42.955870 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a6401-2a5d-4086-aec7-2f726da206a5 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:42.956302 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a6401-2a5d-4086-aec7-2f726da206a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:42.956725 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a6401-2a5d-4086-aec7-2f726da206a5 None admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:42.957744 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5a6401-2a5d-4086-aec7-2f726da206a5 None admin] RBAC: Adding query filter params (name=member) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:39:42.958764 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5a6401-2a5d-4086-aec7-2f726da206a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:42.960406 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5a6401-2a5d-4086-aec7-2f726da206a5 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:42.970027 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 144/288] 10.222.0.67 () {56 vars in 1101 bytes} [Thu Jul 14 17:39:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:39:42.976339 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5a6401-2a5d-4086-aec7-2f726da206a5 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:43.095502 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5a6401-2a5d-4086-aec7-2f726da206a5 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:43.147628 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b255d3ef-155f-4937-9fb8-1a2640d4a141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:43.149979 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b255d3ef-155f-4937-9fb8-1a2640d4a141 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:43.150426 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b255d3ef-155f-4937-9fb8-1a2640d4a141 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:43.150855 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b255d3ef-155f-4937-9fb8-1a2640d4a141 None admin] PATH_INFO: `/v3/users/110fdac68c844ae3b627674e69504b70` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:43.152452 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b255d3ef-155f-4937-9fb8-1a2640d4a141 None admin] RBAC: Authorizing `identity:get_user(user_id=110fdac68c844ae3b627674e69504b70)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:43.154306 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b255d3ef-155f-4937-9fb8-1a2640d4a141 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:43.157661 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 145/289] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 14 17:39:42 2022] GET /identity/v3/users/110fdac68c844ae3b627674e69504b70 => generated 297 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:39:43.164945 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b255d3ef-155f-4937-9fb8-1a2640d4a141 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:43.181435 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc9c9e0-2110-431e-ad9f-ac01df3e5427 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:43.202926 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:43.221795 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:43.278255 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b551117-e54b-434b-9d10-02d110931c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:43.279139 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b551117-e54b-434b-9d10-02d110931c49 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:43.279420 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b551117-e54b-434b-9d10-02d110931c49 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:43.279692 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b551117-e54b-434b-9d10-02d110931c49 None admin] PATH_INFO: `/v3/projects/67e4c4e8f5f441c5bc8f752c9db84352` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:43.280953 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b551117-e54b-434b-9d10-02d110931c49 None admin] RBAC: Authorizing `identity:get_project(project_id=67e4c4e8f5f441c5bc8f752c9db84352)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:43.282436 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b551117-e54b-434b-9d10-02d110931c49 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:43.284336 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 145/290] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 14 17:39:42 2022] GET /identity/v3/projects/67e4c4e8f5f441c5bc8f752c9db84352 => generated 302 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:43.294496 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b551117-e54b-434b-9d10-02d110931c49 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:43.316601 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b255d3ef-155f-4937-9fb8-1a2640d4a141 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:43.378061 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a420c1ab-e110-4e54-b700-c12ab036baf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:43.378720 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a420c1ab-e110-4e54-b700-c12ab036baf4 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:43.379001 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a420c1ab-e110-4e54-b700-c12ab036baf4 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:43.379277 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a420c1ab-e110-4e54-b700-c12ab036baf4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:43.497963 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a420c1ab-e110-4e54-b700-c12ab036baf4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:43.499457 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a420c1ab-e110-4e54-b700-c12ab036baf4 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:43.501122 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b551117-e54b-434b-9d10-02d110931c49 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:43.516453 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:43.565694 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9996438-098b-4ea6-8003-c13c4a74ba29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:43.566634 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9996438-098b-4ea6-8003-c13c4a74ba29 None admin] REQUEST_METHOD: `PUT` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:43.566917 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9996438-098b-4ea6-8003-c13c4a74ba29 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:43.567190 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9996438-098b-4ea6-8003-c13c4a74ba29 None admin] PATH_INFO: `/v3/projects/67e4c4e8f5f441c5bc8f752c9db84352/users/176e4aa06b5e4c549375bd1774432a6d/roles/7e81381d29ef4d8c89fe53e977678bf6` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:43.573851 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9996438-098b-4ea6-8003-c13c4a74ba29 None admin] RBAC: Authorizing `identity:create_grant(project_id=67e4c4e8f5f441c5bc8f752c9db84352, user_id=176e4aa06b5e4c549375bd1774432a6d, role_id=7e81381d29ef4d8c89fe53e977678bf6)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:43.575396 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9996438-098b-4ea6-8003-c13c4a74ba29 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:43.601019 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 146/291] 10.222.0.67 () {58 vars in 1439 bytes} [Thu Jul 14 17:39:43 2022] PUT /identity/v3/projects/67e4c4e8f5f441c5bc8f752c9db84352/users/176e4aa06b5e4c549375bd1774432a6d/roles/7e81381d29ef4d8c89fe53e977678bf6 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:39:43.660723 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 146/292] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 14 17:39:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 17:39:43.666209 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9996438-098b-4ea6-8003-c13c4a74ba29 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:43.732063 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:43.798383 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9996438-098b-4ea6-8003-c13c4a74ba29 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:43.838783 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c85d4c-e3a9-49b4-a3d6-b7c781a3ed9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:43.840045 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c85d4c-e3a9-49b4-a3d6-b7c781a3ed9a None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:43.840525 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c85d4c-e3a9-49b4-a3d6-b7c781a3ed9a None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:43.840992 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c85d4c-e3a9-49b4-a3d6-b7c781a3ed9a None admin] PATH_INFO: `/v3/projects/67e4c4e8f5f441c5bc8f752c9db84352` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:43.842495 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c85d4c-e3a9-49b4-a3d6-b7c781a3ed9a None admin] RBAC: Authorizing `identity:get_project(project_id=67e4c4e8f5f441c5bc8f752c9db84352)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:43.844324 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c85d4c-e3a9-49b4-a3d6-b7c781a3ed9a None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:43.846889 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 147/293] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 14 17:39:43 2022] GET /identity/v3/projects/67e4c4e8f5f441c5bc8f752c9db84352 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:43.853095 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a420c1ab-e110-4e54-b700-c12ab036baf4 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:43.968193 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a420c1ab-e110-4e54-b700-c12ab036baf4 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:43.984177 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:44.012383 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec11c89-389b-41e5-906b-f91ad783cb56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:44.013189 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec11c89-389b-41e5-906b-f91ad783cb56 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:44.013470 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec11c89-389b-41e5-906b-f91ad783cb56 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:44.013776 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec11c89-389b-41e5-906b-f91ad783cb56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:44.014621 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec11c89-389b-41e5-906b-f91ad783cb56 None admin] RBAC: Adding query filter params (role.id=95d753870f97426cb1ce32e078621a4c, scope.project.id=67e4c4e8f5f441c5bc8f752c9db84352, user.id=110fdac68c844ae3b627674e69504b70) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:39:44.014929 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec11c89-389b-41e5-906b-f91ad783cb56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:44.016415 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec11c89-389b-41e5-906b-f91ad783cb56 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:44.026087 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 147/294] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 14 17:39:43 2022] GET /identity/v3/role_assignments?user.id=110fdac68c844ae3b627674e69504b70&scope.project.id=67e4c4e8f5f441c5bc8f752c9db84352&role.id=95d753870f97426cb1ce32e078621a4c => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:44.585632 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b690969-0f9f-4957-ba7e-89fa79d3b300 None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:44.586609 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b690969-0f9f-4957-ba7e-89fa79d3b300 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:44.587088 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b690969-0f9f-4957-ba7e-89fa79d3b300 None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:44.588669 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 148/295] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:39:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:39:44.594305 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1cc350-5e6b-4ed5-83da-7f51dfb07af9 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:44.594590 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1cc350-5e6b-4ed5-83da-7f51dfb07af9 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:44.594890 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1cc350-5e6b-4ed5-83da-7f51dfb07af9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:44.612635 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e130e9-b2c4-4597-982a-402f63d945b7 None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:44.612635 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e130e9-b2c4-4597-982a-402f63d945b7 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:44.612635 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e130e9-b2c4-4597-982a-402f63d945b7 None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:44.612635 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 149/296] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:39:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:39:44.619907 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4962e235-6f99-4887-94a9-e07082dede28 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:44.620105 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-6d1cc350-5e6b-4ed5-83da-7f51dfb07af9 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:39:44.620519 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4962e235-6f99-4887-94a9-e07082dede28 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:44.620942 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4962e235-6f99-4887-94a9-e07082dede28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:44.621175 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-6d1cc350-5e6b-4ed5-83da-7f51dfb07af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:39:44.645859 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-4962e235-6f99-4887-94a9-e07082dede28 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:39:44.647509 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-4962e235-6f99-4887-94a9-e07082dede28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:39:44.718384 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 148/297] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:39:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:39:44.727601 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 150/298] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:39:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:39:44.742691 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1cc350-5e6b-4ed5-83da-7f51dfb07af9 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:44.751329 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4962e235-6f99-4887-94a9-e07082dede28 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:44.806856 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:44.850005 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1cc350-5e6b-4ed5-83da-7f51dfb07af9 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:44.859960 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:44.872629 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4962e235-6f99-4887-94a9-e07082dede28 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:44.894334 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268aaf3b-e910-4aa7-a668-c93ec8b64e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:44.896270 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268aaf3b-e910-4aa7-a668-c93ec8b64e03 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:44.896658 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268aaf3b-e910-4aa7-a668-c93ec8b64e03 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:44.897036 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268aaf3b-e910-4aa7-a668-c93ec8b64e03 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:44.912644 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268aaf3b-e910-4aa7-a668-c93ec8b64e03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:39:44.915939 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5085b2cd-fd10-4632-b699-2af0bfad13af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:44.916918 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5085b2cd-fd10-4632-b699-2af0bfad13af None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:44.917337 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5085b2cd-fd10-4632-b699-2af0bfad13af None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:44.917791 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5085b2cd-fd10-4632-b699-2af0bfad13af None admin] PATH_INFO: `/v3/roles/member` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:44.922034 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-268aaf3b-e910-4aa7-a668-c93ec8b64e03 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 17:39:44.922034 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:39:44.922034 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:39:44.922034 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:39:44.922034 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:39:44.922034 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:39:44.922034 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:39:44.922034 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:39:44.922034 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:39:44.922034 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:39:44.922034 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:39:44.922034 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:39:44.922034 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:39:44.922034 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:39:44.922034 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:39:44.922034 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:39:44.922992 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:39:44.922992 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:39:44.922992 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:39:44.922992 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:39:44.922992 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:39:44.922992 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:39:44.922992 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:39:44.922992 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:39:44.922992 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:39:44.922992 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:39:44.922992 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:39:44.922992 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:39:44.922992 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:39:44.922992 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:39:44.922992 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:39:44.922992 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:39:44.923796 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:39:44.923796 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:39:44.923796 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:39:44.923796 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:39:44.923796 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:39:44.923796 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:39:44.923796 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:39:44.923796 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:39:44.923796 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:39:44.923796 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:39:44.923796 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 17:39:44.923796 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:39:44.923796 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 149/299] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 14 17:39:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:39:44.930628 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268aaf3b-e910-4aa7-a668-c93ec8b64e03 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:44.937173 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5085b2cd-fd10-4632-b699-2af0bfad13af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:39:44.947303 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-5085b2cd-fd10-4632-b699-2af0bfad13af None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 17:39:44.947303 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:39:44.947303 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:39:44.947303 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:39:44.947303 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:39:44.947303 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:39:44.947303 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:39:44.947303 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:39:44.947303 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:39:44.947303 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:39:44.947303 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:39:44.947303 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:39:44.947303 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:39:44.947303 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:39:44.947303 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:39:44.947303 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:39:44.948237 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:39:44.948237 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:39:44.948237 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:39:44.948237 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:39:44.948237 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:39:44.948237 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:39:44.948237 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:39:44.948237 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:39:44.948237 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:39:44.948237 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:39:44.948237 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:39:44.948237 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:39:44.948237 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:39:44.948237 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:39:44.948237 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:39:44.948237 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:39:44.949029 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:39:44.949029 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:39:44.949029 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:39:44.949029 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:39:44.949029 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:39:44.949029 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:39:44.949029 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:39:44.949029 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:39:44.949029 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:39:44.949029 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:39:44.949029 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 17:39:44.949029 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:39:44.951077 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 151/300] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 14 17:39:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 17:39:44.957385 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5085b2cd-fd10-4632-b699-2af0bfad13af None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:45.059352 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268aaf3b-e910-4aa7-a668-c93ec8b64e03 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:45.074443 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5085b2cd-fd10-4632-b699-2af0bfad13af None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:45.077633 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:45.098425 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9b7d66-2fbb-4117-b844-b19625b8985c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:45.099137 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b7d66-2fbb-4117-b844-b19625b8985c None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:45.099431 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b7d66-2fbb-4117-b844-b19625b8985c None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:45.099703 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b7d66-2fbb-4117-b844-b19625b8985c None admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:45.100465 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9b7d66-2fbb-4117-b844-b19625b8985c None admin] RBAC: Adding query filter params (name=reader) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:39:45.100774 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9b7d66-2fbb-4117-b844-b19625b8985c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:45.102193 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9b7d66-2fbb-4117-b844-b19625b8985c None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:45.111201 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47de3b1-9ec5-4711-be2d-ad9910079dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:45.117469 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47de3b1-9ec5-4711-be2d-ad9910079dc5 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:45.117628 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 150/301] 10.222.0.67 () {56 vars in 1101 bytes} [Thu Jul 14 17:39:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:45.117709 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47de3b1-9ec5-4711-be2d-ad9910079dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:45.117709 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47de3b1-9ec5-4711-be2d-ad9910079dc5 None admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:45.117861 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e416bf8-3fa9-4da1-a86c-7311f33e0345 None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:45.117930 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47de3b1-9ec5-4711-be2d-ad9910079dc5 None admin] RBAC: Adding query filter params (name=member) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:39:45.118006 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e416bf8-3fa9-4da1-a86c-7311f33e0345 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:45.118075 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47de3b1-9ec5-4711-be2d-ad9910079dc5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:45.118151 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e416bf8-3fa9-4da1-a86c-7311f33e0345 None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:45.118219 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47de3b1-9ec5-4711-be2d-ad9910079dc5 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:45.119902 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 151/302] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:39:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:39:45.120672 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e416bf8-3fa9-4da1-a86c-7311f33e0345 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:45.126889 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 152/303] 10.222.0.67 () {56 vars in 1101 bytes} [Thu Jul 14 17:39:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:39:45.131397 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dc5e16-1a22-4814-8097-6a5fec488dce None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:45.131397 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dc5e16-1a22-4814-8097-6a5fec488dce None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:45.131397 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dc5e16-1a22-4814-8097-6a5fec488dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:45.145751 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-44dc5e16-1a22-4814-8097-6a5fec488dce None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:39:45.146966 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-44dc5e16-1a22-4814-8097-6a5fec488dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:39:45.155396 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:45.224784 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 153/304] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:39:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:39:45.234518 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dc5e16-1a22-4814-8097-6a5fec488dce None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:45.237751 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e416bf8-3fa9-4da1-a86c-7311f33e0345 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:45.276484 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8835693-adae-4802-be74-e9c6ff4de8fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:45.277371 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8835693-adae-4802-be74-e9c6ff4de8fb None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:45.277688 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8835693-adae-4802-be74-e9c6ff4de8fb None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:45.277963 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8835693-adae-4802-be74-e9c6ff4de8fb None admin] PATH_INFO: `/v3/users/826013e3a6684cc3b04c02860aa0caff` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:45.293848 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8835693-adae-4802-be74-e9c6ff4de8fb None admin] RBAC: Authorizing `identity:get_user(user_id=826013e3a6684cc3b04c02860aa0caff)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:45.296554 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8835693-adae-4802-be74-e9c6ff4de8fb None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:45.304860 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 152/305] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 14 17:39:45 2022] GET /identity/v3/users/826013e3a6684cc3b04c02860aa0caff => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:45.304860 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8835693-adae-4802-be74-e9c6ff4de8fb None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:45.374176 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:45.382266 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dc5e16-1a22-4814-8097-6a5fec488dce None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:45.412694 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:45.417252 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4ddccd-5c8c-45de-bdf5-679864ca4ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:45.418179 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ddccd-5c8c-45de-bdf5-679864ca4ea5 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:45.418485 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ddccd-5c8c-45de-bdf5-679864ca4ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:45.418731 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ddccd-5c8c-45de-bdf5-679864ca4ea5 None admin] PATH_INFO: `/v3/users/837f29b39e8945f9abe74bf343a8d80a` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:45.419927 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4ddccd-5c8c-45de-bdf5-679864ca4ea5 None admin] RBAC: Authorizing `identity:get_user(user_id=837f29b39e8945f9abe74bf343a8d80a)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:45.421391 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4ddccd-5c8c-45de-bdf5-679864ca4ea5 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:45.423138 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 154/306] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 14 17:39:45 2022] GET /identity/v3/users/837f29b39e8945f9abe74bf343a8d80a => generated 293 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:45.427531 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8835693-adae-4802-be74-e9c6ff4de8fb None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:45.429316 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4ddccd-5c8c-45de-bdf5-679864ca4ea5 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:45.472589 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158077e4-cfd5-4efd-af8b-938f9cf3dcf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:45.474261 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158077e4-cfd5-4efd-af8b-938f9cf3dcf2 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:45.474742 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158077e4-cfd5-4efd-af8b-938f9cf3dcf2 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:45.475185 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158077e4-cfd5-4efd-af8b-938f9cf3dcf2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:45.477093 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158077e4-cfd5-4efd-af8b-938f9cf3dcf2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:45.478795 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158077e4-cfd5-4efd-af8b-938f9cf3dcf2 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:45.480589 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 153/307] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:39:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:45.481542 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158077e4-cfd5-4efd-af8b-938f9cf3dcf2 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:45.565891 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4ddccd-5c8c-45de-bdf5-679864ca4ea5 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:45.588132 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158077e4-cfd5-4efd-af8b-938f9cf3dcf2 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:45.604812 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b4ebec-0326-4b8d-8065-63b9ed0a3f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:45.605644 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b4ebec-0326-4b8d-8065-63b9ed0a3f7f None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:45.605901 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b4ebec-0326-4b8d-8065-63b9ed0a3f7f None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:45.606173 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b4ebec-0326-4b8d-8065-63b9ed0a3f7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:45.607128 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b4ebec-0326-4b8d-8065-63b9ed0a3f7f None admin] RBAC: Adding query filter params (role.id=7e81381d29ef4d8c89fe53e977678bf6, user.id=826013e3a6684cc3b04c02860aa0caff, scope.system=all) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:39:45.607439 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b4ebec-0326-4b8d-8065-63b9ed0a3f7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:45.608896 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b4ebec-0326-4b8d-8065-63b9ed0a3f7f None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:45.625665 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 155/308] 10.222.0.67 () {56 vars in 1308 bytes} [Thu Jul 14 17:39:45 2022] GET /identity/v3/role_assignments?user.id=826013e3a6684cc3b04c02860aa0caff&scope.system=all&role.id=7e81381d29ef4d8c89fe53e977678bf6 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:45.625665 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b4ebec-0326-4b8d-8065-63b9ed0a3f7f None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:45.638107 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71fb48b-7ef8-45b7-a705-0337854b6d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:45.639124 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71fb48b-7ef8-45b7-a705-0337854b6d11 None admin] REQUEST_METHOD: `PUT` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:45.639473 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71fb48b-7ef8-45b7-a705-0337854b6d11 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:45.639825 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71fb48b-7ef8-45b7-a705-0337854b6d11 None admin] PATH_INFO: `/v3/system/users/837f29b39e8945f9abe74bf343a8d80a/roles/95d753870f97426cb1ce32e078621a4c` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:45.641501 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71fb48b-7ef8-45b7-a705-0337854b6d11 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=837f29b39e8945f9abe74bf343a8d80a, role_id=95d753870f97426cb1ce32e078621a4c)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:45.643050 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71fb48b-7ef8-45b7-a705-0337854b6d11 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:45.657743 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 154/309] 10.222.0.67 () {58 vars in 1334 bytes} [Thu Jul 14 17:39:45 2022] PUT /identity/v3/system/users/837f29b39e8945f9abe74bf343a8d80a/roles/95d753870f97426cb1ce32e078621a4c => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:39:45.667095 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:45.769951 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b4ebec-0326-4b8d-8065-63b9ed0a3f7f None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:45.814575 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea57f4d4-6fd3-4c47-a50f-3bd189d122f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:45.815534 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea57f4d4-6fd3-4c47-a50f-3bd189d122f1 None admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:45.815976 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea57f4d4-6fd3-4c47-a50f-3bd189d122f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:45.816409 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea57f4d4-6fd3-4c47-a50f-3bd189d122f1 None admin] PATH_INFO: `/v3/groups` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:45.817271 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea57f4d4-6fd3-4c47-a50f-3bd189d122f1 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:45.819524 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea57f4d4-6fd3-4c47-a50f-3bd189d122f1 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:45.836657 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 156/310] 10.222.0.67 () {60 vars in 1134 bytes} [Thu Jul 14 17:39:45 2022] POST /identity/v3/groups => generated 229 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:39:45.961092 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a9bc24-441a-4490-ae95-7c4ea8233228 None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:45.961624 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a9bc24-441a-4490-ae95-7c4ea8233228 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:45.961624 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a9bc24-441a-4490-ae95-7c4ea8233228 None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:45.963308 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 155/311] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:39:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:39:45.969324 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1306c684-55a9-466e-b666-4ad8a54c7b5f None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:45.970047 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1306c684-55a9-466e-b666-4ad8a54c7b5f None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:45.970047 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1306c684-55a9-466e-b666-4ad8a54c7b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:45.989178 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-1306c684-55a9-466e-b666-4ad8a54c7b5f None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:39:45.991184 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-1306c684-55a9-466e-b666-4ad8a54c7b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:39:46.078092 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 157/312] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:39:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:39:46.101085 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a9bc24-441a-4490-ae95-7c4ea8233228 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:46.124618 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:46.220106 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a9bc24-441a-4490-ae95-7c4ea8233228 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:46.256592 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f848d3a-585b-48f0-a852-381328e66135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:46.257405 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f848d3a-585b-48f0-a852-381328e66135 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:46.257717 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f848d3a-585b-48f0-a852-381328e66135 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:46.257991 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f848d3a-585b-48f0-a852-381328e66135 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:46.270772 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f848d3a-585b-48f0-a852-381328e66135 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:39:46.280662 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-9f848d3a-585b-48f0-a852-381328e66135 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 17:39:46.280662 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:39:46.280662 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:39:46.280662 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:39:46.280662 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:39:46.280662 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:39:46.280662 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:39:46.280662 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:39:46.280662 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:39:46.280662 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:39:46.280662 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:39:46.280662 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:39:46.280662 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:39:46.280662 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:39:46.280662 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:39:46.280662 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:39:46.281586 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:39:46.281586 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:39:46.281586 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:39:46.281586 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:39:46.281586 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:39:46.281586 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:39:46.281586 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:39:46.281586 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:39:46.281586 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:39:46.281586 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:39:46.281586 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:39:46.281586 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:39:46.281586 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:39:46.281586 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:39:46.281586 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:39:46.281586 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:39:46.282439 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:39:46.282439 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:39:46.282439 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:39:46.282439 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:39:46.282439 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:39:46.282439 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:39:46.282439 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:39:46.282439 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:39:46.282439 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:39:46.282439 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:39:46.282439 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 17:39:46.282439 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:39:46.282439 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 156/313] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 14 17:39:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:39:46.288883 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1306c684-55a9-466e-b666-4ad8a54c7b5f None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:46.309850 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:46.404765 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1306c684-55a9-466e-b666-4ad8a54c7b5f None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:46.450071 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5460f4c-111b-4911-b6d7-929aff569942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:46.450761 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5460f4c-111b-4911-b6d7-929aff569942 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:46.451087 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5460f4c-111b-4911-b6d7-929aff569942 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:46.451536 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5460f4c-111b-4911-b6d7-929aff569942 None admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:46.452905 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5460f4c-111b-4911-b6d7-929aff569942 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:39:46.453772 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5460f4c-111b-4911-b6d7-929aff569942 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:46.455262 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5460f4c-111b-4911-b6d7-929aff569942 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:46.468170 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 158/314] 10.222.0.67 () {56 vars in 1101 bytes} [Thu Jul 14 17:39:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:46.475454 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f848d3a-585b-48f0-a852-381328e66135 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:46.597760 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:46.620656 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f848d3a-585b-48f0-a852-381328e66135 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:46.658102 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c79ed7e-9975-4679-8159-5fdfe32fbd45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:46.659000 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c79ed7e-9975-4679-8159-5fdfe32fbd45 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:46.659280 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c79ed7e-9975-4679-8159-5fdfe32fbd45 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:46.659553 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c79ed7e-9975-4679-8159-5fdfe32fbd45 None admin] PATH_INFO: `/v3/users/176e4aa06b5e4c549375bd1774432a6d` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:46.660821 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c79ed7e-9975-4679-8159-5fdfe32fbd45 None admin] RBAC: Authorizing `identity:get_user(user_id=176e4aa06b5e4c549375bd1774432a6d)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:46.662921 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c79ed7e-9975-4679-8159-5fdfe32fbd45 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:46.664990 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 157/315] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 14 17:39:46 2022] GET /identity/v3/users/176e4aa06b5e4c549375bd1774432a6d => generated 297 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:46.670274 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5460f4c-111b-4911-b6d7-929aff569942 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:46.760711 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:46.780235 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5460f4c-111b-4911-b6d7-929aff569942 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:46.815710 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45fd9ba-ebd5-43be-b8a7-2a102c4fe098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:46.816431 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45fd9ba-ebd5-43be-b8a7-2a102c4fe098 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:46.816713 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45fd9ba-ebd5-43be-b8a7-2a102c4fe098 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:46.816989 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45fd9ba-ebd5-43be-b8a7-2a102c4fe098 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:46.890706 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45fd9ba-ebd5-43be-b8a7-2a102c4fe098 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:46.892224 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45fd9ba-ebd5-43be-b8a7-2a102c4fe098 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:46.982595 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:47.003313 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 159/316] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 14 17:39:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 17:39:47.008932 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c79ed7e-9975-4679-8159-5fdfe32fbd45 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:47.120389 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c79ed7e-9975-4679-8159-5fdfe32fbd45 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:47.154488 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d4e100-fa34-49a8-9a16-01eadda642d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:47.155351 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d4e100-fa34-49a8-9a16-01eadda642d6 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:47.155633 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d4e100-fa34-49a8-9a16-01eadda642d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:47.155908 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d4e100-fa34-49a8-9a16-01eadda642d6 None admin] PATH_INFO: `/v3/projects/67e4c4e8f5f441c5bc8f752c9db84352` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:47.157085 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d4e100-fa34-49a8-9a16-01eadda642d6 None admin] RBAC: Authorizing `identity:get_project(project_id=67e4c4e8f5f441c5bc8f752c9db84352)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:47.158552 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d4e100-fa34-49a8-9a16-01eadda642d6 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:47.160556 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 158/317] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 14 17:39:47 2022] GET /identity/v3/projects/67e4c4e8f5f441c5bc8f752c9db84352 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:47.166218 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45fd9ba-ebd5-43be-b8a7-2a102c4fe098 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:47.268632 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45fd9ba-ebd5-43be-b8a7-2a102c4fe098 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:47.304089 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b513100e-9a02-4e4a-b19b-458e6c5b22ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:47.305154 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b513100e-9a02-4e4a-b19b-458e6c5b22ae None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:47.305686 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b513100e-9a02-4e4a-b19b-458e6c5b22ae None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:47.306163 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b513100e-9a02-4e4a-b19b-458e6c5b22ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:47.307281 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b513100e-9a02-4e4a-b19b-458e6c5b22ae None admin] RBAC: Adding query filter params (role.id=7e81381d29ef4d8c89fe53e977678bf6, scope.project.id=67e4c4e8f5f441c5bc8f752c9db84352, user.id=176e4aa06b5e4c549375bd1774432a6d) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:39:47.307849 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b513100e-9a02-4e4a-b19b-458e6c5b22ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:47.309503 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b513100e-9a02-4e4a-b19b-458e6c5b22ae None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:47.316324 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 160/318] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 14 17:39:47 2022] GET /identity/v3/role_assignments?user.id=176e4aa06b5e4c549375bd1774432a6d&scope.project.id=67e4c4e8f5f441c5bc8f752c9db84352&role.id=7e81381d29ef4d8c89fe53e977678bf6 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:47.841761 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c0af38-ab49-4eef-9201-094c4c6d8396 None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:47.842085 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c0af38-ab49-4eef-9201-094c4c6d8396 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:47.842259 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c0af38-ab49-4eef-9201-094c4c6d8396 None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:47.843758 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 159/319] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:39:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:39:47.848931 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035345ea-2328-4e95-9287-9ad8d811676b None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:47.849393 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035345ea-2328-4e95-9287-9ad8d811676b None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:47.849495 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035345ea-2328-4e95-9287-9ad8d811676b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:47.868061 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-035345ea-2328-4e95-9287-9ad8d811676b None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:39:47.869470 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-035345ea-2328-4e95-9287-9ad8d811676b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:39:47.901724 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab562b1f-3522-4081-9a01-835ee8430924 None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:47.902069 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab562b1f-3522-4081-9a01-835ee8430924 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:47.902527 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab562b1f-3522-4081-9a01-835ee8430924 None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:47.903889 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 160/320] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:39:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 17:39:47.908873 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a0815-2208-4e2e-8743-9cbeb8a63513 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:47.909160 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a0815-2208-4e2e-8743-9cbeb8a63513 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:47.909432 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a0815-2208-4e2e-8743-9cbeb8a63513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:47.912204 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:47.928395 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-df1a0815-2208-4e2e-8743-9cbeb8a63513 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:39:47.929797 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-df1a0815-2208-4e2e-8743-9cbeb8a63513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:39:47.941595 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 161/321] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:39:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:39:47.942075 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:47.964216 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035345ea-2328-4e95-9287-9ad8d811676b None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:48.001496 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 161/322] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:39:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 17:39:48.007773 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f47109-78ec-47da-b535-dfd3762df9fe None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:48.008369 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f47109-78ec-47da-b535-dfd3762df9fe None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:48.008652 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f47109-78ec-47da-b535-dfd3762df9fe None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:48.010169 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 162/323] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:39:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 17:39:48.015132 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30603ef-d259-4a34-9c92-78df957db188 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:48.015420 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30603ef-d259-4a34-9c92-78df957db188 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:48.015698 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30603ef-d259-4a34-9c92-78df957db188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:48.031828 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-c30603ef-d259-4a34-9c92-78df957db188 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:39:48.032995 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-c30603ef-d259-4a34-9c92-78df957db188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:39:48.066256 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035345ea-2328-4e95-9287-9ad8d811676b None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:48.098234 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 163/324] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:39:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 17:39:48.099028 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30603ef-d259-4a34-9c92-78df957db188 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:48.103751 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3339962-9121-4dcf-b32c-454a2a4a37cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:48.104619 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3339962-9121-4dcf-b32c-454a2a4a37cc None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:48.104892 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3339962-9121-4dcf-b32c-454a2a4a37cc None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:48.105160 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3339962-9121-4dcf-b32c-454a2a4a37cc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:48.120661 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3339962-9121-4dcf-b32c-454a2a4a37cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:39:48.128538 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-d3339962-9121-4dcf-b32c-454a2a4a37cc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 17:39:48.128538 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:39:48.128538 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:39:48.128538 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:39:48.128538 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:39:48.128538 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:39:48.128538 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:39:48.128538 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:39:48.128538 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:39:48.128538 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:39:48.128538 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:39:48.128538 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:39:48.128538 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:39:48.128538 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:39:48.128538 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:39:48.128538 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:39:48.129424 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:39:48.129424 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:39:48.129424 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:39:48.129424 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:39:48.129424 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:39:48.129424 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:39:48.129424 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:39:48.129424 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:39:48.129424 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:39:48.129424 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:39:48.129424 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:39:48.129424 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:39:48.129424 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:39:48.129424 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:39:48.129424 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:39:48.129424 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:39:48.135956 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:39:48.135956 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:39:48.135956 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:39:48.135956 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:39:48.135956 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:39:48.135956 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:39:48.135956 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:39:48.135956 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:39:48.135956 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:39:48.135956 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:39:48.135956 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 17:39:48.135956 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:39:48.135956 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 162/325] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 14 17:39:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 17:39:48.135956 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3339962-9121-4dcf-b32c-454a2a4a37cc None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:48.166627 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:48.177586 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:48.201359 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30603ef-d259-4a34-9c92-78df957db188 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:48.232314 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3339962-9121-4dcf-b32c-454a2a4a37cc None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:48.234335 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5634ec7a-de15-4515-aab8-32d404f44c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:48.235137 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5634ec7a-de15-4515-aab8-32d404f44c96 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:48.235414 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5634ec7a-de15-4515-aab8-32d404f44c96 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:48.235686 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5634ec7a-de15-4515-aab8-32d404f44c96 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:48.246682 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5634ec7a-de15-4515-aab8-32d404f44c96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:39:48.254542 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-5634ec7a-de15-4515-aab8-32d404f44c96 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 17:39:48.254542 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:39:48.254542 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:39:48.254542 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:39:48.254542 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:39:48.254542 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:39:48.254542 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:39:48.254542 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:39:48.254542 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:39:48.254542 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:39:48.254542 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:39:48.254542 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:39:48.254542 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:39:48.254542 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:39:48.254542 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:39:48.254542 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:39:48.255485 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:39:48.255485 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:39:48.255485 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:39:48.255485 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:39:48.255485 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:39:48.255485 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:39:48.255485 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:39:48.255485 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:39:48.255485 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:39:48.255485 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:39:48.255485 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:39:48.255485 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:39:48.255485 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:39:48.255485 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:39:48.255485 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:39:48.255485 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:39:48.256610 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:39:48.256610 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:39:48.256610 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:39:48.256610 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:39:48.256610 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:39:48.256610 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:39:48.256610 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:39:48.256610 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:39:48.256610 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:39:48.256610 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:39:48.256610 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 17:39:48.256610 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:39:48.256610 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 164/326] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 14 17:39:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:39:48.256610 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5634ec7a-de15-4515-aab8-32d404f44c96 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:48.272409 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a1e269-dc55-45b6-b779-9fdcd8a4cc26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:48.273201 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a1e269-dc55-45b6-b779-9fdcd8a4cc26 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:48.273477 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a1e269-dc55-45b6-b779-9fdcd8a4cc26 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:48.273779 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a1e269-dc55-45b6-b779-9fdcd8a4cc26 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:48.274972 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a1e269-dc55-45b6-b779-9fdcd8a4cc26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:48.276422 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a1e269-dc55-45b6-b779-9fdcd8a4cc26 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:48.278052 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 163/327] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:39:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:48.278802 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a1e269-dc55-45b6-b779-9fdcd8a4cc26 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:48.355169 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5634ec7a-de15-4515-aab8-32d404f44c96 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:48.377489 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a1e269-dc55-45b6-b779-9fdcd8a4cc26 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:48.379110 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:48.390134 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b661e7e-393f-463a-8383-d3dc8a204250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:48.390808 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b661e7e-393f-463a-8383-d3dc8a204250 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:48.391093 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b661e7e-393f-463a-8383-d3dc8a204250 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:48.391486 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b661e7e-393f-463a-8383-d3dc8a204250 None admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:48.392251 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b661e7e-393f-463a-8383-d3dc8a204250 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:39:48.392558 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b661e7e-393f-463a-8383-d3dc8a204250 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:48.393976 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b661e7e-393f-463a-8383-d3dc8a204250 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:48.396923 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:48.404225 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 165/328] 10.222.0.67 () {56 vars in 1101 bytes} [Thu Jul 14 17:39:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:48.404842 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b661e7e-393f-463a-8383-d3dc8a204250 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:48.413090 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe09886-edd7-457a-83b8-48484876cd06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:48.413791 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe09886-edd7-457a-83b8-48484876cd06 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:48.414073 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe09886-edd7-457a-83b8-48484876cd06 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:48.414345 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe09886-edd7-457a-83b8-48484876cd06 None admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:48.415090 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe09886-edd7-457a-83b8-48484876cd06 None admin] RBAC: Adding query filter params (name=member) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:39:48.415391 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe09886-edd7-457a-83b8-48484876cd06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:48.416742 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe09886-edd7-457a-83b8-48484876cd06 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:48.424778 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 164/329] 10.222.0.67 () {56 vars in 1101 bytes} [Thu Jul 14 17:39:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:48.425582 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe09886-edd7-457a-83b8-48484876cd06 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:48.506188 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b661e7e-393f-463a-8383-d3dc8a204250 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:48.531272 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe09886-edd7-457a-83b8-48484876cd06 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:48.539359 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e3384b-456b-4f1d-8470-9d9b69ed4268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:48.540029 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e3384b-456b-4f1d-8470-9d9b69ed4268 None admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:48.540311 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e3384b-456b-4f1d-8470-9d9b69ed4268 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:48.540582 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e3384b-456b-4f1d-8470-9d9b69ed4268 None admin] PATH_INFO: `/v3/groups` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:48.541262 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e3384b-456b-4f1d-8470-9d9b69ed4268 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:48.542796 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e3384b-456b-4f1d-8470-9d9b69ed4268 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:48.561809 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 166/330] 10.222.0.67 () {60 vars in 1134 bytes} [Thu Jul 14 17:39:48 2022] POST /identity/v3/groups => generated 226 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:39:48.561809 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e3384b-456b-4f1d-8470-9d9b69ed4268 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:48.570844 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74049d61-0970-4375-af2d-fefa8646c061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:48.572038 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74049d61-0970-4375-af2d-fefa8646c061 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:48.572314 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74049d61-0970-4375-af2d-fefa8646c061 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:48.572582 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74049d61-0970-4375-af2d-fefa8646c061 None admin] PATH_INFO: `/v3/users/826013e3a6684cc3b04c02860aa0caff` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:48.573944 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74049d61-0970-4375-af2d-fefa8646c061 None admin] RBAC: Authorizing `identity:get_user(user_id=826013e3a6684cc3b04c02860aa0caff)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:48.575447 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74049d61-0970-4375-af2d-fefa8646c061 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:48.577348 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 165/331] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 14 17:39:48 2022] GET /identity/v3/users/826013e3a6684cc3b04c02860aa0caff => generated 293 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:48.583257 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74049d61-0970-4375-af2d-fefa8646c061 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:48.622607 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:48.649463 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:48.702842 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e3384b-456b-4f1d-8470-9d9b69ed4268 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:48.709124 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74049d61-0970-4375-af2d-fefa8646c061 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:48.747420 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef880ed0-d029-49d1-8af1-d85c8c7cd14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:48.748450 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef880ed0-d029-49d1-8af1-d85c8c7cd14b None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:48.748740 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef880ed0-d029-49d1-8af1-d85c8c7cd14b None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:48.749045 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef880ed0-d029-49d1-8af1-d85c8c7cd14b None admin] PATH_INFO: `/v3/users/837f29b39e8945f9abe74bf343a8d80a` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:48.750354 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef880ed0-d029-49d1-8af1-d85c8c7cd14b None admin] RBAC: Authorizing `identity:get_user(user_id=837f29b39e8945f9abe74bf343a8d80a)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:48.752310 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef880ed0-d029-49d1-8af1-d85c8c7cd14b None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:48.753478 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 167/332] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 14 17:39:48 2022] GET /identity/v3/users/837f29b39e8945f9abe74bf343a8d80a => generated 293 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:48.755044 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b4856a-47f1-4018-b349-87e8dcbc8a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:48.756546 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b4856a-47f1-4018-b349-87e8dcbc8a78 None admin] REQUEST_METHOD: `PUT` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:48.756901 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b4856a-47f1-4018-b349-87e8dcbc8a78 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:48.757245 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b4856a-47f1-4018-b349-87e8dcbc8a78 None admin] PATH_INFO: `/v3/system/users/826013e3a6684cc3b04c02860aa0caff/roles/7e81381d29ef4d8c89fe53e977678bf6` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:48.759032 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b4856a-47f1-4018-b349-87e8dcbc8a78 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=826013e3a6684cc3b04c02860aa0caff, role_id=7e81381d29ef4d8c89fe53e977678bf6)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:48.760059 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef880ed0-d029-49d1-8af1-d85c8c7cd14b None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:48.761581 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b4856a-47f1-4018-b349-87e8dcbc8a78 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:48.773412 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 166/333] 10.222.0.67 () {58 vars in 1334 bytes} [Thu Jul 14 17:39:48 2022] PUT /identity/v3/system/users/826013e3a6684cc3b04c02860aa0caff/roles/7e81381d29ef4d8c89fe53e977678bf6 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 17:39:48.889479 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef880ed0-d029-49d1-8af1-d85c8c7cd14b None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:48.920011 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:48.931633 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819e32e1-abaf-47ad-92d5-c9eb96685e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:48.932312 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e32e1-abaf-47ad-92d5-c9eb96685e64 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:48.932596 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e32e1-abaf-47ad-92d5-c9eb96685e64 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:48.932873 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e32e1-abaf-47ad-92d5-c9eb96685e64 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:48.933855 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819e32e1-abaf-47ad-92d5-c9eb96685e64 None admin] RBAC: Adding query filter params (role.id=95d753870f97426cb1ce32e078621a4c, user.id=837f29b39e8945f9abe74bf343a8d80a, scope.system=all) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:39:48.934171 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819e32e1-abaf-47ad-92d5-c9eb96685e64 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:48.935652 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819e32e1-abaf-47ad-92d5-c9eb96685e64 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:48.950808 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 168/334] 10.222.0.67 () {56 vars in 1308 bytes} [Thu Jul 14 17:39:48 2022] GET /identity/v3/role_assignments?user.id=837f29b39e8945f9abe74bf343a8d80a&scope.system=all&role.id=95d753870f97426cb1ce32e078621a4c => generated 510 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:39:51.290852 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998a5276-8b5b-458e-abdb-9cc355c597eb None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:51.291396 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998a5276-8b5b-458e-abdb-9cc355c597eb None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:51.291396 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998a5276-8b5b-458e-abdb-9cc355c597eb None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:51.293067 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 167/335] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:39:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:39:51.299167 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f30b551-e26d-41e4-b2a6-61a2d267d16c None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:51.299628 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f30b551-e26d-41e4-b2a6-61a2d267d16c None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:51.299710 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f30b551-e26d-41e4-b2a6-61a2d267d16c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:51.327278 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-2f30b551-e26d-41e4-b2a6-61a2d267d16c None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:39:51.328533 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-2f30b551-e26d-41e4-b2a6-61a2d267d16c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:39:51.383383 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a3dcbc-ca90-44bf-81aa-cff9b1913f46 None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:51.384002 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a3dcbc-ca90-44bf-81aa-cff9b1913f46 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:51.384493 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a3dcbc-ca90-44bf-81aa-cff9b1913f46 None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:51.386365 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 168/336] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:39:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:39:51.391261 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc5f03e-fa99-4ab8-a2ae-01ad1b0cbd19 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:51.391820 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc5f03e-fa99-4ab8-a2ae-01ad1b0cbd19 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:51.392384 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc5f03e-fa99-4ab8-a2ae-01ad1b0cbd19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:51.411129 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 169/337] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:39:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 17:39:51.421933 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-3fc5f03e-fa99-4ab8-a2ae-01ad1b0cbd19 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:39:51.423130 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-3fc5f03e-fa99-4ab8-a2ae-01ad1b0cbd19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:39:51.480467 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f30b551-e26d-41e4-b2a6-61a2d267d16c None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:51.531277 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 169/338] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:39:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:39:51.565004 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fc0936-51e5-45ee-81e1-c64f2d9d2e9c None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:51.565203 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fc0936-51e5-45ee-81e1-c64f2d9d2e9c None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:51.565828 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fc0936-51e5-45ee-81e1-c64f2d9d2e9c None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:51.567418 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 170/339] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:39:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 17:39:51.574375 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fc0936-51e5-45ee-81e1-c64f2d9d2e9c None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:51.612880 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f30b551-e26d-41e4-b2a6-61a2d267d16c None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:51.632387 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:51.634821 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:51.661318 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe08ccc-9b84-4a9c-bb31-a4dfc312569c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:51.664170 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe08ccc-9b84-4a9c-bb31-a4dfc312569c None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:51.664629 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe08ccc-9b84-4a9c-bb31-a4dfc312569c None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:51.665224 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe08ccc-9b84-4a9c-bb31-a4dfc312569c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:51.681427 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe08ccc-9b84-4a9c-bb31-a4dfc312569c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:39:51.692261 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-2fe08ccc-9b84-4a9c-bb31-a4dfc312569c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 17:39:51.692261 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:39:51.692261 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:39:51.692261 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:39:51.692261 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:39:51.692261 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:39:51.692261 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:39:51.692261 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:39:51.692261 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:39:51.692261 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:39:51.692261 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:39:51.692261 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:39:51.692261 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:39:51.692261 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:39:51.692261 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:39:51.692261 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:39:51.693442 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:39:51.693442 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:39:51.693442 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:39:51.693442 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:39:51.693442 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:39:51.693442 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:39:51.693442 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:39:51.693442 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:39:51.693442 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:39:51.693442 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:39:51.693442 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:39:51.693442 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:39:51.693442 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:39:51.693442 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:39:51.693442 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:39:51.693442 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:39:51.694800 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:39:51.694800 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:39:51.694800 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:39:51.694800 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:39:51.694800 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:39:51.694800 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:39:51.694800 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:39:51.694800 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:39:51.694800 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:39:51.694800 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:39:51.694800 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 17:39:51.694800 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:39:51.697616 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 170/340] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 14 17:39:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 17:39:51.699441 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c03fc9-676c-40b8-bf97-07999bf0ff4c None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:51.699940 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c03fc9-676c-40b8-bf97-07999bf0ff4c None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:51.700409 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c03fc9-676c-40b8-bf97-07999bf0ff4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:51.722307 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-63c03fc9-676c-40b8-bf97-07999bf0ff4c None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:39:51.723860 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-63c03fc9-676c-40b8-bf97-07999bf0ff4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:39:51.801791 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fc0936-51e5-45ee-81e1-c64f2d9d2e9c None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:51.845632 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 171/341] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:39:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:39:51.845632 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c03fc9-676c-40b8-bf97-07999bf0ff4c None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:51.849465 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207a1853-ef80-445a-aed5-6bd11cb61197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:51.850566 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a1853-ef80-445a-aed5-6bd11cb61197 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:51.851034 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a1853-ef80-445a-aed5-6bd11cb61197 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:51.851491 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a1853-ef80-445a-aed5-6bd11cb61197 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:51.867898 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207a1853-ef80-445a-aed5-6bd11cb61197 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:39:51.876077 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-207a1853-ef80-445a-aed5-6bd11cb61197 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 17:39:51.876077 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:39:51.876077 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:39:51.876077 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:39:51.876077 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:39:51.876077 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:39:51.876077 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:39:51.876077 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:39:51.876077 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:39:51.876077 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:39:51.876077 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:39:51.876077 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:39:51.876077 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:39:51.876077 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:39:51.876077 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:39:51.876077 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:39:51.877017 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:39:51.877017 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:39:51.877017 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:39:51.877017 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:39:51.877017 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:39:51.877017 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:39:51.877017 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:39:51.877017 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:39:51.877017 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:39:51.877017 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:39:51.877017 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:39:51.877017 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:39:51.877017 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:39:51.877017 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:39:51.877017 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:39:51.877017 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:39:51.877867 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:39:51.877867 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:39:51.877867 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:39:51.877867 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:39:51.877867 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:39:51.877867 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:39:51.877867 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:39:51.877867 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:39:51.877867 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:39:51.877867 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:39:51.877867 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 17:39:51.877867 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:39:51.881027 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 171/342] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 14 17:39:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:39:51.887362 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207a1853-ef80-445a-aed5-6bd11cb61197 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:51.991398 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:52.012244 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207a1853-ef80-445a-aed5-6bd11cb61197 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:52.044567 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c03fc9-676c-40b8-bf97-07999bf0ff4c None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:52.053776 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031b0fc9-d817-4ccf-8274-f79d586d87ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:52.054856 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b0fc9-d817-4ccf-8274-f79d586d87ef None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:52.055385 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b0fc9-d817-4ccf-8274-f79d586d87ef None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:52.055882 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b0fc9-d817-4ccf-8274-f79d586d87ef None admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:52.056861 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031b0fc9-d817-4ccf-8274-f79d586d87ef None admin] RBAC: Adding query filter params (name=member) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:39:52.057389 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031b0fc9-d817-4ccf-8274-f79d586d87ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:52.059078 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031b0fc9-d817-4ccf-8274-f79d586d87ef None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:52.059977 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:52.071284 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 172/343] 10.222.0.67 () {56 vars in 1101 bytes} [Thu Jul 14 17:39:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:39:52.072543 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031b0fc9-d817-4ccf-8274-f79d586d87ef None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:52.107770 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ac9ba8-37da-4754-8913-aa8b1b28406a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:52.108466 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ac9ba8-37da-4754-8913-aa8b1b28406a None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:52.108911 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ac9ba8-37da-4754-8913-aa8b1b28406a None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:52.109360 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ac9ba8-37da-4754-8913-aa8b1b28406a None admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:52.110306 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ac9ba8-37da-4754-8913-aa8b1b28406a None admin] RBAC: Adding query filter params (name=reader) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:39:52.110780 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ac9ba8-37da-4754-8913-aa8b1b28406a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:52.112336 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ac9ba8-37da-4754-8913-aa8b1b28406a None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:52.125484 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 172/344] 10.222.0.67 () {56 vars in 1101 bytes} [Thu Jul 14 17:39:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:52.131299 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ac9ba8-37da-4754-8913-aa8b1b28406a None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:52.196851 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031b0fc9-d817-4ccf-8274-f79d586d87ef None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:52.230482 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f80ecb-ae4b-45ac-9b40-57df9afea57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:52.231471 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f80ecb-ae4b-45ac-9b40-57df9afea57d None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:52.231855 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f80ecb-ae4b-45ac-9b40-57df9afea57d None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:52.232239 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f80ecb-ae4b-45ac-9b40-57df9afea57d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:52.244943 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f80ecb-ae4b-45ac-9b40-57df9afea57d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:39:52.253440 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-f1f80ecb-ae4b-45ac-9b40-57df9afea57d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 17:39:52.253440 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:39:52.253440 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:39:52.253440 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:39:52.253440 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:39:52.253440 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:39:52.253440 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:39:52.253440 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:39:52.253440 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:39:52.253440 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:39:52.253440 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:39:52.253440 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:39:52.253440 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:39:52.253440 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:39:52.253440 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:39:52.253440 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:39:52.254647 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:39:52.254647 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:39:52.254647 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:39:52.254647 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:39:52.254647 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:39:52.254647 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:39:52.254647 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:39:52.254647 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:39:52.254647 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:39:52.254647 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:39:52.254647 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:39:52.254647 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:39:52.254647 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:39:52.254647 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:39:52.254647 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:39:52.254647 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:39:52.256171 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:39:52.256171 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:39:52.256171 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:39:52.256171 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:39:52.256171 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:39:52.256171 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:39:52.256171 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:39:52.256171 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:39:52.256171 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:39:52.256171 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:39:52.256171 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 17:39:52.256171 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:39:52.258314 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 173/345] 10.222.0.67 () {56 vars in 1114 bytes} [Thu Jul 14 17:39:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:39:52.259724 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee62c507-ad93-4a74-8527-f3ca4fea3124 None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:52.260084 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ac9ba8-37da-4754-8913-aa8b1b28406a None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:52.260208 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee62c507-ad93-4a74-8527-f3ca4fea3124 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:52.260559 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee62c507-ad93-4a74-8527-f3ca4fea3124 None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:52.262261 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 174/346] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:39:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:39:52.263799 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee62c507-ad93-4a74-8527-f3ca4fea3124 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:52.275673 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:52.299452 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b74c7a2-cd6a-4989-9dea-bbd147d753c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:52.300720 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b74c7a2-cd6a-4989-9dea-bbd147d753c5 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:52.301159 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b74c7a2-cd6a-4989-9dea-bbd147d753c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:52.301622 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b74c7a2-cd6a-4989-9dea-bbd147d753c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:52.340791 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:52.385771 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b74c7a2-cd6a-4989-9dea-bbd147d753c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:52.387583 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b74c7a2-cd6a-4989-9dea-bbd147d753c5 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:52.406360 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee62c507-ad93-4a74-8527-f3ca4fea3124 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:52.470933 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d29c32-ae58-471e-8730-d618f465b048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:52.471841 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d29c32-ae58-471e-8730-d618f465b048 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:52.472126 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d29c32-ae58-471e-8730-d618f465b048 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:52.472404 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d29c32-ae58-471e-8730-d618f465b048 None admin] PATH_INFO: `/v3/users/826013e3a6684cc3b04c02860aa0caff` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:52.474821 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d29c32-ae58-471e-8730-d618f465b048 None admin] RBAC: Authorizing `identity:get_user(user_id=826013e3a6684cc3b04c02860aa0caff)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:52.476318 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d29c32-ae58-471e-8730-d618f465b048 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:52.478899 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 175/347] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 14 17:39:52 2022] GET /identity/v3/users/826013e3a6684cc3b04c02860aa0caff => generated 293 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:52.479708 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d29c32-ae58-471e-8730-d618f465b048 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:52.560057 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 173/348] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 14 17:39:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 17:39:52.561032 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224b1ac9-8ecf-4d41-81ae-2639d30fb17c None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:52.561470 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224b1ac9-8ecf-4d41-81ae-2639d30fb17c None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:52.561920 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224b1ac9-8ecf-4d41-81ae-2639d30fb17c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:52.584811 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:52.596677 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-224b1ac9-8ecf-4d41-81ae-2639d30fb17c None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:39:52.599998 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-224b1ac9-8ecf-4d41-81ae-2639d30fb17c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:39:52.612249 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d29c32-ae58-471e-8730-d618f465b048 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:52.654643 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a7f928-1e75-4f21-8a9b-1884218afdee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:52.655549 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a7f928-1e75-4f21-8a9b-1884218afdee None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:52.656273 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a7f928-1e75-4f21-8a9b-1884218afdee None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:52.656552 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a7f928-1e75-4f21-8a9b-1884218afdee None admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:52.657344 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a7f928-1e75-4f21-8a9b-1884218afdee None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:39:52.657941 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a7f928-1e75-4f21-8a9b-1884218afdee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:52.659346 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a7f928-1e75-4f21-8a9b-1884218afdee None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:52.670122 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 176/349] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 14 17:39:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:52.671713 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6040dea-68a3-4928-95fc-6a1225681adb None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:52.672156 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6040dea-68a3-4928-95fc-6a1225681adb None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:52.672578 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6040dea-68a3-4928-95fc-6a1225681adb None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:52.674147 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 177/350] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:39:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:39:52.675047 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6040dea-68a3-4928-95fc-6a1225681adb None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:52.715291 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:52.734762 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 174/351] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:39:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:39:52.735671 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224b1ac9-8ecf-4d41-81ae-2639d30fb17c None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:52.850800 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6040dea-68a3-4928-95fc-6a1225681adb None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:52.902664 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224b1ac9-8ecf-4d41-81ae-2639d30fb17c None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:52.915581 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3130a751-5a6b-47c1-93e9-e6fb65b16966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:52.916567 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3130a751-5a6b-47c1-93e9-e6fb65b16966 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:52.917030 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3130a751-5a6b-47c1-93e9-e6fb65b16966 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:52.917479 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3130a751-5a6b-47c1-93e9-e6fb65b16966 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:52.918519 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3130a751-5a6b-47c1-93e9-e6fb65b16966 None admin] RBAC: Adding query filter params (role.id=7e81381d29ef4d8c89fe53e977678bf6, user.id=826013e3a6684cc3b04c02860aa0caff, scope.system=all) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:39:52.919035 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3130a751-5a6b-47c1-93e9-e6fb65b16966 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:52.920670 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3130a751-5a6b-47c1-93e9-e6fb65b16966 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:52.937814 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:52.941885 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 178/352] 10.222.0.67 () {56 vars in 1308 bytes} [Thu Jul 14 17:39:52 2022] GET /identity/v3/role_assignments?user.id=826013e3a6684cc3b04c02860aa0caff&scope.system=all&role.id=7e81381d29ef4d8c89fe53e977678bf6 => generated 510 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:52.943507 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a379503-ea8e-4f62-b17d-5a0507f298b8 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:52.943802 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a379503-ea8e-4f62-b17d-5a0507f298b8 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:52.944079 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a379503-ea8e-4f62-b17d-5a0507f298b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:52.963123 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-3a379503-ea8e-4f62-b17d-5a0507f298b8 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:39:52.963462 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee42b4c-7e3d-4964-9eef-39d7393732dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:52.964481 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee42b4c-7e3d-4964-9eef-39d7393732dc None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:52.964876 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee42b4c-7e3d-4964-9eef-39d7393732dc None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:52.965150 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-3a379503-ea8e-4f62-b17d-5a0507f298b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:39:52.965323 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee42b4c-7e3d-4964-9eef-39d7393732dc None admin] PATH_INFO: `/v3/projects/44c7c7b4ddec44b48803f27448a16a78` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:52.966797 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee42b4c-7e3d-4964-9eef-39d7393732dc None admin] RBAC: Authorizing `identity:get_project(project_id=44c7c7b4ddec44b48803f27448a16a78)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:52.968830 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee42b4c-7e3d-4964-9eef-39d7393732dc None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:52.972288 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 175/353] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 14 17:39:52 2022] GET /identity/v3/projects/44c7c7b4ddec44b48803f27448a16a78 => generated 298 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:52.973608 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee42b4c-7e3d-4964-9eef-39d7393732dc None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:53.067144 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 179/354] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:39:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:39:53.067144 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a379503-ea8e-4f62-b17d-5a0507f298b8 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:53.081077 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:53.142713 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee42b4c-7e3d-4964-9eef-39d7393732dc None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:53.190116 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424027d4-ef0a-41f9-bab9-4ce247f4a448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:53.192537 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424027d4-ef0a-41f9-bab9-4ce247f4a448 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:53.192537 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424027d4-ef0a-41f9-bab9-4ce247f4a448 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:53.192537 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424027d4-ef0a-41f9-bab9-4ce247f4a448 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:53.218903 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a379503-ea8e-4f62-b17d-5a0507f298b8 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:53.253496 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:53.264476 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b83d97b-69b1-4f40-b3c6-62b1bc60dd6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:53.265284 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b83d97b-69b1-4f40-b3c6-62b1bc60dd6e None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:53.265594 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b83d97b-69b1-4f40-b3c6-62b1bc60dd6e None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:53.265870 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b83d97b-69b1-4f40-b3c6-62b1bc60dd6e None admin] PATH_INFO: `/v3/roles/member` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:53.273399 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424027d4-ef0a-41f9-bab9-4ce247f4a448 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:53.275027 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424027d4-ef0a-41f9-bab9-4ce247f4a448 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:53.278517 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b83d97b-69b1-4f40-b3c6-62b1bc60dd6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:39:53.286194 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-0b83d97b-69b1-4f40-b3c6-62b1bc60dd6e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 17:39:53.286194 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:39:53.286194 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:39:53.286194 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:39:53.286194 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:39:53.286194 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:39:53.286194 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:39:53.286194 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:39:53.286194 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:39:53.286194 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:39:53.286194 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:39:53.286194 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:39:53.286194 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:39:53.286194 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:39:53.286194 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:39:53.286194 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:39:53.287177 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:39:53.287177 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:39:53.287177 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:39:53.287177 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:39:53.287177 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:39:53.287177 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:39:53.287177 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:39:53.287177 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:39:53.287177 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:39:53.287177 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:39:53.287177 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:39:53.287177 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:39:53.287177 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:39:53.287177 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:39:53.287177 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:39:53.287177 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:39:53.287999 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:39:53.287999 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:39:53.287999 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:39:53.287999 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:39:53.287999 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:39:53.287999 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:39:53.287999 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:39:53.287999 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:39:53.287999 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:39:53.287999 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:39:53.287999 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 17:39:53.287999 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:39:53.287999 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 180/355] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 14 17:39:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:39:53.288674 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b83d97b-69b1-4f40-b3c6-62b1bc60dd6e None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:53.349784 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:53.396492 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 176/356] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 14 17:39:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 17:39:53.396492 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424027d4-ef0a-41f9-bab9-4ce247f4a448 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:53.405915 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b83d97b-69b1-4f40-b3c6-62b1bc60dd6e None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:53.445699 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff2e63e-3d64-4c60-9da4-141b2378d203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:53.446490 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff2e63e-3d64-4c60-9da4-141b2378d203 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:53.446766 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff2e63e-3d64-4c60-9da4-141b2378d203 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:53.447036 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff2e63e-3d64-4c60-9da4-141b2378d203 None admin] PATH_INFO: `/v3/groups/aef192fea03a488b8680b50d525fbfd5` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:53.456018 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff2e63e-3d64-4c60-9da4-141b2378d203 None admin] RBAC: Authorizing `identity:get_group(group_id=aef192fea03a488b8680b50d525fbfd5)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:53.459296 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff2e63e-3d64-4c60-9da4-141b2378d203 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:53.459296 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 181/357] 10.222.0.67 () {56 vars in 1180 bytes} [Thu Jul 14 17:39:53 2022] GET /identity/v3/groups/aef192fea03a488b8680b50d525fbfd5 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:53.460534 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7263b82f-b641-42fb-a99c-1e67193842d9 None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:53.460784 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7263b82f-b641-42fb-a99c-1e67193842d9 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:53.461079 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7263b82f-b641-42fb-a99c-1e67193842d9 None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:53.463809 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 182/358] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:39:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:39:53.464402 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7263b82f-b641-42fb-a99c-1e67193842d9 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:53.525191 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:53.526047 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424027d4-ef0a-41f9-bab9-4ce247f4a448 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:53.565953 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79137cb6-69b2-420a-a319-0868150d69c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:53.566776 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79137cb6-69b2-420a-a319-0868150d69c2 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:53.567068 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79137cb6-69b2-420a-a319-0868150d69c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:53.567347 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79137cb6-69b2-420a-a319-0868150d69c2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:53.578840 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79137cb6-69b2-420a-a319-0868150d69c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:39:53.585173 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7263b82f-b641-42fb-a99c-1e67193842d9 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:53.587647 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-79137cb6-69b2-420a-a319-0868150d69c2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 17:39:53.587647 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:39:53.587647 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:39:53.587647 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:39:53.587647 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:39:53.587647 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:39:53.587647 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:39:53.587647 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:39:53.587647 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:39:53.587647 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:39:53.587647 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:39:53.587647 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:39:53.587647 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:39:53.587647 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:39:53.587647 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:39:53.587647 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:39:53.588547 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:39:53.588547 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:39:53.588547 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:39:53.588547 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:39:53.588547 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:39:53.588547 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:39:53.588547 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:39:53.588547 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:39:53.588547 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:39:53.588547 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:39:53.588547 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:39:53.588547 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:39:53.588547 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:39:53.588547 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:39:53.588547 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:39:53.588547 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:39:53.589351 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:39:53.589351 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:39:53.589351 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:39:53.589351 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:39:53.589351 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:39:53.589351 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:39:53.589351 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:39:53.589351 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:39:53.589351 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:39:53.589351 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:39:53.589351 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 17:39:53.589351 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:39:53.589351 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 177/359] 10.222.0.67 () {56 vars in 1114 bytes} [Thu Jul 14 17:39:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:39:53.590094 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79137cb6-69b2-420a-a319-0868150d69c2 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:53.621662 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:53.631077 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b862a15-bb2b-4191-b6ff-b4902b80f281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:53.631675 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b862a15-bb2b-4191-b6ff-b4902b80f281 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:53.631961 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b862a15-bb2b-4191-b6ff-b4902b80f281 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:53.632241 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b862a15-bb2b-4191-b6ff-b4902b80f281 None admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:53.633004 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b862a15-bb2b-4191-b6ff-b4902b80f281 None admin] RBAC: Adding query filter params (name=member) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:39:53.633313 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b862a15-bb2b-4191-b6ff-b4902b80f281 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:53.634766 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b862a15-bb2b-4191-b6ff-b4902b80f281 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:53.643906 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 183/360] 10.222.0.67 () {56 vars in 1101 bytes} [Thu Jul 14 17:39:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:53.644587 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b862a15-bb2b-4191-b6ff-b4902b80f281 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:53.726067 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79137cb6-69b2-420a-a319-0868150d69c2 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:53.763600 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b862a15-bb2b-4191-b6ff-b4902b80f281 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:53.765864 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229797db-e2d3-4acd-9f9e-bed227a07037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:53.766742 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229797db-e2d3-4acd-9f9e-bed227a07037 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:53.767019 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229797db-e2d3-4acd-9f9e-bed227a07037 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:53.767289 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229797db-e2d3-4acd-9f9e-bed227a07037 None admin] PATH_INFO: `/v3/projects/44c7c7b4ddec44b48803f27448a16a78` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:53.769427 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229797db-e2d3-4acd-9f9e-bed227a07037 None admin] RBAC: Authorizing `identity:get_project(project_id=44c7c7b4ddec44b48803f27448a16a78)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:53.770976 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229797db-e2d3-4acd-9f9e-bed227a07037 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:53.773199 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 178/361] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 14 17:39:53 2022] GET /identity/v3/projects/44c7c7b4ddec44b48803f27448a16a78 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:53.778814 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d185978e-849d-4013-ab03-82ccb4d7a9b1 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:53.779102 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d185978e-849d-4013-ab03-82ccb4d7a9b1 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:53.779381 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d185978e-849d-4013-ab03-82ccb4d7a9b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:53.780003 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:53.797921 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-d185978e-849d-4013-ab03-82ccb4d7a9b1 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:39:53.799117 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-d185978e-849d-4013-ab03-82ccb4d7a9b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:39:53.805565 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74945d42-cb71-476c-ae94-2248bf9cd6df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:53.806680 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74945d42-cb71-476c-ae94-2248bf9cd6df None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:53.806968 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74945d42-cb71-476c-ae94-2248bf9cd6df None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:53.807246 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74945d42-cb71-476c-ae94-2248bf9cd6df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:53.808476 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74945d42-cb71-476c-ae94-2248bf9cd6df None admin] RBAC: Adding query filter params (group.id=aef192fea03a488b8680b50d525fbfd5, role.id=95d753870f97426cb1ce32e078621a4c, scope.project.id=44c7c7b4ddec44b48803f27448a16a78) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:39:53.808476 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74945d42-cb71-476c-ae94-2248bf9cd6df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:53.809899 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74945d42-cb71-476c-ae94-2248bf9cd6df None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:53.815808 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 184/362] 10.222.0.67 () {56 vars in 1376 bytes} [Thu Jul 14 17:39:53 2022] GET /identity/v3/role_assignments?group.id=aef192fea03a488b8680b50d525fbfd5&scope.project.id=44c7c7b4ddec44b48803f27448a16a78&role.id=95d753870f97426cb1ce32e078621a4c => generated 260 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:53.816614 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74945d42-cb71-476c-ae94-2248bf9cd6df None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:53.904415 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 179/363] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:39:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:39:53.905622 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d185978e-849d-4013-ab03-82ccb4d7a9b1 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:53.940618 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:53.964784 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74945d42-cb71-476c-ae94-2248bf9cd6df None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:54.005398 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c713b41-2f95-4bd1-86a7-8b0e673a5d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:54.006036 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c713b41-2f95-4bd1-86a7-8b0e673a5d3d None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:54.006321 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c713b41-2f95-4bd1-86a7-8b0e673a5d3d None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:54.006602 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c713b41-2f95-4bd1-86a7-8b0e673a5d3d None admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:54.007370 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c713b41-2f95-4bd1-86a7-8b0e673a5d3d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:39:54.007703 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c713b41-2f95-4bd1-86a7-8b0e673a5d3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:54.009094 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c713b41-2f95-4bd1-86a7-8b0e673a5d3d None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:54.023490 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 185/364] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 14 17:39:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:54.024168 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c713b41-2f95-4bd1-86a7-8b0e673a5d3d None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:54.041238 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d185978e-849d-4013-ab03-82ccb4d7a9b1 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:54.076617 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:54.090792 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a9e3c8-f2fe-47ff-aa01-c6829f0a0a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:54.091236 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a9e3c8-f2fe-47ff-aa01-c6829f0a0a30 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:54.091516 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a9e3c8-f2fe-47ff-aa01-c6829f0a0a30 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:54.091793 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a9e3c8-f2fe-47ff-aa01-c6829f0a0a30 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:54.172999 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c713b41-2f95-4bd1-86a7-8b0e673a5d3d None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:54.181273 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a9e3c8-f2fe-47ff-aa01-c6829f0a0a30 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:54.182937 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a9e3c8-f2fe-47ff-aa01-c6829f0a0a30 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:54.211716 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:54.220923 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec762747-7354-49a9-b433-5ca1a28c007a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:54.220923 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec762747-7354-49a9-b433-5ca1a28c007a None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:54.221271 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec762747-7354-49a9-b433-5ca1a28c007a None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:54.221421 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec762747-7354-49a9-b433-5ca1a28c007a None admin] PATH_INFO: `/v3/groups/aef192fea03a488b8680b50d525fbfd5` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:54.223619 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec762747-7354-49a9-b433-5ca1a28c007a None admin] RBAC: Authorizing `identity:get_group(group_id=aef192fea03a488b8680b50d525fbfd5)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:54.225360 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec762747-7354-49a9-b433-5ca1a28c007a None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:54.227267 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 186/365] 10.222.0.67 () {56 vars in 1180 bytes} [Thu Jul 14 17:39:54 2022] GET /identity/v3/groups/aef192fea03a488b8680b50d525fbfd5 => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:54.227919 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec762747-7354-49a9-b433-5ca1a28c007a None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:54.335008 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 180/366] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 14 17:39:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 17:39:54.336813 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a9e3c8-f2fe-47ff-aa01-c6829f0a0a30 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:54.369501 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec762747-7354-49a9-b433-5ca1a28c007a None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:54.381114 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:54.418441 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa3626b-10f3-44bd-a88d-b364cc419ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:54.419256 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3626b-10f3-44bd-a88d-b364cc419ca1 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:54.419540 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3626b-10f3-44bd-a88d-b364cc419ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:54.419821 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3626b-10f3-44bd-a88d-b364cc419ca1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:54.438425 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa3626b-10f3-44bd-a88d-b364cc419ca1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:39:54.449182 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-1aa3626b-10f3-44bd-a88d-b364cc419ca1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 17:39:54.449182 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:39:54.449182 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:39:54.449182 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:39:54.449182 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:39:54.449182 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:39:54.449182 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:39:54.449182 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:39:54.449182 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:39:54.449182 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:39:54.449182 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:39:54.449182 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:39:54.449182 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:39:54.449182 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:39:54.449182 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:39:54.449182 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:39:54.450585 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:39:54.450585 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:39:54.450585 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:39:54.450585 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:39:54.450585 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:39:54.450585 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:39:54.450585 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:39:54.450585 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:39:54.450585 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:39:54.450585 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:39:54.450585 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:39:54.450585 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:39:54.450585 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:39:54.450585 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:39:54.450585 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:39:54.450585 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:39:54.451379 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:39:54.451379 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:39:54.451379 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:39:54.451379 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:39:54.451379 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:39:54.451379 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:39:54.451379 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:39:54.451379 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:39:54.451379 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:39:54.451379 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:39:54.451379 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 17:39:54.451379 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:39:54.452010 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 187/367] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 14 17:39:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:39:54.452402 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa3626b-10f3-44bd-a88d-b364cc419ca1 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:54.493434 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a9e3c8-f2fe-47ff-aa01-c6829f0a0a30 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:54.530949 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:54.543481 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf16f1d-4b00-493e-a335-1b5b08801788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:54.544153 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf16f1d-4b00-493e-a335-1b5b08801788 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:54.544436 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf16f1d-4b00-493e-a335-1b5b08801788 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:54.544712 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf16f1d-4b00-493e-a335-1b5b08801788 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:54.595499 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa3626b-10f3-44bd-a88d-b364cc419ca1 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:54.638171 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf16f1d-4b00-493e-a335-1b5b08801788 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:54.640677 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf16f1d-4b00-493e-a335-1b5b08801788 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:54.649130 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd72f0a-8197-42e5-89a0-86bae87bc993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:54.651065 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd72f0a-8197-42e5-89a0-86bae87bc993 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:54.651595 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd72f0a-8197-42e5-89a0-86bae87bc993 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:54.652074 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd72f0a-8197-42e5-89a0-86bae87bc993 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:54.653131 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd72f0a-8197-42e5-89a0-86bae87bc993 None admin] RBAC: Adding query filter params (group.id=aef192fea03a488b8680b50d525fbfd5, role.id=fa9b6b80eda3440ca058cb77bd7f8f5c, scope.project.id=44c7c7b4ddec44b48803f27448a16a78) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:39:54.653677 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd72f0a-8197-42e5-89a0-86bae87bc993 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:54.655370 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd72f0a-8197-42e5-89a0-86bae87bc993 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:54.665314 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 188/368] 10.222.0.67 () {56 vars in 1376 bytes} [Thu Jul 14 17:39:54 2022] GET /identity/v3/role_assignments?group.id=aef192fea03a488b8680b50d525fbfd5&scope.project.id=44c7c7b4ddec44b48803f27448a16a78&role.id=fa9b6b80eda3440ca058cb77bd7f8f5c => generated 260 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:54.667180 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd72f0a-8197-42e5-89a0-86bae87bc993 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:54.726016 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:54.814356 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 181/369] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 14 17:39:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 17:39:54.815149 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf16f1d-4b00-493e-a335-1b5b08801788 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:54.823697 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd72f0a-8197-42e5-89a0-86bae87bc993 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:54.849657 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:54.872007 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b68950-0575-4373-82ca-153a3c4120ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:54.873374 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b68950-0575-4373-82ca-153a3c4120ea None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:54.873915 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b68950-0575-4373-82ca-153a3c4120ea None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:54.874392 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b68950-0575-4373-82ca-153a3c4120ea None admin] PATH_INFO: `/v3/projects/67e4c4e8f5f441c5bc8f752c9db84352` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:54.876011 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b68950-0575-4373-82ca-153a3c4120ea None admin] RBAC: Authorizing `identity:get_project(project_id=67e4c4e8f5f441c5bc8f752c9db84352)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:54.877930 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b68950-0575-4373-82ca-153a3c4120ea None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:54.881002 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 189/370] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 14 17:39:54 2022] GET /identity/v3/projects/67e4c4e8f5f441c5bc8f752c9db84352 => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:54.883261 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b68950-0575-4373-82ca-153a3c4120ea None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:54.950275 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf16f1d-4b00-493e-a335-1b5b08801788 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:54.996670 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0de43e3-e1fb-457b-a315-70d976e3ef00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:54.997853 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0de43e3-e1fb-457b-a315-70d976e3ef00 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:54.998341 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0de43e3-e1fb-457b-a315-70d976e3ef00 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:54.998830 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0de43e3-e1fb-457b-a315-70d976e3ef00 None admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:54.999992 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0de43e3-e1fb-457b-a315-70d976e3ef00 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:39:55.000514 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0de43e3-e1fb-457b-a315-70d976e3ef00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:55.002223 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0de43e3-e1fb-457b-a315-70d976e3ef00 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:55.013194 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 182/371] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 14 17:39:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:55.014538 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0de43e3-e1fb-457b-a315-70d976e3ef00 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:55.015328 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:55.022332 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b68950-0575-4373-82ca-153a3c4120ea None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:55.068506 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f50ff4-0fd2-40e2-83b4-44f0678e6d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:55.069492 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f50ff4-0fd2-40e2-83b4-44f0678e6d55 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:55.069881 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f50ff4-0fd2-40e2-83b4-44f0678e6d55 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:55.070540 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f50ff4-0fd2-40e2-83b4-44f0678e6d55 None admin] PATH_INFO: `/v3/projects/67e4c4e8f5f441c5bc8f752c9db84352` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:55.072139 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f50ff4-0fd2-40e2-83b4-44f0678e6d55 None admin] RBAC: Authorizing `identity:get_project(project_id=67e4c4e8f5f441c5bc8f752c9db84352)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:55.073844 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f50ff4-0fd2-40e2-83b4-44f0678e6d55 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:55.076435 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 190/372] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 14 17:39:54 2022] GET /identity/v3/projects/67e4c4e8f5f441c5bc8f752c9db84352 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:55.079188 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f50ff4-0fd2-40e2-83b4-44f0678e6d55 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:55.127574 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:55.149026 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0de43e3-e1fb-457b-a315-70d976e3ef00 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:55.185290 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9af50f-0d2b-453f-8680-1ae5bc4a8d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:55.186744 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9af50f-0d2b-453f-8680-1ae5bc4a8d33 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:55.187227 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9af50f-0d2b-453f-8680-1ae5bc4a8d33 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:55.187783 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9af50f-0d2b-453f-8680-1ae5bc4a8d33 None admin] PATH_INFO: `/v3/groups/aef192fea03a488b8680b50d525fbfd5` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:55.189154 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9af50f-0d2b-453f-8680-1ae5bc4a8d33 None admin] RBAC: Authorizing `identity:get_group(group_id=aef192fea03a488b8680b50d525fbfd5)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:55.191091 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9af50f-0d2b-453f-8680-1ae5bc4a8d33 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:55.193935 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 183/373] 10.222.0.67 () {56 vars in 1180 bytes} [Thu Jul 14 17:39:55 2022] GET /identity/v3/groups/aef192fea03a488b8680b50d525fbfd5 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:55.194946 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9af50f-0d2b-453f-8680-1ae5bc4a8d33 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:55.215398 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f50ff4-0fd2-40e2-83b4-44f0678e6d55 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:55.259594 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553df58e-2078-423f-bb54-e4754526a85d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:55.260255 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553df58e-2078-423f-bb54-e4754526a85d None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:55.260540 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553df58e-2078-423f-bb54-e4754526a85d None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:55.260819 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553df58e-2078-423f-bb54-e4754526a85d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:55.304209 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:55.308823 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9af50f-0d2b-453f-8680-1ae5bc4a8d33 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:55.346756 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc97220-1b89-4116-93ce-63ec73d54265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:55.347860 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553df58e-2078-423f-bb54-e4754526a85d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:55.348284 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc97220-1b89-4116-93ce-63ec73d54265 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:55.348763 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc97220-1b89-4116-93ce-63ec73d54265 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:55.349887 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553df58e-2078-423f-bb54-e4754526a85d None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:55.350242 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc97220-1b89-4116-93ce-63ec73d54265 None admin] PATH_INFO: `/v3/groups/aef192fea03a488b8680b50d525fbfd5` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:55.351824 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc97220-1b89-4116-93ce-63ec73d54265 None admin] RBAC: Authorizing `identity:get_group(group_id=aef192fea03a488b8680b50d525fbfd5)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:55.353642 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc97220-1b89-4116-93ce-63ec73d54265 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:55.355507 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 184/374] 10.222.0.67 () {56 vars in 1180 bytes} [Thu Jul 14 17:39:55 2022] GET /identity/v3/groups/aef192fea03a488b8680b50d525fbfd5 => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:55.361443 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc97220-1b89-4116-93ce-63ec73d54265 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:55.410073 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:55.472327 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 191/375] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 14 17:39:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 17:39:55.473922 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553df58e-2078-423f-bb54-e4754526a85d None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:55.476814 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc97220-1b89-4116-93ce-63ec73d54265 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:55.512118 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2800156-af1f-484b-811c-c76ecfc0cfa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:55.512778 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2800156-af1f-484b-811c-c76ecfc0cfa7 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:55.513045 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2800156-af1f-484b-811c-c76ecfc0cfa7 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:55.513317 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2800156-af1f-484b-811c-c76ecfc0cfa7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:55.514201 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2800156-af1f-484b-811c-c76ecfc0cfa7 None admin] RBAC: Adding query filter params (group.id=aef192fea03a488b8680b50d525fbfd5, role.id=95d753870f97426cb1ce32e078621a4c, scope.project.id=67e4c4e8f5f441c5bc8f752c9db84352) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:39:55.514509 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2800156-af1f-484b-811c-c76ecfc0cfa7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:55.515948 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2800156-af1f-484b-811c-c76ecfc0cfa7 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:55.522517 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 185/376] 10.222.0.67 () {56 vars in 1376 bytes} [Thu Jul 14 17:39:55 2022] GET /identity/v3/role_assignments?group.id=aef192fea03a488b8680b50d525fbfd5&scope.project.id=67e4c4e8f5f441c5bc8f752c9db84352&role.id=95d753870f97426cb1ce32e078621a4c => generated 260 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:55.529686 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2800156-af1f-484b-811c-c76ecfc0cfa7 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:55.584419 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:55.601201 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553df58e-2078-423f-bb54-e4754526a85d None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:55.640329 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32415937-1ca0-4115-9f2c-1339a6226ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:55.641563 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32415937-1ca0-4115-9f2c-1339a6226ed9 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:55.642065 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32415937-1ca0-4115-9f2c-1339a6226ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:55.642537 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32415937-1ca0-4115-9f2c-1339a6226ed9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:55.643582 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32415937-1ca0-4115-9f2c-1339a6226ed9 None admin] RBAC: Adding query filter params (group.id=aef192fea03a488b8680b50d525fbfd5, role.id=fa9b6b80eda3440ca058cb77bd7f8f5c, scope.project.id=67e4c4e8f5f441c5bc8f752c9db84352) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:39:55.644117 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32415937-1ca0-4115-9f2c-1339a6226ed9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:55.647003 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32415937-1ca0-4115-9f2c-1339a6226ed9 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:55.654244 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 192/377] 10.222.0.67 () {56 vars in 1376 bytes} [Thu Jul 14 17:39:55 2022] GET /identity/v3/role_assignments?group.id=aef192fea03a488b8680b50d525fbfd5&scope.project.id=67e4c4e8f5f441c5bc8f752c9db84352&role.id=fa9b6b80eda3440ca058cb77bd7f8f5c => generated 260 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:55.676977 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:55.725956 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2800156-af1f-484b-811c-c76ecfc0cfa7 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:55.765996 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0524a1-8373-4186-9a46-c9339a1f557e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:55.766878 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0524a1-8373-4186-9a46-c9339a1f557e None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:55.767147 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0524a1-8373-4186-9a46-c9339a1f557e None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:55.767419 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0524a1-8373-4186-9a46-c9339a1f557e None admin] PATH_INFO: `/v3/projects/cbe4032be1b14bfe82df97ec9e98e7c0` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:55.768646 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0524a1-8373-4186-9a46-c9339a1f557e None admin] RBAC: Authorizing `identity:get_project(project_id=cbe4032be1b14bfe82df97ec9e98e7c0)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:55.770154 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0524a1-8373-4186-9a46-c9339a1f557e None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:55.772648 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 186/378] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 14 17:39:55 2022] GET /identity/v3/projects/cbe4032be1b14bfe82df97ec9e98e7c0 => generated 344 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:55.778180 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32415937-1ca0-4115-9f2c-1339a6226ed9 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:55.894948 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32415937-1ca0-4115-9f2c-1339a6226ed9 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:55.930297 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:55.931248 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdda761-51dc-4a04-bbbe-b04d3cf934bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:55.932130 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdda761-51dc-4a04-bbbe-b04d3cf934bc None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:55.932457 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdda761-51dc-4a04-bbbe-b04d3cf934bc None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:55.932740 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdda761-51dc-4a04-bbbe-b04d3cf934bc None admin] PATH_INFO: `/v3/groups/262d6ae41af7485d86f744c428300f25` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:55.939048 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdda761-51dc-4a04-bbbe-b04d3cf934bc None admin] RBAC: Authorizing `identity:get_group(group_id=262d6ae41af7485d86f744c428300f25)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:55.940555 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdda761-51dc-4a04-bbbe-b04d3cf934bc None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:55.942741 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 193/379] 10.222.0.67 () {56 vars in 1180 bytes} [Thu Jul 14 17:39:55 2022] GET /identity/v3/groups/262d6ae41af7485d86f744c428300f25 => generated 229 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:55.948919 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0524a1-8373-4186-9a46-c9339a1f557e None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:56.094917 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0524a1-8373-4186-9a46-c9339a1f557e None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:56.130285 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37407c9f-58aa-4c9b-b4a8-a45ae8575f1d None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:56.131123 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37407c9f-58aa-4c9b-b4a8-a45ae8575f1d None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:56.131365 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37407c9f-58aa-4c9b-b4a8-a45ae8575f1d None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:56.132979 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 194/380] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:39:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:39:56.140048 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7890e87b-ed7b-4288-9d4b-84fbcb5812e9 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:56.140337 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7890e87b-ed7b-4288-9d4b-84fbcb5812e9 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:56.140611 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7890e87b-ed7b-4288-9d4b-84fbcb5812e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:56.147348 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c441df-0670-425c-a9f9-133d49f1817a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:56.148287 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c441df-0670-425c-a9f9-133d49f1817a None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:56.148784 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c441df-0670-425c-a9f9-133d49f1817a None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:56.149262 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c441df-0670-425c-a9f9-133d49f1817a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:56.150342 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c441df-0670-425c-a9f9-133d49f1817a None admin] RBAC: Adding query filter params (group.id=262d6ae41af7485d86f744c428300f25, role.id=4651a1cc7b4d4ab7a7a9ca1e77e58e71, scope.project.id=cbe4032be1b14bfe82df97ec9e98e7c0) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:39:56.150961 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c441df-0670-425c-a9f9-133d49f1817a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:56.152619 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c441df-0670-425c-a9f9-133d49f1817a None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:56.159510 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 187/381] 10.222.0.67 () {56 vars in 1376 bytes} [Thu Jul 14 17:39:55 2022] GET /identity/v3/role_assignments?group.id=262d6ae41af7485d86f744c428300f25&scope.project.id=cbe4032be1b14bfe82df97ec9e98e7c0&role.id=4651a1cc7b4d4ab7a7a9ca1e77e58e71 => generated 260 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:56.174672 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-7890e87b-ed7b-4288-9d4b-84fbcb5812e9 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:39:56.175907 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-7890e87b-ed7b-4288-9d4b-84fbcb5812e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:39:56.257519 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 195/382] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:39:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:39:56.291987 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c441df-0670-425c-a9f9-133d49f1817a None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:56.322449 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:56.453789 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c441df-0670-425c-a9f9-133d49f1817a None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:56.514340 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cbe3fe-47c9-40e8-9c99-4e282f711590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:56.515080 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cbe3fe-47c9-40e8-9c99-4e282f711590 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:56.515364 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cbe3fe-47c9-40e8-9c99-4e282f711590 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:56.515643 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cbe3fe-47c9-40e8-9c99-4e282f711590 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:56.534021 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cbe3fe-47c9-40e8-9c99-4e282f711590 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:39:56.543395 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-03cbe3fe-47c9-40e8-9c99-4e282f711590 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 17:39:56.543395 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:39:56.543395 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:39:56.543395 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:39:56.543395 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:39:56.543395 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:39:56.543395 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:39:56.543395 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:39:56.543395 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:39:56.543395 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:39:56.543395 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:39:56.543395 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:39:56.543395 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:39:56.543395 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:39:56.543395 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:39:56.543395 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:39:56.544555 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:39:56.544555 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:39:56.544555 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:39:56.544555 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:39:56.544555 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:39:56.544555 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:39:56.544555 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:39:56.544555 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:39:56.544555 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:39:56.544555 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:39:56.544555 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:39:56.544555 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:39:56.544555 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:39:56.544555 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:39:56.544555 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:39:56.544555 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:39:56.545575 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:39:56.545575 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:39:56.545575 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:39:56.545575 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:39:56.545575 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:39:56.545575 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:39:56.545575 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:39:56.545575 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:39:56.545575 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:39:56.545575 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:39:56.545575 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 17:39:56.545575 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:39:56.547360 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 188/383] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 14 17:39:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:39:56.554654 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7890e87b-ed7b-4288-9d4b-84fbcb5812e9 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:56.700218 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7890e87b-ed7b-4288-9d4b-84fbcb5812e9 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:56.737173 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:56.749863 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167b4cb5-5dc5-4064-9cfc-9230b40c0566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:56.750545 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b4cb5-5dc5-4064-9cfc-9230b40c0566 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:56.750829 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b4cb5-5dc5-4064-9cfc-9230b40c0566 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:56.751103 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b4cb5-5dc5-4064-9cfc-9230b40c0566 None admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:56.751861 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167b4cb5-5dc5-4064-9cfc-9230b40c0566 None admin] RBAC: Adding query filter params (name=member) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:39:56.752165 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167b4cb5-5dc5-4064-9cfc-9230b40c0566 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:56.753554 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167b4cb5-5dc5-4064-9cfc-9230b40c0566 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:56.765723 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 196/384] 10.222.0.67 () {56 vars in 1101 bytes} [Thu Jul 14 17:39:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:56.771245 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cbe3fe-47c9-40e8-9c99-4e282f711590 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:56.874737 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:56.906479 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cbe3fe-47c9-40e8-9c99-4e282f711590 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:56.955289 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f7588e-ad79-4bf3-bd8c-04f75a1490ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:56.956158 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f7588e-ad79-4bf3-bd8c-04f75a1490ef None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:56.956440 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f7588e-ad79-4bf3-bd8c-04f75a1490ef None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:56.956714 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f7588e-ad79-4bf3-bd8c-04f75a1490ef None admin] PATH_INFO: `/v3/groups/aef192fea03a488b8680b50d525fbfd5` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:56.957957 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f7588e-ad79-4bf3-bd8c-04f75a1490ef None admin] RBAC: Authorizing `identity:get_group(group_id=aef192fea03a488b8680b50d525fbfd5)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:56.959928 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f7588e-ad79-4bf3-bd8c-04f75a1490ef None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:56.962677 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 189/385] 10.222.0.67 () {56 vars in 1180 bytes} [Thu Jul 14 17:39:56 2022] GET /identity/v3/groups/aef192fea03a488b8680b50d525fbfd5 => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:56.967344 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167b4cb5-5dc5-4064-9cfc-9230b40c0566 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:56.997522 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b1e3c-7282-4eb2-889a-d23fc4e56dd1 None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:56.997859 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b1e3c-7282-4eb2-889a-d23fc4e56dd1 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:56.998097 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b1e3c-7282-4eb2-889a-d23fc4e56dd1 None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:56.999619 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 190/386] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:39:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 17:39:57.009617 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f85b1d-9ac2-42df-9eb7-c6c7564c61d4 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:57.009902 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f85b1d-9ac2-42df-9eb7-c6c7564c61d4 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:57.010180 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f85b1d-9ac2-42df-9eb7-c6c7564c61d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:57.039792 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-d2f85b1d-9ac2-42df-9eb7-c6c7564c61d4 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:39:57.041007 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-d2f85b1d-9ac2-42df-9eb7-c6c7564c61d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:39:57.168213 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167b4cb5-5dc5-4064-9cfc-9230b40c0566 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:57.170950 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 191/387] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:39:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 17:39:57.194730 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f85b1d-9ac2-42df-9eb7-c6c7564c61d4 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:57.220332 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11790c0-05c8-4fa6-8a0b-b0b45af2a7c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:57.221898 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11790c0-05c8-4fa6-8a0b-b0b45af2a7c0 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:57.222389 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11790c0-05c8-4fa6-8a0b-b0b45af2a7c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:57.222864 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11790c0-05c8-4fa6-8a0b-b0b45af2a7c0 None admin] PATH_INFO: `/v3/projects/44c7c7b4ddec44b48803f27448a16a78` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:57.228622 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11790c0-05c8-4fa6-8a0b-b0b45af2a7c0 None admin] RBAC: Authorizing `identity:get_project(project_id=44c7c7b4ddec44b48803f27448a16a78)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:57.234140 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11790c0-05c8-4fa6-8a0b-b0b45af2a7c0 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:57.236129 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 197/388] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 14 17:39:56 2022] GET /identity/v3/projects/44c7c7b4ddec44b48803f27448a16a78 => generated 298 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:57.260364 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11790c0-05c8-4fa6-8a0b-b0b45af2a7c0 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:57.326355 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:57.361136 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f85b1d-9ac2-42df-9eb7-c6c7564c61d4 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:57.400447 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:57.403894 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cca1ed-3837-4e5b-8d9a-26b9958e5c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:57.405071 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cca1ed-3837-4e5b-8d9a-26b9958e5c0e None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:57.405602 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cca1ed-3837-4e5b-8d9a-26b9958e5c0e None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:57.406084 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cca1ed-3837-4e5b-8d9a-26b9958e5c0e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:57.418155 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cca1ed-3837-4e5b-8d9a-26b9958e5c0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:39:57.426828 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-b5cca1ed-3837-4e5b-8d9a-26b9958e5c0e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 17:39:57.426828 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:39:57.426828 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:39:57.426828 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:39:57.426828 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:39:57.426828 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:39:57.426828 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:39:57.426828 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:39:57.426828 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:39:57.426828 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:39:57.426828 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:39:57.426828 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:39:57.426828 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:39:57.426828 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:39:57.426828 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:39:57.426828 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:39:57.427868 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:39:57.427868 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:39:57.427868 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:39:57.427868 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:39:57.427868 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:39:57.427868 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:39:57.427868 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:39:57.427868 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:39:57.427868 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:39:57.427868 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:39:57.427868 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:39:57.427868 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:39:57.427868 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:39:57.427868 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:39:57.427868 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:39:57.427868 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:39:57.428724 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:39:57.428724 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:39:57.428724 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:39:57.428724 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:39:57.428724 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:39:57.428724 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:39:57.428724 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:39:57.428724 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:39:57.428724 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:39:57.428724 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:39:57.428724 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 17:39:57.428724 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:39:57.431482 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 192/389] 10.222.0.67 () {56 vars in 1114 bytes} [Thu Jul 14 17:39:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 17:39:57.437461 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cca1ed-3837-4e5b-8d9a-26b9958e5c0e None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:57.540456 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11790c0-05c8-4fa6-8a0b-b0b45af2a7c0 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:57.559355 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cca1ed-3837-4e5b-8d9a-26b9958e5c0e None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:57.595881 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8749de-77d3-4681-89d5-f3f6ff7ab7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:57.596907 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8749de-77d3-4681-89d5-f3f6ff7ab7df None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:57.597396 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8749de-77d3-4681-89d5-f3f6ff7ab7df None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:57.597901 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8749de-77d3-4681-89d5-f3f6ff7ab7df None admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:57.598890 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8749de-77d3-4681-89d5-f3f6ff7ab7df None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:39:57.600024 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8749de-77d3-4681-89d5-f3f6ff7ab7df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:57.601658 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8749de-77d3-4681-89d5-f3f6ff7ab7df None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:57.603434 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:57.615323 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 193/390] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 14 17:39:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:57.624703 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8749de-77d3-4681-89d5-f3f6ff7ab7df None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:57.627153 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0608b8b8-8371-4df5-a106-03dda5626abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:57.628056 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0608b8b8-8371-4df5-a106-03dda5626abe None admin] REQUEST_METHOD: `PUT` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:57.628340 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0608b8b8-8371-4df5-a106-03dda5626abe None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:57.628616 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0608b8b8-8371-4df5-a106-03dda5626abe None admin] PATH_INFO: `/v3/projects/44c7c7b4ddec44b48803f27448a16a78/groups/aef192fea03a488b8680b50d525fbfd5/roles/95d753870f97426cb1ce32e078621a4c` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:57.631056 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0608b8b8-8371-4df5-a106-03dda5626abe None admin] RBAC: Authorizing `identity:create_grant(project_id=44c7c7b4ddec44b48803f27448a16a78, group_id=aef192fea03a488b8680b50d525fbfd5, role_id=95d753870f97426cb1ce32e078621a4c)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:57.632241 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0608b8b8-8371-4df5-a106-03dda5626abe None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:57.654176 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 198/391] 10.222.0.67 () {58 vars in 1442 bytes} [Thu Jul 14 17:39:57 2022] PUT /identity/v3/projects/44c7c7b4ddec44b48803f27448a16a78/groups/aef192fea03a488b8680b50d525fbfd5/roles/95d753870f97426cb1ce32e078621a4c => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 17:39:57.804685 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8749de-77d3-4681-89d5-f3f6ff7ab7df None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:57.858275 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe3da9c-2683-4342-a9a9-997aa06fc554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:57.859182 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3da9c-2683-4342-a9a9-997aa06fc554 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:57.859464 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3da9c-2683-4342-a9a9-997aa06fc554 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:57.859736 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3da9c-2683-4342-a9a9-997aa06fc554 None admin] PATH_INFO: `/v3/groups/aef192fea03a488b8680b50d525fbfd5` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:57.861059 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe3da9c-2683-4342-a9a9-997aa06fc554 None admin] RBAC: Authorizing `identity:get_group(group_id=aef192fea03a488b8680b50d525fbfd5)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:57.862590 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe3da9c-2683-4342-a9a9-997aa06fc554 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:57.864581 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 194/392] 10.222.0.67 () {56 vars in 1180 bytes} [Thu Jul 14 17:39:57 2022] GET /identity/v3/groups/aef192fea03a488b8680b50d525fbfd5 => generated 226 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:39:57.871050 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0608b8b8-8371-4df5-a106-03dda5626abe None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:57.978350 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0608b8b8-8371-4df5-a106-03dda5626abe None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:57.993690 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:58.014176 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec77698-ccab-4c9c-83a1-34d88f83a9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:58.015072 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec77698-ccab-4c9c-83a1-34d88f83a9f4 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:58.015906 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec77698-ccab-4c9c-83a1-34d88f83a9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:58.016199 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec77698-ccab-4c9c-83a1-34d88f83a9f4 None admin] PATH_INFO: `/v3/projects/44c7c7b4ddec44b48803f27448a16a78` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:58.017438 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec77698-ccab-4c9c-83a1-34d88f83a9f4 None admin] RBAC: Authorizing `identity:get_project(project_id=44c7c7b4ddec44b48803f27448a16a78)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:58.019123 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec77698-ccab-4c9c-83a1-34d88f83a9f4 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:58.020954 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 199/393] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 14 17:39:57 2022] GET /identity/v3/projects/44c7c7b4ddec44b48803f27448a16a78 => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:58.028809 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe3da9c-2683-4342-a9a9-997aa06fc554 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:58.115595 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:58.162046 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe3da9c-2683-4342-a9a9-997aa06fc554 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:58.212638 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7388b660-2175-48cf-ada0-b54cb9fa994f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:58.213846 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7388b660-2175-48cf-ada0-b54cb9fa994f None admin] REQUEST_METHOD: `PUT` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:58.214323 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7388b660-2175-48cf-ada0-b54cb9fa994f None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:58.214738 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7388b660-2175-48cf-ada0-b54cb9fa994f None admin] PATH_INFO: `/v3/projects/44c7c7b4ddec44b48803f27448a16a78/groups/aef192fea03a488b8680b50d525fbfd5/roles/fa9b6b80eda3440ca058cb77bd7f8f5c` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:58.222833 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7388b660-2175-48cf-ada0-b54cb9fa994f None admin] RBAC: Authorizing `identity:create_grant(project_id=44c7c7b4ddec44b48803f27448a16a78, group_id=aef192fea03a488b8680b50d525fbfd5, role_id=fa9b6b80eda3440ca058cb77bd7f8f5c)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:58.224547 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7388b660-2175-48cf-ada0-b54cb9fa994f None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:58.252804 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 195/394] 10.222.0.67 () {58 vars in 1442 bytes} [Thu Jul 14 17:39:58 2022] PUT /identity/v3/projects/44c7c7b4ddec44b48803f27448a16a78/groups/aef192fea03a488b8680b50d525fbfd5/roles/fa9b6b80eda3440ca058cb77bd7f8f5c => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:39:58.277805 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c2d168-1bc4-4130-bd26-94c89191a6ca None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:58.278365 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c2d168-1bc4-4130-bd26-94c89191a6ca None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:58.278784 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c2d168-1bc4-4130-bd26-94c89191a6ca None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:58.280296 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 200/395] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:39:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:39:58.290348 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7f828e-585a-429d-b25a-666e43710a4d None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:58.290572 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4953719b-64a8-4d3e-878f-75495121e679 None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:58.290666 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7f828e-585a-429d-b25a-666e43710a4d None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:58.290912 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7f828e-585a-429d-b25a-666e43710a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:58.291213 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4953719b-64a8-4d3e-878f-75495121e679 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:58.291628 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4953719b-64a8-4d3e-878f-75495121e679 None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:58.293493 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 196/396] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:39:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:39:58.302796 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc7635e-53f8-4c3c-9108-3945e5f7afce None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:58.303308 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc7635e-53f8-4c3c-9108-3945e5f7afce None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:58.303731 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc7635e-53f8-4c3c-9108-3945e5f7afce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:58.319084 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-eb7f828e-585a-429d-b25a-666e43710a4d None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:39:58.320317 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-eb7f828e-585a-429d-b25a-666e43710a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:39:58.328566 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-5bc7635e-53f8-4c3c-9108-3945e5f7afce None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:39:58.330827 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-5bc7635e-53f8-4c3c-9108-3945e5f7afce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:39:58.445689 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 201/397] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:39:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:39:58.483613 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 197/398] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:39:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 17:39:58.485960 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7f828e-585a-429d-b25a-666e43710a4d None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:58.509059 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc7635e-53f8-4c3c-9108-3945e5f7afce None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:58.605671 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:58.661100 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7f828e-585a-429d-b25a-666e43710a4d None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:58.676758 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:58.708322 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc7635e-53f8-4c3c-9108-3945e5f7afce None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:58.729792 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d57687-b2ee-42c9-a713-9e35979448a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:58.730925 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d57687-b2ee-42c9-a713-9e35979448a5 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:58.732480 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d57687-b2ee-42c9-a713-9e35979448a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:58.733443 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d57687-b2ee-42c9-a713-9e35979448a5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:58.757648 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d57687-b2ee-42c9-a713-9e35979448a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:39:58.766565 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-59d57687-b2ee-42c9-a713-9e35979448a5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 17:39:58.766565 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:39:58.766565 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:39:58.766565 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:39:58.766565 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:39:58.766565 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:39:58.766565 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:39:58.766565 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:39:58.766565 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:39:58.766565 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:39:58.766565 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:39:58.766565 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:39:58.766565 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:39:58.766565 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:39:58.766565 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:39:58.766565 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:39:58.767451 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:39:58.767451 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:39:58.767451 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:39:58.767451 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:39:58.767451 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:39:58.767451 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:39:58.767451 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:39:58.767451 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:39:58.767451 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:39:58.767451 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:39:58.767451 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:39:58.767451 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:39:58.767451 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:39:58.767451 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:39:58.767451 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:39:58.767451 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:39:58.768281 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:39:58.768281 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:39:58.768281 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:39:58.768281 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:39:58.768281 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:39:58.768281 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:39:58.768281 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:39:58.768281 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:39:58.768281 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:39:58.768281 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:39:58.768281 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 17:39:58.768281 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:39:58.771610 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 202/399] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 14 17:39:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 17:39:58.777426 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d57687-b2ee-42c9-a713-9e35979448a5 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:58.783695 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb148b8-76c7-4838-8efa-40f0738be098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:58.785663 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb148b8-76c7-4838-8efa-40f0738be098 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:58.787701 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb148b8-76c7-4838-8efa-40f0738be098 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:58.788177 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb148b8-76c7-4838-8efa-40f0738be098 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:58.807624 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb148b8-76c7-4838-8efa-40f0738be098 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:39:58.825615 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-0fb148b8-76c7-4838-8efa-40f0738be098 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 17:39:58.825615 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:39:58.825615 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:39:58.825615 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:39:58.825615 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:39:58.825615 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:39:58.825615 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:39:58.825615 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:39:58.825615 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:39:58.825615 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:39:58.825615 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:39:58.825615 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:39:58.825615 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:39:58.825615 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:39:58.825615 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:39:58.825615 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:39:58.826567 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:39:58.826567 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:39:58.826567 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:39:58.826567 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:39:58.826567 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:39:58.826567 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:39:58.826567 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:39:58.826567 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:39:58.826567 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:39:58.826567 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:39:58.826567 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:39:58.826567 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:39:58.826567 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:39:58.826567 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:39:58.826567 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:39:58.826567 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:39:58.827396 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:39:58.827396 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:39:58.827396 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:39:58.827396 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:39:58.827396 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:39:58.827396 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:39:58.827396 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:39:58.827396 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:39:58.827396 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:39:58.827396 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:39:58.827396 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 17:39:58.827396 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:39:58.832614 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 198/400] 10.222.0.67 () {56 vars in 1114 bytes} [Thu Jul 14 17:39:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:39:58.837843 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb148b8-76c7-4838-8efa-40f0738be098 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:58.928562 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d57687-b2ee-42c9-a713-9e35979448a5 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:58.965450 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9507ebd-9284-4bec-9e2b-e7dbc45eac5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:58.966067 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9507ebd-9284-4bec-9e2b-e7dbc45eac5b None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:58.966423 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9507ebd-9284-4bec-9e2b-e7dbc45eac5b None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:58.966615 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9507ebd-9284-4bec-9e2b-e7dbc45eac5b None admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:58.967374 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9507ebd-9284-4bec-9e2b-e7dbc45eac5b None admin] RBAC: Adding query filter params (name=member) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:39:58.967678 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9507ebd-9284-4bec-9e2b-e7dbc45eac5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:58.969182 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9507ebd-9284-4bec-9e2b-e7dbc45eac5b None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:58.976788 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb148b8-76c7-4838-8efa-40f0738be098 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:58.983086 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 203/401] 10.222.0.67 () {56 vars in 1101 bytes} [Thu Jul 14 17:39:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:58.984668 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c3af53-cb41-448a-807a-98f17ff50616 None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:58.985466 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c3af53-cb41-448a-807a-98f17ff50616 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:58.985466 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c3af53-cb41-448a-807a-98f17ff50616 None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:58.992249 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 204/402] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:39:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:39:58.993219 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c3af53-cb41-448a-807a-98f17ff50616 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:59.009922 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:59.026543 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7407c415-e16f-49d3-bcbd-52c108bab65b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:59.027731 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407c415-e16f-49d3-bcbd-52c108bab65b None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:59.028190 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407c415-e16f-49d3-bcbd-52c108bab65b None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:59.028834 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407c415-e16f-49d3-bcbd-52c108bab65b None admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:59.030206 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7407c415-e16f-49d3-bcbd-52c108bab65b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:39:59.030897 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7407c415-e16f-49d3-bcbd-52c108bab65b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:59.032457 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7407c415-e16f-49d3-bcbd-52c108bab65b None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:59.034255 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:59.046569 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 199/403] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 14 17:39:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:39:59.048366 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd3b9d-a415-4bd0-a597-7f1f2e7efc0e None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:59.048795 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd3b9d-a415-4bd0-a597-7f1f2e7efc0e None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:59.049463 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd3b9d-a415-4bd0-a597-7f1f2e7efc0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:59.072721 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-edcd3b9d-a415-4bd0-a597-7f1f2e7efc0e None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:39:59.074132 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-edcd3b9d-a415-4bd0-a597-7f1f2e7efc0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:39:59.124429 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c3af53-cb41-448a-807a-98f17ff50616 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:59.157752 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 200/404] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:39:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:39:59.158820 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcd3b9d-a415-4bd0-a597-7f1f2e7efc0e None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:59.168056 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff00eba-9375-444c-996c-8d8f575d398a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:59.169095 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff00eba-9375-444c-996c-8d8f575d398a None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:59.169507 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff00eba-9375-444c-996c-8d8f575d398a None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:59.169946 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff00eba-9375-444c-996c-8d8f575d398a None admin] PATH_INFO: `/v3/groups/aef192fea03a488b8680b50d525fbfd5` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:59.178080 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff00eba-9375-444c-996c-8d8f575d398a None admin] RBAC: Authorizing `identity:get_group(group_id=aef192fea03a488b8680b50d525fbfd5)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:59.178080 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff00eba-9375-444c-996c-8d8f575d398a None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:59.178080 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 205/405] 10.222.0.67 () {56 vars in 1180 bytes} [Thu Jul 14 17:39:58 2022] GET /identity/v3/groups/aef192fea03a488b8680b50d525fbfd5 => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:59.184335 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff00eba-9375-444c-996c-8d8f575d398a None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:59.279137 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcd3b9d-a415-4bd0-a597-7f1f2e7efc0e None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:59.287397 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff00eba-9375-444c-996c-8d8f575d398a None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:59.288927 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:59.291331 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:59.319989 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bc4d35-2075-407a-833d-1b32a3dbe81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:59.321140 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc4d35-2075-407a-833d-1b32a3dbe81a None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:59.321520 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc4d35-2075-407a-833d-1b32a3dbe81a None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:59.321912 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc4d35-2075-407a-833d-1b32a3dbe81a None admin] PATH_INFO: `/v3/groups/aef192fea03a488b8680b50d525fbfd5` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:59.323343 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bc4d35-2075-407a-833d-1b32a3dbe81a None admin] RBAC: Authorizing `identity:get_group(group_id=aef192fea03a488b8680b50d525fbfd5)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:59.324975 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bc4d35-2075-407a-833d-1b32a3dbe81a None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:59.326618 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd4fec9-ae4a-491f-914c-0056481d425e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:59.327318 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 201/406] 10.222.0.67 () {56 vars in 1180 bytes} [Thu Jul 14 17:39:59 2022] GET /identity/v3/groups/aef192fea03a488b8680b50d525fbfd5 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:59.327824 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd4fec9-ae4a-491f-914c-0056481d425e None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:59.328239 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd4fec9-ae4a-491f-914c-0056481d425e None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:59.328348 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bc4d35-2075-407a-833d-1b32a3dbe81a None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:59.328734 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd4fec9-ae4a-491f-914c-0056481d425e None admin] PATH_INFO: `/v3/projects/67e4c4e8f5f441c5bc8f752c9db84352` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:59.330094 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd4fec9-ae4a-491f-914c-0056481d425e None admin] RBAC: Authorizing `identity:get_project(project_id=67e4c4e8f5f441c5bc8f752c9db84352)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:59.332048 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd4fec9-ae4a-491f-914c-0056481d425e None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:59.334775 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 206/407] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 14 17:39:59 2022] GET /identity/v3/projects/67e4c4e8f5f441c5bc8f752c9db84352 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:59.335756 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd4fec9-ae4a-491f-914c-0056481d425e None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:59.448361 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd4fec9-ae4a-491f-914c-0056481d425e None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:59.449201 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bc4d35-2075-407a-833d-1b32a3dbe81a None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:59.487018 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947ca6d9-e12f-44cb-be71-b1f60b449157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:59.488182 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947ca6d9-e12f-44cb-be71-b1f60b449157 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:59.488605 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947ca6d9-e12f-44cb-be71-b1f60b449157 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:59.488864 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecaa469-fedd-4d28-a9c9-529d7574dc44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:59.489236 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947ca6d9-e12f-44cb-be71-b1f60b449157 None admin] PATH_INFO: `/v3/projects/67e4c4e8f5f441c5bc8f752c9db84352` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:59.489940 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecaa469-fedd-4d28-a9c9-529d7574dc44 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:59.490315 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecaa469-fedd-4d28-a9c9-529d7574dc44 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:59.490687 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecaa469-fedd-4d28-a9c9-529d7574dc44 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:59.490997 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947ca6d9-e12f-44cb-be71-b1f60b449157 None admin] RBAC: Authorizing `identity:get_project(project_id=67e4c4e8f5f441c5bc8f752c9db84352)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:59.492827 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947ca6d9-e12f-44cb-be71-b1f60b449157 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:59.495218 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 207/408] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 14 17:39:59 2022] GET /identity/v3/projects/67e4c4e8f5f441c5bc8f752c9db84352 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:59.496242 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947ca6d9-e12f-44cb-be71-b1f60b449157 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:59.503769 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecaa469-fedd-4d28-a9c9-529d7574dc44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:39:59.513036 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-5ecaa469-fedd-4d28-a9c9-529d7574dc44 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 17:39:59.513036 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:39:59.513036 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:39:59.513036 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:39:59.513036 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:39:59.513036 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:39:59.513036 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:39:59.513036 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:39:59.513036 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:39:59.513036 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:39:59.513036 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:39:59.513036 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:39:59.513036 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:39:59.513036 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:39:59.513036 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:39:59.513036 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:39:59.514174 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:39:59.514174 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:39:59.514174 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:39:59.514174 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:39:59.514174 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:39:59.514174 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:39:59.514174 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:39:59.514174 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:39:59.514174 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:39:59.514174 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:39:59.514174 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:39:59.514174 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:39:59.514174 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:39:59.514174 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:39:59.514174 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:39:59.514174 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:39:59.514982 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:39:59.514982 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:39:59.514982 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:39:59.514982 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:39:59.514982 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:39:59.514982 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:39:59.514982 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:39:59.514982 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:39:59.514982 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:39:59.514982 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:39:59.514982 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 17:39:59.514982 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:39:59.514982 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 202/409] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 14 17:39:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:39:59.515658 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecaa469-fedd-4d28-a9c9-529d7574dc44 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:59.545295 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:59.562867 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:59.612089 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947ca6d9-e12f-44cb-be71-b1f60b449157 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:59.643850 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecaa469-fedd-4d28-a9c9-529d7574dc44 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:59.649911 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1300d3-39d2-466a-9a11-a6d4cb605498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:59.650889 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1300d3-39d2-466a-9a11-a6d4cb605498 None admin] REQUEST_METHOD: `PUT` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:59.651238 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1300d3-39d2-466a-9a11-a6d4cb605498 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:59.651637 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1300d3-39d2-466a-9a11-a6d4cb605498 None admin] PATH_INFO: `/v3/projects/67e4c4e8f5f441c5bc8f752c9db84352/groups/aef192fea03a488b8680b50d525fbfd5/roles/95d753870f97426cb1ce32e078621a4c` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:59.654150 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1300d3-39d2-466a-9a11-a6d4cb605498 None admin] RBAC: Authorizing `identity:create_grant(project_id=67e4c4e8f5f441c5bc8f752c9db84352, group_id=aef192fea03a488b8680b50d525fbfd5, role_id=95d753870f97426cb1ce32e078621a4c)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:59.655676 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1300d3-39d2-466a-9a11-a6d4cb605498 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:59.671231 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 208/410] 10.222.0.67 () {58 vars in 1442 bytes} [Thu Jul 14 17:39:59 2022] PUT /identity/v3/projects/67e4c4e8f5f441c5bc8f752c9db84352/groups/aef192fea03a488b8680b50d525fbfd5/roles/95d753870f97426cb1ce32e078621a4c => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:39:59.677462 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1300d3-39d2-466a-9a11-a6d4cb605498 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:59.688220 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57833416-6124-4482-b27e-b90a14629f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:59.689492 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57833416-6124-4482-b27e-b90a14629f5b None admin] REQUEST_METHOD: `PUT` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:59.690014 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57833416-6124-4482-b27e-b90a14629f5b None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:59.690459 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57833416-6124-4482-b27e-b90a14629f5b None admin] PATH_INFO: `/v3/projects/67e4c4e8f5f441c5bc8f752c9db84352/groups/aef192fea03a488b8680b50d525fbfd5/roles/fa9b6b80eda3440ca058cb77bd7f8f5c` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:59.693845 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57833416-6124-4482-b27e-b90a14629f5b None admin] RBAC: Authorizing `identity:create_grant(project_id=67e4c4e8f5f441c5bc8f752c9db84352, group_id=aef192fea03a488b8680b50d525fbfd5, role_id=fa9b6b80eda3440ca058cb77bd7f8f5c)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:59.696319 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57833416-6124-4482-b27e-b90a14629f5b None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:59.720201 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 203/411] 10.222.0.67 () {58 vars in 1442 bytes} [Thu Jul 14 17:39:59 2022] PUT /identity/v3/projects/67e4c4e8f5f441c5bc8f752c9db84352/groups/aef192fea03a488b8680b50d525fbfd5/roles/fa9b6b80eda3440ca058cb77bd7f8f5c => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:39:59.866660 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:39:59.873442 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1300d3-39d2-466a-9a11-a6d4cb605498 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:39:59.931488 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01affc43-a98c-4ed9-952b-15c7301e948b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:39:59.932239 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01affc43-a98c-4ed9-952b-15c7301e948b None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:59.932522 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01affc43-a98c-4ed9-952b-15c7301e948b None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:59.932792 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01affc43-a98c-4ed9-952b-15c7301e948b None admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:59.933572 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01affc43-a98c-4ed9-952b-15c7301e948b None admin] RBAC: Adding query filter params (name=admin) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:39:59.933883 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01affc43-a98c-4ed9-952b-15c7301e948b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:39:59.935290 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01affc43-a98c-4ed9-952b-15c7301e948b None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:39:59.947281 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 209/412] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 14 17:39:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:39:59.953461 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57833416-6124-4482-b27e-b90a14629f5b None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:39:59.990861 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ff8f7-bd82-49c5-bea6-209ad4b4ea9c None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:39:59.991139 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ff8f7-bd82-49c5-bea6-209ad4b4ea9c None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:39:59.991787 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ff8f7-bd82-49c5-bea6-209ad4b4ea9c None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:39:59.993293 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 210/413] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:39:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 17:40:00.001849 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7efdf00-ff48-447c-b894-3e4aeb82a005 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:00.002175 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7efdf00-ff48-447c-b894-3e4aeb82a005 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:00.002415 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7efdf00-ff48-447c-b894-3e4aeb82a005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:00.024836 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-d7efdf00-ff48-447c-b894-3e4aeb82a005 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:40:00.026059 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-d7efdf00-ff48-447c-b894-3e4aeb82a005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:40:00.126833 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:00.140864 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57833416-6124-4482-b27e-b90a14629f5b None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:00.165177 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 211/414] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:40:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 17:40:00.245560 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a02ed8e-3a60-47a5-bdf0-875c59e313a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:00.247128 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a02ed8e-3a60-47a5-bdf0-875c59e313a6 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:00.247668 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a02ed8e-3a60-47a5-bdf0-875c59e313a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:00.248310 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a02ed8e-3a60-47a5-bdf0-875c59e313a6 None admin] PATH_INFO: `/v3/groups/262d6ae41af7485d86f744c428300f25` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:00.253248 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a02ed8e-3a60-47a5-bdf0-875c59e313a6 None admin] RBAC: Authorizing `identity:get_group(group_id=262d6ae41af7485d86f744c428300f25)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:00.256559 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a02ed8e-3a60-47a5-bdf0-875c59e313a6 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:00.259934 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 204/415] 10.222.0.67 () {56 vars in 1180 bytes} [Thu Jul 14 17:39:59 2022] GET /identity/v3/groups/262d6ae41af7485d86f744c428300f25 => generated 229 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:00.268214 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7efdf00-ff48-447c-b894-3e4aeb82a005 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:00.281928 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a02ed8e-3a60-47a5-bdf0-875c59e313a6 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:00.447898 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:00.481461 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7efdf00-ff48-447c-b894-3e4aeb82a005 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:00.557556 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a02ed8e-3a60-47a5-bdf0-875c59e313a6 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:00.573020 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511ceab4-85c6-4407-b33f-d4217de07454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:00.574348 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511ceab4-85c6-4407-b33f-d4217de07454 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:00.574841 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511ceab4-85c6-4407-b33f-d4217de07454 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:00.575339 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511ceab4-85c6-4407-b33f-d4217de07454 None admin] PATH_INFO: `/v3/projects/cbe4032be1b14bfe82df97ec9e98e7c0` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:00.580792 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511ceab4-85c6-4407-b33f-d4217de07454 None admin] RBAC: Authorizing `identity:get_project(project_id=cbe4032be1b14bfe82df97ec9e98e7c0)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:00.582654 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511ceab4-85c6-4407-b33f-d4217de07454 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:00.585269 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 212/416] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 14 17:40:00 2022] GET /identity/v3/projects/cbe4032be1b14bfe82df97ec9e98e7c0 => generated 344 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:40:00.593908 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511ceab4-85c6-4407-b33f-d4217de07454 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:00.634274 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c04d71-afb1-406c-b392-c17452102e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:00.635103 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c04d71-afb1-406c-b392-c17452102e4c None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:00.635383 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c04d71-afb1-406c-b392-c17452102e4c None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:00.635662 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c04d71-afb1-406c-b392-c17452102e4c None admin] PATH_INFO: `/v3/roles/member` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:00.681359 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c04d71-afb1-406c-b392-c17452102e4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:40:00.704651 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-33c04d71-afb1-406c-b392-c17452102e4c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 17:40:00.704651 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:00.704651 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:00.704651 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:00.704651 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:00.704651 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:00.704651 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:00.704651 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:00.704651 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:00.704651 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:00.704651 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:00.704651 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:00.704651 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:40:00.704651 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:40:00.704651 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:40:00.704651 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:40:00.706545 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:40:00.706545 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:40:00.706545 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:40:00.706545 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:40:00.706545 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:00.706545 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:00.706545 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:00.706545 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:00.706545 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:00.706545 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:00.706545 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:00.706545 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:00.706545 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:00.706545 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:00.706545 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:00.706545 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:00.708279 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:00.708279 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:00.708279 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:00.708279 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:00.708279 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:40:00.708279 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:40:00.708279 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:40:00.708279 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:40:00.708279 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:40:00.708279 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:40:00.708279 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 17:40:00.708279 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:40:00.713929 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 205/417] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 14 17:40:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 433 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:00.716698 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112fbe0a-c2ed-4abc-aea5-180397cf7328 None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:00.717497 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112fbe0a-c2ed-4abc-aea5-180397cf7328 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:00.718244 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112fbe0a-c2ed-4abc-aea5-180397cf7328 None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:00.721485 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 206/418] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:40:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:40:00.723298 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112fbe0a-c2ed-4abc-aea5-180397cf7328 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:00.778007 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:00.778816 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511ceab4-85c6-4407-b33f-d4217de07454 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:00.819528 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f1f1de-e959-4568-b179-114af63d7611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:00.820717 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f1f1de-e959-4568-b179-114af63d7611 None admin] REQUEST_METHOD: `PUT` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:00.821082 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f1f1de-e959-4568-b179-114af63d7611 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:00.821434 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f1f1de-e959-4568-b179-114af63d7611 None admin] PATH_INFO: `/v3/projects/cbe4032be1b14bfe82df97ec9e98e7c0/groups/262d6ae41af7485d86f744c428300f25/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:00.824004 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f1f1de-e959-4568-b179-114af63d7611 None admin] RBAC: Authorizing `identity:create_grant(project_id=cbe4032be1b14bfe82df97ec9e98e7c0, group_id=262d6ae41af7485d86f744c428300f25, role_id=4651a1cc7b4d4ab7a7a9ca1e77e58e71)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:00.825586 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f1f1de-e959-4568-b179-114af63d7611 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:00.847049 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 213/419] 10.222.0.67 () {58 vars in 1442 bytes} [Thu Jul 14 17:40:00 2022] PUT /identity/v3/projects/cbe4032be1b14bfe82df97ec9e98e7c0/groups/262d6ae41af7485d86f744c428300f25/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 17:40:00.848197 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def31424-4189-44a7-87dd-a28ea2396e00 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:00.848556 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def31424-4189-44a7-87dd-a28ea2396e00 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:00.848901 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def31424-4189-44a7-87dd-a28ea2396e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:00.877464 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-def31424-4189-44a7-87dd-a28ea2396e00 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:40:00.881639 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-def31424-4189-44a7-87dd-a28ea2396e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:40:00.929175 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:00.967016 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112fbe0a-c2ed-4abc-aea5-180397cf7328 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:01.044969 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569d481b-c959-4973-84b3-0fd79cf51460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:01.047329 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d481b-c959-4973-84b3-0fd79cf51460 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:01.048037 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d481b-c959-4973-84b3-0fd79cf51460 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:01.049140 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d481b-c959-4973-84b3-0fd79cf51460 None admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:01.051083 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569d481b-c959-4973-84b3-0fd79cf51460 None admin] RBAC: Adding query filter params (name=member) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:01.051819 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569d481b-c959-4973-84b3-0fd79cf51460 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:01.055130 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569d481b-c959-4973-84b3-0fd79cf51460 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:01.073983 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 207/420] 10.222.0.67 () {56 vars in 1101 bytes} [Thu Jul 14 17:40:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:01.080217 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569d481b-c959-4973-84b3-0fd79cf51460 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:01.090911 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 214/421] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:40:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:40:01.113427 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def31424-4189-44a7-87dd-a28ea2396e00 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:01.188354 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:01.215823 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569d481b-c959-4973-84b3-0fd79cf51460 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:01.260662 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d813c81-2451-4f30-91e9-b4ed0c964281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:01.263112 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d813c81-2451-4f30-91e9-b4ed0c964281 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:01.263545 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d813c81-2451-4f30-91e9-b4ed0c964281 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:01.264205 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d813c81-2451-4f30-91e9-b4ed0c964281 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:01.287270 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def31424-4189-44a7-87dd-a28ea2396e00 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:01.367653 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829759ad-66a8-47d0-a3cd-0a124cbe473e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:01.368500 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829759ad-66a8-47d0-a3cd-0a124cbe473e None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:01.368845 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829759ad-66a8-47d0-a3cd-0a124cbe473e None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:01.369121 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829759ad-66a8-47d0-a3cd-0a124cbe473e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:01.393902 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829759ad-66a8-47d0-a3cd-0a124cbe473e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:40:01.408767 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-829759ad-66a8-47d0-a3cd-0a124cbe473e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 17:40:01.408767 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:01.408767 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:01.408767 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:01.408767 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:01.408767 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:01.408767 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:01.408767 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:01.408767 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:01.408767 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:01.408767 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:01.408767 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:01.408767 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:40:01.408767 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:40:01.408767 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:40:01.408767 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:40:01.409755 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:40:01.409755 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:40:01.409755 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:40:01.409755 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:40:01.409755 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:01.409755 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:01.409755 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:01.409755 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:01.409755 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:01.409755 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:01.409755 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:01.409755 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:01.409755 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:01.409755 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:01.409755 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:01.409755 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:01.411068 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:01.411068 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:01.411068 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:01.411068 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:01.411068 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:40:01.411068 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:40:01.411068 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:40:01.411068 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:40:01.411068 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:40:01.411068 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:40:01.411068 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 17:40:01.411068 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:40:01.411068 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 215/422] 10.222.0.67 () {56 vars in 1114 bytes} [Thu Jul 14 17:40:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 17:40:01.411786 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d813c81-2451-4f30-91e9-b4ed0c964281 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:01.418533 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d813c81-2451-4f30-91e9-b4ed0c964281 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:01.421815 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829759ad-66a8-47d0-a3cd-0a124cbe473e None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:01.447025 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:01.576178 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:01.594748 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 208/423] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 14 17:40:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 17:40:01.598679 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829759ad-66a8-47d0-a3cd-0a124cbe473e None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:01.602532 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d813c81-2451-4f30-91e9-b4ed0c964281 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:01.641395 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ffb6ca-91e6-41bb-9062-a6104aa98ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:01.642110 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ffb6ca-91e6-41bb-9062-a6104aa98ccb None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:01.642400 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ffb6ca-91e6-41bb-9062-a6104aa98ccb None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:01.642679 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ffb6ca-91e6-41bb-9062-a6104aa98ccb None admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:01.643436 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ffb6ca-91e6-41bb-9062-a6104aa98ccb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:01.643745 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ffb6ca-91e6-41bb-9062-a6104aa98ccb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:01.645145 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ffb6ca-91e6-41bb-9062-a6104aa98ccb None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:01.654582 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 216/424] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 14 17:40:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:01.659978 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ffb6ca-91e6-41bb-9062-a6104aa98ccb None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:01.734192 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:01.775298 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ffb6ca-91e6-41bb-9062-a6104aa98ccb None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:01.837051 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d813c81-2451-4f30-91e9-b4ed0c964281 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:01.848502 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b18f0d3-1b1c-4498-acd5-8389513306d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:01.849711 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b18f0d3-1b1c-4498-acd5-8389513306d0 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:01.849992 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b18f0d3-1b1c-4498-acd5-8389513306d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:01.850267 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b18f0d3-1b1c-4498-acd5-8389513306d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:01.887473 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355cf5a0-0f0a-4ada-88e7-81ee4eca4b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:01.888348 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355cf5a0-0f0a-4ada-88e7-81ee4eca4b5b None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:01.888629 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355cf5a0-0f0a-4ada-88e7-81ee4eca4b5b None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:01.888904 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355cf5a0-0f0a-4ada-88e7-81ee4eca4b5b None admin] PATH_INFO: `/v3/projects/44c7c7b4ddec44b48803f27448a16a78` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:01.890250 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355cf5a0-0f0a-4ada-88e7-81ee4eca4b5b None admin] RBAC: Authorizing `identity:get_project(project_id=44c7c7b4ddec44b48803f27448a16a78)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:01.891709 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355cf5a0-0f0a-4ada-88e7-81ee4eca4b5b None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:01.893947 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 209/425] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 14 17:40:01 2022] GET /identity/v3/projects/44c7c7b4ddec44b48803f27448a16a78 => generated 298 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:01.899458 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355cf5a0-0f0a-4ada-88e7-81ee4eca4b5b None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:01.939400 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b18f0d3-1b1c-4498-acd5-8389513306d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:01.941072 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b18f0d3-1b1c-4498-acd5-8389513306d0 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:01.961924 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:02.006152 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355cf5a0-0f0a-4ada-88e7-81ee4eca4b5b None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:02.039295 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:02.043839 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b836cd56-afc4-4127-a5f6-92811036a114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:02.044766 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b836cd56-afc4-4127-a5f6-92811036a114 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:02.045048 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b836cd56-afc4-4127-a5f6-92811036a114 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:02.045321 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b836cd56-afc4-4127-a5f6-92811036a114 None admin] PATH_INFO: `/v3/groups/aef192fea03a488b8680b50d525fbfd5` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:02.047554 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b836cd56-afc4-4127-a5f6-92811036a114 None admin] RBAC: Authorizing `identity:get_group(group_id=aef192fea03a488b8680b50d525fbfd5)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:02.049128 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b836cd56-afc4-4127-a5f6-92811036a114 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:02.051176 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 210/426] 10.222.0.67 () {56 vars in 1180 bytes} [Thu Jul 14 17:40:01 2022] GET /identity/v3/groups/aef192fea03a488b8680b50d525fbfd5 => generated 226 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:02.052958 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b1012b-da98-4ddb-ac62-b70078d5644d None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:02.057823 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b1012b-da98-4ddb-ac62-b70078d5644d None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:02.058139 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b1012b-da98-4ddb-ac62-b70078d5644d None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:02.059718 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 211/427] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:40:02 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:40:02.061991 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b1012b-da98-4ddb-ac62-b70078d5644d None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:02.078980 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 217/428] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 14 17:40:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 17:40:02.084969 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc9d78-f35c-4b46-8dbc-62a26f6c177e None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:02.085267 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc9d78-f35c-4b46-8dbc-62a26f6c177e None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:02.085567 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc9d78-f35c-4b46-8dbc-62a26f6c177e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:02.104103 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-e9bc9d78-f35c-4b46-8dbc-62a26f6c177e None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:40:02.105423 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-e9bc9d78-f35c-4b46-8dbc-62a26f6c177e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:40:02.177095 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b1012b-da98-4ddb-ac62-b70078d5644d None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:02.186338 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 218/429] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:40:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:40:02.187274 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bc9d78-f35c-4b46-8dbc-62a26f6c177e None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:02.216639 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:02.238395 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775fe997-9b92-4b42-9497-d8577de54957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:02.239165 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775fe997-9b92-4b42-9497-d8577de54957 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:02.239515 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775fe997-9b92-4b42-9497-d8577de54957 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:02.239889 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775fe997-9b92-4b42-9497-d8577de54957 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:02.240841 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775fe997-9b92-4b42-9497-d8577de54957 None admin] RBAC: Adding query filter params (group.id=aef192fea03a488b8680b50d525fbfd5, role.id=95d753870f97426cb1ce32e078621a4c, scope.project.id=44c7c7b4ddec44b48803f27448a16a78) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:02.241213 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775fe997-9b92-4b42-9497-d8577de54957 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:02.243014 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775fe997-9b92-4b42-9497-d8577de54957 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:02.249890 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 212/430] 10.222.0.67 () {56 vars in 1376 bytes} [Thu Jul 14 17:40:02 2022] GET /identity/v3/role_assignments?group.id=aef192fea03a488b8680b50d525fbfd5&scope.project.id=44c7c7b4ddec44b48803f27448a16a78&role.id=95d753870f97426cb1ce32e078621a4c => generated 611 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:02.258513 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775fe997-9b92-4b42-9497-d8577de54957 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:02.327842 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:02.332072 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bc9d78-f35c-4b46-8dbc-62a26f6c177e None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:02.378691 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473ff75e-e5ce-4ffe-94bf-118285eb04ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:02.379615 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ff75e-e5ce-4ffe-94bf-118285eb04ac None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:02.379897 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ff75e-e5ce-4ffe-94bf-118285eb04ac None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:02.380174 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ff75e-e5ce-4ffe-94bf-118285eb04ac None admin] PATH_INFO: `/v3/projects/44c7c7b4ddec44b48803f27448a16a78` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:02.382089 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473ff75e-e5ce-4ffe-94bf-118285eb04ac None admin] RBAC: Authorizing `identity:get_project(project_id=44c7c7b4ddec44b48803f27448a16a78)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:02.384238 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473ff75e-e5ce-4ffe-94bf-118285eb04ac None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:02.386860 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 219/431] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 14 17:40:02 2022] GET /identity/v3/projects/44c7c7b4ddec44b48803f27448a16a78 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:02.392197 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473ff75e-e5ce-4ffe-94bf-118285eb04ac None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:02.508106 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775fe997-9b92-4b42-9497-d8577de54957 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:02.547007 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3710476-ee1d-4a3e-ba2f-8e341e9eb130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:02.547812 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3710476-ee1d-4a3e-ba2f-8e341e9eb130 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:02.548102 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3710476-ee1d-4a3e-ba2f-8e341e9eb130 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:02.548374 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3710476-ee1d-4a3e-ba2f-8e341e9eb130 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:02.555357 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473ff75e-e5ce-4ffe-94bf-118285eb04ac None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:02.560127 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3710476-ee1d-4a3e-ba2f-8e341e9eb130 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:40:02.568700 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-a3710476-ee1d-4a3e-ba2f-8e341e9eb130 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 17:40:02.568700 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:02.568700 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:02.568700 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:02.568700 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:02.568700 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:02.568700 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:02.568700 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:02.568700 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:02.568700 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:02.568700 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:02.568700 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:02.568700 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:40:02.568700 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:40:02.568700 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:40:02.568700 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:40:02.569656 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:40:02.569656 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:40:02.569656 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:40:02.569656 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:40:02.569656 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:02.569656 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:02.569656 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:02.569656 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:02.569656 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:02.569656 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:02.569656 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:02.569656 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:02.569656 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:02.569656 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:02.569656 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:02.569656 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:02.570499 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:02.570499 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:02.570499 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:02.570499 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:02.570499 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:40:02.570499 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:40:02.570499 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:40:02.570499 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:40:02.570499 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:40:02.570499 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:40:02.570499 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 17:40:02.570499 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:40:02.570499 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 213/432] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 14 17:40:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:02.571407 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa1a005-e94b-44a9-98ea-5125af63c84f None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:02.571981 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa1a005-e94b-44a9-98ea-5125af63c84f None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:02.571981 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa1a005-e94b-44a9-98ea-5125af63c84f None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:02.573260 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 214/433] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:40:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:40:02.578805 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa1a005-e94b-44a9-98ea-5125af63c84f None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:02.606477 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e48f3cb-26b2-4b12-98c7-af4ce2a32023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:02.607349 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e48f3cb-26b2-4b12-98c7-af4ce2a32023 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:02.607628 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e48f3cb-26b2-4b12-98c7-af4ce2a32023 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:02.608000 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e48f3cb-26b2-4b12-98c7-af4ce2a32023 None admin] PATH_INFO: `/v3/groups/aef192fea03a488b8680b50d525fbfd5` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:02.610402 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e48f3cb-26b2-4b12-98c7-af4ce2a32023 None admin] RBAC: Authorizing `identity:get_group(group_id=aef192fea03a488b8680b50d525fbfd5)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:02.612665 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e48f3cb-26b2-4b12-98c7-af4ce2a32023 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:02.614724 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 220/434] 10.222.0.67 () {56 vars in 1180 bytes} [Thu Jul 14 17:40:02 2022] GET /identity/v3/groups/aef192fea03a488b8680b50d525fbfd5 => generated 226 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:02.621718 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de072009-e76e-4f65-bbe4-2c66bb2ca3dc None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:02.621949 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de072009-e76e-4f65-bbe4-2c66bb2ca3dc None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:02.629303 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de072009-e76e-4f65-bbe4-2c66bb2ca3dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:02.634605 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:02.645201 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-de072009-e76e-4f65-bbe4-2c66bb2ca3dc None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:40:02.646484 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-de072009-e76e-4f65-bbe4-2c66bb2ca3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:40:02.682731 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:02.715550 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa1a005-e94b-44a9-98ea-5125af63c84f None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:02.736061 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 221/435] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:40:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:40:02.736378 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de072009-e76e-4f65-bbe4-2c66bb2ca3dc None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:02.768491 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71491047-d8b7-4eea-8c9c-2d0703ec5d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:02.768491 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71491047-d8b7-4eea-8c9c-2d0703ec5d04 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:02.768491 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71491047-d8b7-4eea-8c9c-2d0703ec5d04 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:02.768491 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71491047-d8b7-4eea-8c9c-2d0703ec5d04 None admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:02.768952 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71491047-d8b7-4eea-8c9c-2d0703ec5d04 None admin] RBAC: Adding query filter params (name=member) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:02.769038 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71491047-d8b7-4eea-8c9c-2d0703ec5d04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:02.773948 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71491047-d8b7-4eea-8c9c-2d0703ec5d04 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:02.780113 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 215/436] 10.222.0.67 () {56 vars in 1101 bytes} [Thu Jul 14 17:40:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:02.780796 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71491047-d8b7-4eea-8c9c-2d0703ec5d04 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:02.880684 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de072009-e76e-4f65-bbe4-2c66bb2ca3dc None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:02.909967 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71491047-d8b7-4eea-8c9c-2d0703ec5d04 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:02.918606 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:02.930002 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d99a4d-63fd-4e5a-87e1-04907f41e11a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:02.930666 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d99a4d-63fd-4e5a-87e1-04907f41e11a None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:02.930947 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d99a4d-63fd-4e5a-87e1-04907f41e11a None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:02.931223 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d99a4d-63fd-4e5a-87e1-04907f41e11a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:02.932068 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d99a4d-63fd-4e5a-87e1-04907f41e11a None admin] RBAC: Adding query filter params (group.id=aef192fea03a488b8680b50d525fbfd5, role.id=fa9b6b80eda3440ca058cb77bd7f8f5c, scope.project.id=44c7c7b4ddec44b48803f27448a16a78) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:02.932377 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d99a4d-63fd-4e5a-87e1-04907f41e11a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:02.933864 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d99a4d-63fd-4e5a-87e1-04907f41e11a None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:02.939999 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 222/437] 10.222.0.67 () {56 vars in 1376 bytes} [Thu Jul 14 17:40:02 2022] GET /identity/v3/role_assignments?group.id=aef192fea03a488b8680b50d525fbfd5&scope.project.id=44c7c7b4ddec44b48803f27448a16a78&role.id=fa9b6b80eda3440ca058cb77bd7f8f5c => generated 611 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:02.940813 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d99a4d-63fd-4e5a-87e1-04907f41e11a None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:02.965179 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e06f12d-6304-400f-af99-0fc449d42621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:02.966149 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e06f12d-6304-400f-af99-0fc449d42621 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:02.966462 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e06f12d-6304-400f-af99-0fc449d42621 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:02.966982 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e06f12d-6304-400f-af99-0fc449d42621 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:02.980645 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e06f12d-6304-400f-af99-0fc449d42621 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:40:02.983201 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:02.992587 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-2e06f12d-6304-400f-af99-0fc449d42621 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 17:40:02.992587 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:02.992587 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:02.992587 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:02.992587 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:02.992587 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:02.992587 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:02.992587 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:02.992587 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:02.992587 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:02.992587 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:02.992587 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:02.992587 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:40:02.992587 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:40:02.992587 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:40:02.992587 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:40:02.993630 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:40:02.993630 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:40:02.993630 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:40:02.993630 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:40:02.993630 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:02.993630 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:02.993630 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:02.993630 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:02.993630 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:02.993630 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:02.993630 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:02.993630 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:02.993630 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:02.993630 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:02.993630 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:02.993630 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:02.994444 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:02.994444 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:02.994444 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:02.994444 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:02.994444 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:40:02.994444 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:40:02.994444 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:40:02.994444 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:40:02.994444 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:40:02.994444 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:40:02.994444 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 17:40:02.994444 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:40:02.994444 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 216/438] 10.222.0.67 () {56 vars in 1114 bytes} [Thu Jul 14 17:40:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:03.003956 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e06f12d-6304-400f-af99-0fc449d42621 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:03.071879 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d99a4d-63fd-4e5a-87e1-04907f41e11a None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:03.111504 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b99bdb-f81c-41e4-bbf6-ee82d6df9d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:03.112183 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b99bdb-f81c-41e4-bbf6-ee82d6df9d6f None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:03.112465 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b99bdb-f81c-41e4-bbf6-ee82d6df9d6f None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:03.112743 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b99bdb-f81c-41e4-bbf6-ee82d6df9d6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:03.145476 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e06f12d-6304-400f-af99-0fc449d42621 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:03.188102 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ace3e5-ba81-435b-8503-826da04ac96b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:03.188795 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ace3e5-ba81-435b-8503-826da04ac96b None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:03.189079 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ace3e5-ba81-435b-8503-826da04ac96b None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:03.189363 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ace3e5-ba81-435b-8503-826da04ac96b None admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:03.190170 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ace3e5-ba81-435b-8503-826da04ac96b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:03.190476 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ace3e5-ba81-435b-8503-826da04ac96b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:03.191864 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ace3e5-ba81-435b-8503-826da04ac96b None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:03.192784 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b99bdb-f81c-41e4-bbf6-ee82d6df9d6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:03.195020 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b99bdb-f81c-41e4-bbf6-ee82d6df9d6f None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:03.207764 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 217/439] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 14 17:40:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:03.214028 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ace3e5-ba81-435b-8503-826da04ac96b None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:03.236219 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:03.248813 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:03.329710 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 223/440] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 14 17:40:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 17:40:03.331480 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510538bf-6517-407d-b82f-6721cb6db758 None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:03.331981 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510538bf-6517-407d-b82f-6721cb6db758 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:03.332436 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510538bf-6517-407d-b82f-6721cb6db758 None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:03.334388 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 224/441] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:40:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:40:03.336086 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510538bf-6517-407d-b82f-6721cb6db758 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:03.369195 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ace3e5-ba81-435b-8503-826da04ac96b None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:03.414560 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d7292b-b7d2-4d81-bbaa-4732bc780267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:03.415837 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d7292b-b7d2-4d81-bbaa-4732bc780267 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:03.416345 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d7292b-b7d2-4d81-bbaa-4732bc780267 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:03.416851 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d7292b-b7d2-4d81-bbaa-4732bc780267 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:03.467552 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510538bf-6517-407d-b82f-6721cb6db758 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:03.487430 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d7292b-b7d2-4d81-bbaa-4732bc780267 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:03.488973 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d7292b-b7d2-4d81-bbaa-4732bc780267 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:03.497557 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:03.503936 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff23c01-48d7-424e-a469-2ffa10098900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:03.504793 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff23c01-48d7-424e-a469-2ffa10098900 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:03.505068 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff23c01-48d7-424e-a469-2ffa10098900 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:03.505339 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff23c01-48d7-424e-a469-2ffa10098900 None admin] PATH_INFO: `/v3/projects/67e4c4e8f5f441c5bc8f752c9db84352` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:03.506571 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff23c01-48d7-424e-a469-2ffa10098900 None admin] RBAC: Authorizing `identity:get_project(project_id=67e4c4e8f5f441c5bc8f752c9db84352)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:03.508066 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff23c01-48d7-424e-a469-2ffa10098900 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:03.509798 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 225/442] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 14 17:40:03 2022] GET /identity/v3/projects/67e4c4e8f5f441c5bc8f752c9db84352 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:03.510959 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f58c0-9370-4f27-9e77-6403920505b1 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:03.511242 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f58c0-9370-4f27-9e77-6403920505b1 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:03.511513 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f58c0-9370-4f27-9e77-6403920505b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:03.518122 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:03.528066 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-f85f58c0-9370-4f27-9e77-6403920505b1 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:40:03.529555 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-f85f58c0-9370-4f27-9e77-6403920505b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:40:03.597190 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 226/443] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:40:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:40:03.598061 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85f58c0-9370-4f27-9e77-6403920505b1 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:03.609095 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 218/444] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 14 17:40:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 17:40:03.614329 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d7292b-b7d2-4d81-bbaa-4732bc780267 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:03.702018 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85f58c0-9370-4f27-9e77-6403920505b1 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:03.713960 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d7292b-b7d2-4d81-bbaa-4732bc780267 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:03.741070 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:03.744646 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:03.750532 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a77f66-937d-4514-b974-5e29b21a4432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:03.751422 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a77f66-937d-4514-b974-5e29b21a4432 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:03.751699 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a77f66-937d-4514-b974-5e29b21a4432 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:03.751972 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a77f66-937d-4514-b974-5e29b21a4432 None admin] PATH_INFO: `/v3/groups/aef192fea03a488b8680b50d525fbfd5` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:03.753227 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a77f66-937d-4514-b974-5e29b21a4432 None admin] RBAC: Authorizing `identity:get_group(group_id=aef192fea03a488b8680b50d525fbfd5)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:03.754236 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f425af-f8fa-4974-a2b8-cb2f25286d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:03.754795 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a77f66-937d-4514-b974-5e29b21a4432 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:03.755118 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f425af-f8fa-4974-a2b8-cb2f25286d0d None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:03.755394 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f425af-f8fa-4974-a2b8-cb2f25286d0d None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:03.755893 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f425af-f8fa-4974-a2b8-cb2f25286d0d None admin] PATH_INFO: `/v3/projects/67e4c4e8f5f441c5bc8f752c9db84352` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:03.756552 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 227/445] 10.222.0.67 () {56 vars in 1180 bytes} [Thu Jul 14 17:40:03 2022] GET /identity/v3/groups/aef192fea03a488b8680b50d525fbfd5 => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:03.756958 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f425af-f8fa-4974-a2b8-cb2f25286d0d None admin] RBAC: Authorizing `identity:get_project(project_id=67e4c4e8f5f441c5bc8f752c9db84352)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:03.757347 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a77f66-937d-4514-b974-5e29b21a4432 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:03.758536 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f425af-f8fa-4974-a2b8-cb2f25286d0d None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:03.760338 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 219/446] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 14 17:40:03 2022] GET /identity/v3/projects/67e4c4e8f5f441c5bc8f752c9db84352 => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:40:03.762528 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f425af-f8fa-4974-a2b8-cb2f25286d0d None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:03.865405 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a77f66-937d-4514-b974-5e29b21a4432 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:03.869056 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f425af-f8fa-4974-a2b8-cb2f25286d0d None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:03.901181 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec289e5-be11-4a49-84bb-e140566e4bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:03.902018 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec289e5-be11-4a49-84bb-e140566e4bc2 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:03.902270 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec289e5-be11-4a49-84bb-e140566e4bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:03.902542 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec289e5-be11-4a49-84bb-e140566e4bc2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:03.904380 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e603a9c-c875-4db6-ba96-e0d87f406c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:03.905030 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e603a9c-c875-4db6-ba96-e0d87f406c5e None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:03.905310 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e603a9c-c875-4db6-ba96-e0d87f406c5e None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:03.905613 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e603a9c-c875-4db6-ba96-e0d87f406c5e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:03.906447 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e603a9c-c875-4db6-ba96-e0d87f406c5e None admin] RBAC: Adding query filter params (group.id=aef192fea03a488b8680b50d525fbfd5, role.id=95d753870f97426cb1ce32e078621a4c, scope.project.id=67e4c4e8f5f441c5bc8f752c9db84352) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:03.906754 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e603a9c-c875-4db6-ba96-e0d87f406c5e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:03.908181 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e603a9c-c875-4db6-ba96-e0d87f406c5e None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:03.913194 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec289e5-be11-4a49-84bb-e140566e4bc2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:40:03.914402 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 220/447] 10.222.0.67 () {56 vars in 1376 bytes} [Thu Jul 14 17:40:03 2022] GET /identity/v3/role_assignments?group.id=aef192fea03a488b8680b50d525fbfd5&scope.project.id=67e4c4e8f5f441c5bc8f752c9db84352&role.id=95d753870f97426cb1ce32e078621a4c => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:03.915182 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e603a9c-c875-4db6-ba96-e0d87f406c5e None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:03.920965 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-fec289e5-be11-4a49-84bb-e140566e4bc2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 17:40:03.920965 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:03.920965 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:03.920965 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:03.920965 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:03.920965 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:03.920965 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:03.920965 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:03.920965 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:03.920965 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:03.920965 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:03.920965 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:03.920965 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:40:03.920965 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:40:03.920965 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:40:03.920965 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:40:03.922062 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:40:03.922062 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:40:03.922062 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:40:03.922062 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:40:03.922062 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:03.922062 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:03.922062 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:03.922062 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:03.922062 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:03.922062 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:03.922062 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:03.922062 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:03.922062 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:03.922062 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:03.922062 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:03.922062 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:03.922891 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:03.922891 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:03.922891 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:03.922891 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:03.922891 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:40:03.922891 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:40:03.922891 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:40:03.922891 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:40:03.922891 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:40:03.922891 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:40:03.922891 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 17:40:03.922891 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:40:03.922891 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 228/448] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 14 17:40:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:03.928842 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec289e5-be11-4a49-84bb-e140566e4bc2 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:03.993820 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:03.994306 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:04.040660 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e603a9c-c875-4db6-ba96-e0d87f406c5e None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:04.046719 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec289e5-be11-4a49-84bb-e140566e4bc2 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:04.077673 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c300f2d-bf88-4ee5-9bbb-7e9cd2c9c530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:04.078557 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c300f2d-bf88-4ee5-9bbb-7e9cd2c9c530 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:04.078838 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c300f2d-bf88-4ee5-9bbb-7e9cd2c9c530 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:04.079115 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c300f2d-bf88-4ee5-9bbb-7e9cd2c9c530 None admin] PATH_INFO: `/v3/groups/aef192fea03a488b8680b50d525fbfd5` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:04.080350 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c300f2d-bf88-4ee5-9bbb-7e9cd2c9c530 None admin] RBAC: Authorizing `identity:get_group(group_id=aef192fea03a488b8680b50d525fbfd5)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:04.081872 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c300f2d-bf88-4ee5-9bbb-7e9cd2c9c530 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:04.089251 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 221/449] 10.222.0.67 () {56 vars in 1180 bytes} [Thu Jul 14 17:40:03 2022] GET /identity/v3/groups/aef192fea03a488b8680b50d525fbfd5 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:04.090089 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebc880b-e9d9-4f43-91e6-7378ea6e042c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:04.090217 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c300f2d-bf88-4ee5-9bbb-7e9cd2c9c530 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:04.090789 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebc880b-e9d9-4f43-91e6-7378ea6e042c None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:04.091189 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebc880b-e9d9-4f43-91e6-7378ea6e042c None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:04.091465 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebc880b-e9d9-4f43-91e6-7378ea6e042c None admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:04.092235 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebc880b-e9d9-4f43-91e6-7378ea6e042c None admin] RBAC: Adding query filter params (name=admin) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:04.092543 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebc880b-e9d9-4f43-91e6-7378ea6e042c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:04.093986 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebc880b-e9d9-4f43-91e6-7378ea6e042c None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:04.107495 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 229/450] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 14 17:40:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:40:04.109028 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebc880b-e9d9-4f43-91e6-7378ea6e042c None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:04.212559 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c300f2d-bf88-4ee5-9bbb-7e9cd2c9c530 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:04.234380 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebc880b-e9d9-4f43-91e6-7378ea6e042c None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:04.244306 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:04.257981 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99b0264-e564-4c09-9602-66621298a416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:04.258645 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b0264-e564-4c09-9602-66621298a416 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:04.258929 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b0264-e564-4c09-9602-66621298a416 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:04.259204 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b0264-e564-4c09-9602-66621298a416 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:04.259949 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:04.263148 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99b0264-e564-4c09-9602-66621298a416 None admin] RBAC: Adding query filter params (group.id=aef192fea03a488b8680b50d525fbfd5, role.id=fa9b6b80eda3440ca058cb77bd7f8f5c, scope.project.id=67e4c4e8f5f441c5bc8f752c9db84352) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:04.263148 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99b0264-e564-4c09-9602-66621298a416 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:04.263148 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99b0264-e564-4c09-9602-66621298a416 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:04.269599 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 222/451] 10.222.0.67 () {56 vars in 1376 bytes} [Thu Jul 14 17:40:04 2022] GET /identity/v3/role_assignments?group.id=aef192fea03a488b8680b50d525fbfd5&scope.project.id=67e4c4e8f5f441c5bc8f752c9db84352&role.id=fa9b6b80eda3440ca058cb77bd7f8f5c => generated 611 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:40:04.284408 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ec54b0-4d62-4d4f-8745-661520021c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:04.285106 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec54b0-4d62-4d4f-8745-661520021c5a None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:04.285395 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec54b0-4d62-4d4f-8745-661520021c5a None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:04.285721 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec54b0-4d62-4d4f-8745-661520021c5a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:04.370323 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ec54b0-4d62-4d4f-8745-661520021c5a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:04.372115 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ec54b0-4d62-4d4f-8745-661520021c5a None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:04.479336 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 230/452] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 14 17:40:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 17:40:04.485102 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99b0264-e564-4c09-9602-66621298a416 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:04.586974 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99b0264-e564-4c09-9602-66621298a416 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:04.622468 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d28e7e3-ca88-42d5-8162-f961010b7585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:04.623331 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d28e7e3-ca88-42d5-8162-f961010b7585 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:04.623617 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d28e7e3-ca88-42d5-8162-f961010b7585 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:04.623882 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d28e7e3-ca88-42d5-8162-f961010b7585 None admin] PATH_INFO: `/v3/projects/cbe4032be1b14bfe82df97ec9e98e7c0` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:04.625067 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d28e7e3-ca88-42d5-8162-f961010b7585 None admin] RBAC: Authorizing `identity:get_project(project_id=cbe4032be1b14bfe82df97ec9e98e7c0)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:04.626541 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d28e7e3-ca88-42d5-8162-f961010b7585 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:04.628230 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 223/453] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 14 17:40:04 2022] GET /identity/v3/projects/cbe4032be1b14bfe82df97ec9e98e7c0 => generated 344 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:04.633974 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ec54b0-4d62-4d4f-8745-661520021c5a None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:04.652513 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:04.731188 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ec54b0-4d62-4d4f-8745-661520021c5a None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:04.764403 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d790a45-6d5a-4a40-8ae3-e9f2e6d75b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:04.765241 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d790a45-6d5a-4a40-8ae3-e9f2e6d75b62 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:04.765517 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d790a45-6d5a-4a40-8ae3-e9f2e6d75b62 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:04.765823 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d790a45-6d5a-4a40-8ae3-e9f2e6d75b62 None admin] PATH_INFO: `/v3/groups/262d6ae41af7485d86f744c428300f25` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:04.766967 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d790a45-6d5a-4a40-8ae3-e9f2e6d75b62 None admin] RBAC: Authorizing `identity:get_group(group_id=262d6ae41af7485d86f744c428300f25)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:04.768384 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d790a45-6d5a-4a40-8ae3-e9f2e6d75b62 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:04.769992 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 231/454] 10.222.0.67 () {56 vars in 1180 bytes} [Thu Jul 14 17:40:04 2022] GET /identity/v3/groups/262d6ae41af7485d86f744c428300f25 => generated 229 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:04.776325 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d28e7e3-ca88-42d5-8162-f961010b7585 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:04.833041 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:04.872822 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d28e7e3-ca88-42d5-8162-f961010b7585 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:04.905097 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d283e7-ed24-4dcd-ba9f-846a0664d666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:04.905774 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d283e7-ed24-4dcd-ba9f-846a0664d666 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:04.906056 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d283e7-ed24-4dcd-ba9f-846a0664d666 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:04.906333 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d283e7-ed24-4dcd-ba9f-846a0664d666 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:04.907170 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d283e7-ed24-4dcd-ba9f-846a0664d666 None admin] RBAC: Adding query filter params (group.id=262d6ae41af7485d86f744c428300f25, role.id=4651a1cc7b4d4ab7a7a9ca1e77e58e71, scope.project.id=cbe4032be1b14bfe82df97ec9e98e7c0) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:04.907480 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d283e7-ed24-4dcd-ba9f-846a0664d666 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:04.908905 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d283e7-ed24-4dcd-ba9f-846a0664d666 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:04.915199 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 224/455] 10.222.0.67 () {56 vars in 1376 bytes} [Thu Jul 14 17:40:04 2022] GET /identity/v3/role_assignments?group.id=262d6ae41af7485d86f744c428300f25&scope.project.id=cbe4032be1b14bfe82df97ec9e98e7c0&role.id=4651a1cc7b4d4ab7a7a9ca1e77e58e71 => generated 611 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:07.463642 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc4209-cb26-419b-85c1-24b586c4509d None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:07.464697 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc4209-cb26-419b-85c1-24b586c4509d None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:07.465263 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc4209-cb26-419b-85c1-24b586c4509d None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:07.467108 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 232/456] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:40:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:40:07.473015 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe2036-5365-43d7-a965-407e146e6190 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:07.473924 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe2036-5365-43d7-a965-407e146e6190 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:07.475052 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe2036-5365-43d7-a965-407e146e6190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:07.499731 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-ecbe2036-5365-43d7-a965-407e146e6190 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:40:07.501270 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-ecbe2036-5365-43d7-a965-407e146e6190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:40:07.604339 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 225/457] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:40:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:40:07.649796 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fc4209-cb26-419b-85c1-24b586c4509d None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:07.664867 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c75d63-a341-4e31-8c11-7ee535d49c34 None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:07.665500 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c75d63-a341-4e31-8c11-7ee535d49c34 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:07.666007 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c75d63-a341-4e31-8c11-7ee535d49c34 None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:07.667634 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 226/458] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:40:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:40:07.673148 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44aaa7b-e1f5-4f0c-bfe1-6f0213ed74d7 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:07.673801 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44aaa7b-e1f5-4f0c-bfe1-6f0213ed74d7 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:07.674285 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44aaa7b-e1f5-4f0c-bfe1-6f0213ed74d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:07.698648 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-a44aaa7b-e1f5-4f0c-bfe1-6f0213ed74d7 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:40:07.700228 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-a44aaa7b-e1f5-4f0c-bfe1-6f0213ed74d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:40:07.775933 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:07.804782 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 227/459] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:40:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 17:40:07.809554 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1123ac14-6f63-4748-ad4f-fba32e8c759f None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:07.809741 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:07.810335 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1123ac14-6f63-4748-ad4f-fba32e8c759f None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:07.810896 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1123ac14-6f63-4748-ad4f-fba32e8c759f None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:07.812899 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 228/460] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:40:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:40:07.823187 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9687ec-608e-4342-8130-c16f8b18671c None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:07.823790 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9687ec-608e-4342-8130-c16f8b18671c None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:07.824271 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9687ec-608e-4342-8130-c16f8b18671c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:07.826834 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fc4209-cb26-419b-85c1-24b586c4509d None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:07.854726 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-6a9687ec-608e-4342-8130-c16f8b18671c None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:40:07.856117 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-6a9687ec-608e-4342-8130-c16f8b18671c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:40:07.871357 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458dfe1a-f9dd-45e3-9ffc-0f9f680175fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:07.872573 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458dfe1a-f9dd-45e3-9ffc-0f9f680175fa None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:07.873450 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458dfe1a-f9dd-45e3-9ffc-0f9f680175fa None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:07.873907 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458dfe1a-f9dd-45e3-9ffc-0f9f680175fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:07.887790 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458dfe1a-f9dd-45e3-9ffc-0f9f680175fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:07.889834 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458dfe1a-f9dd-45e3-9ffc-0f9f680175fa None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:07.910104 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-458dfe1a-f9dd-45e3-9ffc-0f9f680175fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:07.910104 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:07.910104 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:07.910104 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:07.910104 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:07.910104 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:07.910104 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:07.910104 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:07.910104 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:07.910104 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:07.910104 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:07.910104 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:07.910104 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:40:07.910104 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:40:07.910104 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:40:07.911082 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:40:07.911082 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:07.911082 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:07.911082 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:07.911082 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:07.911082 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:07.911082 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:07.911082 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:07.911082 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:07.911082 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:07.911082 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:07.911082 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:07.911082 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:07.911082 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:07.911082 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:07.911082 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:07.911082 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:07.912516 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:40:07.912516 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:40:07.912516 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:07.912516 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:40:07.914958 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 233/461] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:40:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:07.916169 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458dfe1a-f9dd-45e3-9ffc-0f9f680175fa None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:07.938733 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 229/462] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:40:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:40:07.941144 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9687ec-608e-4342-8130-c16f8b18671c None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:08.036160 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458dfe1a-f9dd-45e3-9ffc-0f9f680175fa None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:08.074342 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2fc662-9f1e-49fb-b6c1-28c4e9609f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:08.075430 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2fc662-9f1e-49fb-b6c1-28c4e9609f45 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:08.075862 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2fc662-9f1e-49fb-b6c1-28c4e9609f45 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:08.076304 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2fc662-9f1e-49fb-b6c1-28c4e9609f45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:08.084507 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:08.087589 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9687ec-608e-4342-8130-c16f8b18671c None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:08.090351 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2fc662-9f1e-49fb-b6c1-28c4e9609f45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:08.093006 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2fc662-9f1e-49fb-b6c1-28c4e9609f45 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:08.106946 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:08.119349 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-3a2fc662-9f1e-49fb-b6c1-28c4e9609f45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:08.119349 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:08.119349 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:08.119349 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:08.119349 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:08.119349 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:08.119349 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:08.119349 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:08.119349 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:08.119349 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:08.119349 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:08.119349 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:08.119349 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:40:08.119349 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:40:08.119349 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:40:08.120458 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:40:08.120458 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:08.120458 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:08.120458 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:08.120458 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:08.120458 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:08.120458 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:08.120458 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:08.120458 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:08.120458 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:08.120458 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:08.120458 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:08.120458 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:08.120458 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:08.120458 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:08.120458 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:08.120458 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:08.121503 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:40:08.121503 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:40:08.121503 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:08.121503 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:40:08.124026 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 234/463] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:40:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:08.125053 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2fc662-9f1e-49fb-b6c1-28c4e9609f45 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:08.144928 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a08fedb-89eb-461e-ad14-b1f73062a40f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:08.146181 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a08fedb-89eb-461e-ad14-b1f73062a40f None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:08.147337 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a08fedb-89eb-461e-ad14-b1f73062a40f None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:08.147793 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a08fedb-89eb-461e-ad14-b1f73062a40f None admin] PATH_INFO: `/v3/domains` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:08.148681 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a08fedb-89eb-461e-ad14-b1f73062a40f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:08.149130 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a08fedb-89eb-461e-ad14-b1f73062a40f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:08.151462 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a08fedb-89eb-461e-ad14-b1f73062a40f None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:08.167953 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 230/464] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 14 17:40:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:08.169045 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a08fedb-89eb-461e-ad14-b1f73062a40f None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:08.237754 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2fc662-9f1e-49fb-b6c1-28c4e9609f45 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:08.275185 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57608b2-29d1-4a43-92eb-a46fd6432366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:08.276005 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57608b2-29d1-4a43-92eb-a46fd6432366 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:08.276309 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57608b2-29d1-4a43-92eb-a46fd6432366 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:08.276576 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57608b2-29d1-4a43-92eb-a46fd6432366 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:08.284298 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a08fedb-89eb-461e-ad14-b1f73062a40f None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:08.289694 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57608b2-29d1-4a43-92eb-a46fd6432366 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:08.291134 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57608b2-29d1-4a43-92eb-a46fd6432366 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:08.311561 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-b57608b2-29d1-4a43-92eb-a46fd6432366 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:08.311561 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:08.311561 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:08.311561 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:08.311561 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:08.311561 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:08.311561 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:08.311561 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:08.311561 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:08.311561 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:08.311561 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:08.311561 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:08.311561 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:40:08.311561 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:40:08.311561 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:40:08.312591 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:40:08.312591 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:08.312591 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:08.312591 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:08.312591 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:08.312591 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:08.312591 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:08.312591 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:08.312591 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:08.312591 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:08.312591 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:08.312591 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:08.312591 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:08.312591 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:08.312591 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:08.312591 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:08.312591 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:08.313452 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:40:08.313452 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:40:08.313452 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:08.313452 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:40:08.313452 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 235/465] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:40:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:08.314398 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57608b2-29d1-4a43-92eb-a46fd6432366 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:08.331189 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b6a157-5307-4b08-ba0c-60f731e4a105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:08.331867 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b6a157-5307-4b08-ba0c-60f731e4a105 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:08.332196 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b6a157-5307-4b08-ba0c-60f731e4a105 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:08.332538 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b6a157-5307-4b08-ba0c-60f731e4a105 None admin] PATH_INFO: `/v3/domains` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:08.333305 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b6a157-5307-4b08-ba0c-60f731e4a105 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:08.333655 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b6a157-5307-4b08-ba0c-60f731e4a105 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:08.335149 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b6a157-5307-4b08-ba0c-60f731e4a105 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:08.353176 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 231/466] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 14 17:40:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:08.353176 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286d6c5-82ec-4692-bd91-d6c9b24bba34 None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:08.353176 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286d6c5-82ec-4692-bd91-d6c9b24bba34 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:08.353176 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286d6c5-82ec-4692-bd91-d6c9b24bba34 None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:08.353176 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 232/467] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:40:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:40:08.353176 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9286d6c5-82ec-4692-bd91-d6c9b24bba34 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:08.373754 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:08.392861 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:08.436347 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57608b2-29d1-4a43-92eb-a46fd6432366 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:08.481150 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9286d6c5-82ec-4692-bd91-d6c9b24bba34 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:08.483813 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f1ffa1-5a5e-486b-bcef-23d71384bf8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:08.484509 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f1ffa1-5a5e-486b-bcef-23d71384bf8b None admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:08.484797 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f1ffa1-5a5e-486b-bcef-23d71384bf8b None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:08.485074 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f1ffa1-5a5e-486b-bcef-23d71384bf8b None admin] PATH_INFO: `/v3/users` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:08.485849 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f1ffa1-5a5e-486b-bcef-23d71384bf8b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:08.487338 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f1ffa1-5a5e-486b-bcef-23d71384bf8b None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:08.521967 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 236/468] 10.222.0.67 () {60 vars in 1132 bytes} [Thu Jul 14 17:40:08 2022] POST /identity/v3/users => generated 246 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:40:08.521967 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f1ffa1-5a5e-486b-bcef-23d71384bf8b None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:08.539857 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d363e7c-de03-4249-93f0-935f2e10ed56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:08.540762 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d363e7c-de03-4249-93f0-935f2e10ed56 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:08.541700 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d363e7c-de03-4249-93f0-935f2e10ed56 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:08.542015 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d363e7c-de03-4249-93f0-935f2e10ed56 None admin] PATH_INFO: `/v3/domains` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:08.543074 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d363e7c-de03-4249-93f0-935f2e10ed56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:08.543391 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d363e7c-de03-4249-93f0-935f2e10ed56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:08.545710 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d363e7c-de03-4249-93f0-935f2e10ed56 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:08.563014 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 233/469] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 14 17:40:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:08.564974 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b838fe6-6165-4e9a-8f16-178b4d1275f8 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:08.565935 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b838fe6-6165-4e9a-8f16-178b4d1275f8 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:08.566206 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b838fe6-6165-4e9a-8f16-178b4d1275f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:08.593632 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-3b838fe6-6165-4e9a-8f16-178b4d1275f8 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:40:08.595823 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-3b838fe6-6165-4e9a-8f16-178b4d1275f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:40:08.656293 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:08.662343 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f1ffa1-5a5e-486b-bcef-23d71384bf8b None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:08.683269 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 234/470] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:40:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:40:08.684499 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b838fe6-6165-4e9a-8f16-178b4d1275f8 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:08.720524 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:08.722465 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a989c3-6083-40b2-9129-3de039c8b950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:08.723155 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a989c3-6083-40b2-9129-3de039c8b950 None admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:08.723432 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a989c3-6083-40b2-9129-3de039c8b950 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:08.723784 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a989c3-6083-40b2-9129-3de039c8b950 None admin] PATH_INFO: `/v3/users` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:08.725110 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a989c3-6083-40b2-9129-3de039c8b950 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:08.726607 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a989c3-6083-40b2-9129-3de039c8b950 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:08.752622 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 237/471] 10.222.0.67 () {60 vars in 1132 bytes} [Thu Jul 14 17:40:08 2022] POST /identity/v3/users => generated 248 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:40:08.754388 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a989c3-6083-40b2-9129-3de039c8b950 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:08.830020 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b838fe6-6165-4e9a-8f16-178b4d1275f8 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:08.882625 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e395e2e1-dbac-4c95-a16a-dce7177ac1ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:08.883333 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e395e2e1-dbac-4c95-a16a-dce7177ac1ef None admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:08.883618 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e395e2e1-dbac-4c95-a16a-dce7177ac1ef None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:08.883897 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e395e2e1-dbac-4c95-a16a-dce7177ac1ef None admin] PATH_INFO: `/v3/users` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:08.884709 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e395e2e1-dbac-4c95-a16a-dce7177ac1ef None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:08.886231 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e395e2e1-dbac-4c95-a16a-dce7177ac1ef None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:08.892825 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a989c3-6083-40b2-9129-3de039c8b950 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:08.918667 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 235/472] 10.222.0.67 () {60 vars in 1132 bytes} [Thu Jul 14 17:40:08 2022] POST /identity/v3/users => generated 248 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:40:08.944770 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dd13e4-bf40-4a63-86bf-37d6d43b96aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:08.946029 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd13e4-bf40-4a63-86bf-37d6d43b96aa None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:08.946498 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd13e4-bf40-4a63-86bf-37d6d43b96aa None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:08.946989 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd13e4-bf40-4a63-86bf-37d6d43b96aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:08.962919 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dd13e4-bf40-4a63-86bf-37d6d43b96aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:08.963407 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f317ce-fc37-4380-be04-f050f8d05af3 None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:08.963699 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f317ce-fc37-4380-be04-f050f8d05af3 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:08.963978 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f317ce-fc37-4380-be04-f050f8d05af3 None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:08.964355 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dd13e4-bf40-4a63-86bf-37d6d43b96aa None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:08.965475 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 236/473] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:40:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:40:08.976479 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b80b8c-e3a7-4b7c-81c7-467221dbc87e None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:08.976479 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b80b8c-e3a7-4b7c-81c7-467221dbc87e None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:08.976479 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b80b8c-e3a7-4b7c-81c7-467221dbc87e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:08.986316 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-10dd13e4-bf40-4a63-86bf-37d6d43b96aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:08.986316 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:08.986316 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:08.986316 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:08.986316 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:08.986316 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:08.986316 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:08.986316 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:08.986316 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:08.986316 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:08.986316 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:08.986316 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:08.986316 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:40:08.986316 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:40:08.986316 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:40:08.987266 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:40:08.987266 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:08.987266 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:08.987266 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:08.987266 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:08.987266 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:08.987266 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:08.987266 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:08.987266 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:08.987266 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:08.987266 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:08.987266 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:08.987266 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:08.987266 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:08.987266 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:08.987266 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:08.987266 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:08.988144 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:40:08.988144 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:40:08.988144 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:08.988144 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:40:08.988144 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 238/474] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:40:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:08.994393 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dd13e4-bf40-4a63-86bf-37d6d43b96aa None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:09.005661 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-31b80b8c-e3a7-4b7c-81c7-467221dbc87e None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:40:09.006892 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-31b80b8c-e3a7-4b7c-81c7-467221dbc87e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:40:09.010388 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:09.124482 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 237/475] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:40:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:40:09.149427 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b80b8c-e3a7-4b7c-81c7-467221dbc87e None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:09.152448 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dd13e4-bf40-4a63-86bf-37d6d43b96aa None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:09.162902 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:09.196896 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed2d831-9de7-42c7-bc01-33304305e53a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:09.197632 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed2d831-9de7-42c7-bc01-33304305e53a None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:09.197924 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed2d831-9de7-42c7-bc01-33304305e53a None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:09.198205 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed2d831-9de7-42c7-bc01-33304305e53a None admin] PATH_INFO: `/v3/domains` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:09.199047 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed2d831-9de7-42c7-bc01-33304305e53a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:09.199361 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed2d831-9de7-42c7-bc01-33304305e53a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:09.200803 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed2d831-9de7-42c7-bc01-33304305e53a None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:09.216692 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 239/476] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 14 17:40:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:09.223541 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed2d831-9de7-42c7-bc01-33304305e53a None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:09.293517 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b80b8c-e3a7-4b7c-81c7-467221dbc87e None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:09.314024 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:09.350062 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129a6015-7b45-4fff-803b-2bea82b4717d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:09.351336 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129a6015-7b45-4fff-803b-2bea82b4717d None admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:09.351628 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129a6015-7b45-4fff-803b-2bea82b4717d None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:09.351906 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129a6015-7b45-4fff-803b-2bea82b4717d None admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:09.352965 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129a6015-7b45-4fff-803b-2bea82b4717d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:09.354710 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129a6015-7b45-4fff-803b-2bea82b4717d None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:09.363128 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed2d831-9de7-42c7-bc01-33304305e53a None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:09.364629 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.sql.core [None req-129a6015-7b45-4fff-803b-2bea82b4717d None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 14 17:40:09.364629 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 14 17:40:09.364629 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [parameters: {'id': '7fba7474a4b74a9f8ac03968d4124cfb', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 14 17:40:09.364629 dv-cinder-849890-1-smb devstack@keystone.service[86773]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86773) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 14 17:40:09.383553 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-129a6015-7b45-4fff-803b-2bea82b4717d None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 14 17:40:09.383553 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:09.383553 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 17:40:09.383553 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 14 17:40:09.383553 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 17:40:09.383553 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 14 17:40:09.383553 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 17:40:09.383553 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application result = self._query(query) Jul 14 17:40:09.383553 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 17:40:09.383553 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application conn.query(q) Jul 14 17:40:09.383553 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 17:40:09.383553 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 17:40:09.383553 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 17:40:09.383553 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application result.read() Jul 14 17:40:09.383553 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 17:40:09.384465 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 14 17:40:09.384465 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 17:40:09.384465 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 14 17:40:09.384465 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 17:40:09.384465 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 14 17:40:09.384465 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 17:40:09.384465 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 14 17:40:09.384465 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 14 17:40:09.384465 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:40:09.384465 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 14 17:40:09.384465 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:40:09.384465 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:09.384465 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 14 17:40:09.384465 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 14 17:40:09.384465 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 14 17:40:09.384465 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return ref.to_dict() Jul 14 17:40:09.384465 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 14 17:40:09.384465 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application next(self.gen) Jul 14 17:40:09.385475 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 14 17:40:09.385475 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application yield resource Jul 14 17:40:09.385475 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 14 17:40:09.385475 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application next(self.gen) Jul 14 17:40:09.385475 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 14 17:40:09.385475 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application self.session.rollback() Jul 14 17:40:09.385475 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 17:40:09.385475 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application self.force_reraise() Jul 14 17:40:09.385475 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 17:40:09.385475 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise self.value Jul 14 17:40:09.385475 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 14 17:40:09.385475 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 14 17:40:09.385475 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 14 17:40:09.385475 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application session.commit() Jul 14 17:40:09.385475 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 14 17:40:09.385475 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 14 17:40:09.385475 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 14 17:40:09.386384 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application self._prepare_impl() Jul 14 17:40:09.386384 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 14 17:40:09.386384 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application self.session.flush() Jul 14 17:40:09.386384 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 14 17:40:09.386384 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application self._flush(objects) Jul 14 17:40:09.386384 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 14 17:40:09.386384 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 14 17:40:09.386384 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 14 17:40:09.386384 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application compat.raise_( Jul 14 17:40:09.386384 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 17:40:09.386384 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception Jul 14 17:40:09.386384 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 14 17:40:09.386384 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application flush_context.execute() Jul 14 17:40:09.386384 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 14 17:40:09.386384 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rec.execute(self) Jul 14 17:40:09.386384 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 14 17:40:09.386384 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 14 17:40:09.387290 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 14 17:40:09.387290 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 14 17:40:09.387290 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 14 17:40:09.387290 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 14 17:40:09.387290 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 14 17:40:09.387290 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 14 17:40:09.387290 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 14 17:40:09.387290 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 14 17:40:09.387290 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 14 17:40:09.387290 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 14 17:40:09.387290 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 14 17:40:09.387290 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 14 17:40:09.387290 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 14 17:40:09.387290 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 14 17:40:09.387290 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 17:40:09.387290 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception Jul 14 17:40:09.388129 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 17:40:09.388129 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 14 17:40:09.388129 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 17:40:09.388129 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 14 17:40:09.388129 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 17:40:09.388129 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application result = self._query(query) Jul 14 17:40:09.388129 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 17:40:09.388129 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application conn.query(q) Jul 14 17:40:09.388129 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 17:40:09.388129 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 17:40:09.388129 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 17:40:09.388129 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application result.read() Jul 14 17:40:09.388129 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 17:40:09.388129 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 14 17:40:09.388129 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 17:40:09.388129 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 14 17:40:09.388961 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 17:40:09.388961 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 14 17:40:09.388961 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 17:40:09.388961 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 14 17:40:09.388961 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 14 17:40:09.388961 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 14 17:40:09.388961 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [parameters: {'id': '7fba7474a4b74a9f8ac03968d4124cfb', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 14 17:40:09.388961 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 14 17:40:09.388961 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:40:09.388961 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 17:40:09.388961 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:40:09.388961 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:09.388961 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:09.388961 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:09.388961 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:09.388961 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:09.389872 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:09.389872 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:09.389872 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:09.389872 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:09.389872 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:09.389872 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:09.389872 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 14 17:40:09.389872 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 14 17:40:09.389872 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:09.389872 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:09.389872 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 14 17:40:09.389872 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 14 17:40:09.389872 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 14 17:40:09.389872 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 14 17:40:09.389872 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 14 17:40:09.389872 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:40:09.394008 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 238/477] 10.222.0.67 () {60 vars in 1131 bytes} [Thu Jul 14 17:40:09 2022] POST /identity/v3/roles => generated 144 bytes in 245 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 14 17:40:09.405488 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129a6015-7b45-4fff-803b-2bea82b4717d None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:09.418429 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b571cb9-9f2b-41dc-969c-18680dda40a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:09.419116 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b571cb9-9f2b-41dc-969c-18680dda40a4 None admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:09.419406 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b571cb9-9f2b-41dc-969c-18680dda40a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:09.419688 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b571cb9-9f2b-41dc-969c-18680dda40a4 None admin] PATH_INFO: `/v3/users` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:09.420924 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b571cb9-9f2b-41dc-969c-18680dda40a4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:09.422396 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b571cb9-9f2b-41dc-969c-18680dda40a4 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:09.471416 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 240/478] 10.222.0.67 () {60 vars in 1132 bytes} [Thu Jul 14 17:40:09 2022] POST /identity/v3/users => generated 249 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:40:09.510195 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:09.542778 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129a6015-7b45-4fff-803b-2bea82b4717d None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:09.582493 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b4a25f-4866-44b1-94de-84109f588482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:09.583813 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b4a25f-4866-44b1-94de-84109f588482 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:09.584882 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b4a25f-4866-44b1-94de-84109f588482 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:09.585357 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b4a25f-4866-44b1-94de-84109f588482 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:09.597214 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b4a25f-4866-44b1-94de-84109f588482 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:40:09.606786 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-c3b4a25f-4866-44b1-94de-84109f588482 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 17:40:09.606786 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:09.606786 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:09.606786 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:09.606786 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:09.606786 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:09.606786 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:09.606786 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:09.606786 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:09.606786 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:09.606786 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:09.606786 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:09.606786 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:40:09.606786 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:40:09.606786 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:40:09.606786 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:40:09.607776 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:40:09.607776 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:40:09.607776 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:40:09.607776 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:40:09.607776 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:09.607776 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:09.607776 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:09.607776 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:09.607776 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:09.607776 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:09.607776 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:09.607776 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:09.607776 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:09.607776 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:09.607776 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:09.607776 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:09.608588 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:09.608588 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:09.608588 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:09.608588 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:09.608588 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:40:09.608588 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:40:09.608588 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:40:09.608588 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:40:09.608588 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:40:09.608588 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:40:09.608588 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 17:40:09.608588 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:40:09.615830 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 239/479] 10.222.0.67 () {56 vars in 1114 bytes} [Thu Jul 14 17:40:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:09.618347 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b571cb9-9f2b-41dc-969c-18680dda40a4 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:09.770945 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b571cb9-9f2b-41dc-969c-18680dda40a4 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:09.796110 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:09.819904 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f67e14-dff2-46fc-b4ad-51cee905a662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:09.820605 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f67e14-dff2-46fc-b4ad-51cee905a662 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:09.820897 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f67e14-dff2-46fc-b4ad-51cee905a662 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:09.821152 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f67e14-dff2-46fc-b4ad-51cee905a662 None admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:09.822037 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f67e14-dff2-46fc-b4ad-51cee905a662 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:09.822350 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f67e14-dff2-46fc-b4ad-51cee905a662 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:09.824119 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f67e14-dff2-46fc-b4ad-51cee905a662 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:09.833616 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 241/480] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 14 17:40:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:11.226781 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e040b1-6462-44e4-bb0a-b5dd90901c73 None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:11.227393 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e040b1-6462-44e4-bb0a-b5dd90901c73 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:11.227638 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e040b1-6462-44e4-bb0a-b5dd90901c73 None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:11.230148 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 240/481] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:40:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:40:11.237113 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195aba4d-1de1-4167-930a-117d235fbd39 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:11.237658 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195aba4d-1de1-4167-930a-117d235fbd39 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:11.237761 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195aba4d-1de1-4167-930a-117d235fbd39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:11.270398 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-195aba4d-1de1-4167-930a-117d235fbd39 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:40:11.272290 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-195aba4d-1de1-4167-930a-117d235fbd39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:40:11.411155 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 242/482] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:40:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 17:40:11.467091 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e040b1-6462-44e4-bb0a-b5dd90901c73 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:11.625496 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e040b1-6462-44e4-bb0a-b5dd90901c73 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:11.638691 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc201702-7e79-4653-b71a-694f48506f7c None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:11.638979 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc201702-7e79-4653-b71a-694f48506f7c None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:11.639261 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc201702-7e79-4653-b71a-694f48506f7c None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:11.641697 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 243/483] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:40:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:40:11.659045 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc51266e-2b6a-4a2b-97b5-5a43228832c4 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:11.659372 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc51266e-2b6a-4a2b-97b5-5a43228832c4 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:11.659615 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc51266e-2b6a-4a2b-97b5-5a43228832c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:11.673157 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3240eadd-922f-49c0-8065-c2f150e51af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:11.674496 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3240eadd-922f-49c0-8065-c2f150e51af8 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:11.675062 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3240eadd-922f-49c0-8065-c2f150e51af8 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:11.675619 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3240eadd-922f-49c0-8065-c2f150e51af8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:11.683237 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:11.690171 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3240eadd-922f-49c0-8065-c2f150e51af8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:40:11.694560 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-bc51266e-2b6a-4a2b-97b5-5a43228832c4 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:40:11.695788 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-bc51266e-2b6a-4a2b-97b5-5a43228832c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:40:11.701819 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-3240eadd-922f-49c0-8065-c2f150e51af8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 17:40:11.701819 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:11.701819 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:11.701819 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:11.701819 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:11.701819 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:11.701819 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:11.701819 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:11.701819 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:11.701819 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:11.701819 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:11.701819 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:11.701819 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:40:11.701819 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:40:11.701819 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:40:11.701819 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:40:11.702922 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:40:11.702922 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:40:11.702922 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:40:11.702922 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:40:11.702922 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:11.702922 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:11.702922 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:11.702922 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:11.702922 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:11.702922 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:11.702922 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:11.702922 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:11.702922 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:11.702922 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:11.702922 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:11.702922 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:11.703839 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:11.703839 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:11.703839 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:11.703839 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:11.703839 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:40:11.703839 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:40:11.703839 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:40:11.703839 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:40:11.703839 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:40:11.703839 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:40:11.703839 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 17:40:11.703839 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:40:11.707478 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 241/484] 10.222.0.67 () {56 vars in 1102 bytes} [Thu Jul 14 17:40:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:11.717391 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3240eadd-922f-49c0-8065-c2f150e51af8 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:11.870040 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3240eadd-922f-49c0-8065-c2f150e51af8 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:11.899388 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 244/485] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:40:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 17:40:11.909785 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aa9a46-5967-4cc9-a2e4-3d5a21d48597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:11.910797 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa9a46-5967-4cc9-a2e4-3d5a21d48597 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:11.911330 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa9a46-5967-4cc9-a2e4-3d5a21d48597 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:11.911829 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa9a46-5967-4cc9-a2e4-3d5a21d48597 None admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:11.913485 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aa9a46-5967-4cc9-a2e4-3d5a21d48597 None admin] RBAC: Adding query filter params (name=service) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:11.913979 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aa9a46-5967-4cc9-a2e4-3d5a21d48597 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:11.915527 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aa9a46-5967-4cc9-a2e4-3d5a21d48597 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:11.929724 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 242/486] 10.222.0.67 () {56 vars in 1103 bytes} [Thu Jul 14 17:40:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:11.931873 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc51266e-2b6a-4a2b-97b5-5a43228832c4 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:11.948219 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aa9a46-5967-4cc9-a2e4-3d5a21d48597 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:12.042294 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:12.063672 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:12.112085 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc51266e-2b6a-4a2b-97b5-5a43228832c4 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:12.141051 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aa9a46-5967-4cc9-a2e4-3d5a21d48597 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:12.162020 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf445dc-20f6-406f-a3fe-873febe61173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:12.163257 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf445dc-20f6-406f-a3fe-873febe61173 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:12.164403 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf445dc-20f6-406f-a3fe-873febe61173 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:12.164816 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf445dc-20f6-406f-a3fe-873febe61173 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:12.181419 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf445dc-20f6-406f-a3fe-873febe61173 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:12.183576 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf445dc-20f6-406f-a3fe-873febe61173 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:12.192564 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33989459-81b6-4ec5-8c90-d951d18ca24c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:12.194340 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33989459-81b6-4ec5-8c90-d951d18ca24c None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:12.194619 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33989459-81b6-4ec5-8c90-d951d18ca24c None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:12.195002 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33989459-81b6-4ec5-8c90-d951d18ca24c None admin] PATH_INFO: `/v3/roles/service` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:12.205818 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-fbf445dc-20f6-406f-a3fe-873febe61173 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:12.205818 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:12.205818 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:12.205818 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:12.205818 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:12.205818 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:12.205818 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:12.205818 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:12.205818 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:12.205818 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:12.205818 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:12.205818 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:12.205818 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:40:12.205818 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:40:12.205818 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:40:12.206729 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:40:12.206729 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:12.206729 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:12.206729 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:12.206729 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:12.206729 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:12.206729 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:12.206729 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:12.206729 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:12.206729 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:12.206729 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:12.206729 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:12.206729 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:12.206729 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:12.206729 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:12.206729 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:12.206729 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:12.207607 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:40:12.207607 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:40:12.207607 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:12.207607 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:40:12.207816 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33989459-81b6-4ec5-8c90-d951d18ca24c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:40:12.209379 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 245/487] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:40:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 17:40:12.215554 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-33989459-81b6-4ec5-8c90-d951d18ca24c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 17:40:12.215554 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:12.215554 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:12.215554 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:12.215554 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:12.215554 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:12.215554 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:12.215554 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:12.215554 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:12.215554 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:12.215554 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:12.215554 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:12.215554 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:40:12.215554 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:40:12.215554 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:40:12.215554 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:40:12.216762 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:40:12.216762 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:40:12.216762 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:40:12.216762 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:40:12.216762 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:12.216762 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:12.216762 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:12.216762 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:12.216762 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:12.216762 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:12.216762 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:12.216762 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:12.216762 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:12.216762 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:12.216762 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:12.216762 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:12.217644 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:12.217644 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:12.217644 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:12.217644 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:12.217644 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:40:12.217644 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:40:12.217644 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:40:12.217644 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:40:12.217644 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:40:12.217644 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:40:12.217644 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 17:40:12.217644 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:40:12.218884 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe0c48f-67bd-4b05-9253-3cb5bbbeecb1 None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:12.219549 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe0c48f-67bd-4b05-9253-3cb5bbbeecb1 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:12.220016 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe0c48f-67bd-4b05-9253-3cb5bbbeecb1 None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:12.222134 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 246/489] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:40:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:40:12.222243 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 243/489] 10.222.0.67 () {56 vars in 1102 bytes} [Thu Jul 14 17:40:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:12.223208 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33989459-81b6-4ec5-8c90-d951d18ca24c None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:12.225324 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe0c48f-67bd-4b05-9253-3cb5bbbeecb1 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:12.335862 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:12.347139 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe0c48f-67bd-4b05-9253-3cb5bbbeecb1 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:12.355110 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33989459-81b6-4ec5-8c90-d951d18ca24c None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:12.392831 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af1461f-f5e2-415c-a9c4-3a0e2dfd8845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:12.394240 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af1461f-f5e2-415c-a9c4-3a0e2dfd8845 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:12.394847 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af1461f-f5e2-415c-a9c4-3a0e2dfd8845 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:12.395450 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af1461f-f5e2-415c-a9c4-3a0e2dfd8845 None admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:12.397214 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af1461f-f5e2-415c-a9c4-3a0e2dfd8845 None admin] RBAC: Adding query filter params (name=service) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:12.397907 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af1461f-f5e2-415c-a9c4-3a0e2dfd8845 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:12.399712 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af1461f-f5e2-415c-a9c4-3a0e2dfd8845 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:12.402585 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e01d02-70bd-475b-9692-294835984752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:12.403750 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e01d02-70bd-475b-9692-294835984752 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:12.404038 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e01d02-70bd-475b-9692-294835984752 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:12.404327 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e01d02-70bd-475b-9692-294835984752 None admin] PATH_INFO: `/v3/domains` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:12.405084 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e01d02-70bd-475b-9692-294835984752 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:12.405395 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e01d02-70bd-475b-9692-294835984752 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:12.406970 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e01d02-70bd-475b-9692-294835984752 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:12.410985 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:12.426641 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 247/490] 10.222.0.67 () {56 vars in 1103 bytes} [Thu Jul 14 17:40:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:40:12.430229 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df59f73-a677-4925-864e-989392e36b42 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:12.431301 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df59f73-a677-4925-864e-989392e36b42 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:12.432081 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df59f73-a677-4925-864e-989392e36b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:12.434286 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 244/491] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 14 17:40:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:12.434286 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e01d02-70bd-475b-9692-294835984752 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:12.484210 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-5df59f73-a677-4925-864e-989392e36b42 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:40:12.487030 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-5df59f73-a677-4925-864e-989392e36b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:40:12.573768 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e01d02-70bd-475b-9692-294835984752 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:12.588201 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 248/492] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:40:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:40:12.589843 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df59f73-a677-4925-864e-989392e36b42 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:12.626442 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a290ec-a7b7-4c88-bd58-17939ffcfefe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:12.627706 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a290ec-a7b7-4c88-bd58-17939ffcfefe None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:12.628097 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a290ec-a7b7-4c88-bd58-17939ffcfefe None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:12.628623 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a290ec-a7b7-4c88-bd58-17939ffcfefe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:12.644407 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a290ec-a7b7-4c88-bd58-17939ffcfefe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:12.646953 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a290ec-a7b7-4c88-bd58-17939ffcfefe None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:12.679561 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-70a290ec-a7b7-4c88-bd58-17939ffcfefe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:12.679561 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:12.679561 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:12.679561 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:12.679561 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:12.679561 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:12.679561 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:12.679561 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:12.679561 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:12.679561 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:12.679561 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:12.679561 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:12.679561 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:40:12.679561 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:40:12.679561 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:40:12.680486 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:40:12.680486 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:12.680486 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:12.680486 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:12.680486 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:12.680486 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:12.680486 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:12.680486 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:12.680486 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:12.680486 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:12.680486 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:12.680486 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:12.680486 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:12.680486 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:12.680486 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:12.680486 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:12.680486 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:12.681868 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:40:12.681868 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:40:12.681868 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:12.681868 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:40:12.681868 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 245/493] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:40:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:12.686774 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a290ec-a7b7-4c88-bd58-17939ffcfefe None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:12.716870 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:12.727495 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:12.742503 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df59f73-a677-4925-864e-989392e36b42 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:12.790657 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836061fa-0319-48c9-ba1e-4ba3fd6e6769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:12.791787 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836061fa-0319-48c9-ba1e-4ba3fd6e6769 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:12.792134 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836061fa-0319-48c9-ba1e-4ba3fd6e6769 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:12.792469 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836061fa-0319-48c9-ba1e-4ba3fd6e6769 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:12.802450 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836061fa-0319-48c9-ba1e-4ba3fd6e6769 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:12.804608 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836061fa-0319-48c9-ba1e-4ba3fd6e6769 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:12.814881 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a290ec-a7b7-4c88-bd58-17939ffcfefe None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:12.823261 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-836061fa-0319-48c9-ba1e-4ba3fd6e6769 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 17:40:12.823261 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:12.823261 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:12.823261 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:12.823261 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:12.823261 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:12.823261 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:12.823261 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:12.823261 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:12.823261 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:12.823261 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:12.823261 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:12.823261 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 17:40:12.823261 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 17:40:12.823261 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 17:40:12.823261 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 17:40:12.824218 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:12.824218 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:12.824218 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 17:40:12.824218 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:40:12.824218 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 17:40:12.824218 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:40:12.824218 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:12.824218 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:12.824218 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:12.824218 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:12.824218 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:12.824218 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:12.824218 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:12.824218 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:12.824218 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:12.824218 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:12.824218 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:12.824218 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:12.825125 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:12.825125 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:12.825125 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 17:40:12.825125 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 17:40:12.825125 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 17:40:12.825125 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 17:40:12.825125 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 17:40:12.825125 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 17:40:12.825125 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 17:40:12.825125 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:40:12.825125 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 249/494] 10.222.0.67 () {56 vars in 1093 bytes} [Thu Jul 14 17:40:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:12.825717 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836061fa-0319-48c9-ba1e-4ba3fd6e6769 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:12.855053 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9047bcc-1ce8-464c-8c5d-eef2c336a8ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:12.855865 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9047bcc-1ce8-464c-8c5d-eef2c336a8ae None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:12.856146 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9047bcc-1ce8-464c-8c5d-eef2c336a8ae None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:12.856431 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9047bcc-1ce8-464c-8c5d-eef2c336a8ae None admin] PATH_INFO: `/v3/roles/service` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:12.870032 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9047bcc-1ce8-464c-8c5d-eef2c336a8ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:40:12.880125 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-f9047bcc-1ce8-464c-8c5d-eef2c336a8ae None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 17:40:12.880125 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:12.880125 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:12.880125 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:12.880125 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:12.880125 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:12.880125 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:12.880125 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:12.880125 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:12.880125 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:12.880125 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:12.880125 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:12.880125 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:40:12.880125 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:40:12.880125 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:40:12.880125 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:40:12.881985 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:40:12.881985 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:40:12.881985 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:40:12.881985 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:40:12.881985 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:12.881985 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:12.881985 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:12.881985 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:12.881985 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:12.881985 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:12.881985 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:12.881985 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:12.881985 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:12.881985 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:12.881985 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:12.881985 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:12.882828 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:12.882828 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:12.882828 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:12.882828 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:12.882828 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:40:12.882828 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:40:12.882828 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:40:12.882828 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:40:12.882828 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:40:12.882828 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:40:12.882828 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 17:40:12.882828 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:40:12.882828 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 246/495] 10.222.0.67 () {56 vars in 1102 bytes} [Thu Jul 14 17:40:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:12.886912 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bf9388-07d4-4960-b3e7-66c48ceeda3b None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:12.887370 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bf9388-07d4-4960-b3e7-66c48ceeda3b None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:12.887652 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bf9388-07d4-4960-b3e7-66c48ceeda3b None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:12.889149 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 247/496] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:40:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:40:12.890281 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c1d021-d433-4589-9191-1dc360c70de8 None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:12.890569 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c1d021-d433-4589-9191-1dc360c70de8 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:12.890866 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c1d021-d433-4589-9191-1dc360c70de8 None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:12.892524 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 248/497] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:40:12 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:40:12.894163 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c1d021-d433-4589-9191-1dc360c70de8 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:12.944671 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836061fa-0319-48c9-ba1e-4ba3fd6e6769 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:12.989827 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c304ffe6-f307-4ab6-91f8-9b2b736a3961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:12.991090 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c304ffe6-f307-4ab6-91f8-9b2b736a3961 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:12.991384 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c304ffe6-f307-4ab6-91f8-9b2b736a3961 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:12.991662 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c304ffe6-f307-4ab6-91f8-9b2b736a3961 None admin] PATH_INFO: `/v3/domains` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:12.992733 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c304ffe6-f307-4ab6-91f8-9b2b736a3961 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:12.993055 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c304ffe6-f307-4ab6-91f8-9b2b736a3961 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:12.994578 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c304ffe6-f307-4ab6-91f8-9b2b736a3961 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:12.999629 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:13.007049 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 250/498] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 14 17:40:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:13.008025 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c304ffe6-f307-4ab6-91f8-9b2b736a3961 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:13.018095 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c1d021-d433-4589-9191-1dc360c70de8 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:13.024218 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:13.060919 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3bccac-e457-4d14-9e83-e57a1f1efbc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:13.061635 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3bccac-e457-4d14-9e83-e57a1f1efbc2 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:13.061923 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3bccac-e457-4d14-9e83-e57a1f1efbc2 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:13.062202 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3bccac-e457-4d14-9e83-e57a1f1efbc2 None admin] PATH_INFO: `/v3/users` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:13.063127 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3bccac-e457-4d14-9e83-e57a1f1efbc2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:13.063538 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3bccac-e457-4d14-9e83-e57a1f1efbc2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:13.065219 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3bccac-e457-4d14-9e83-e57a1f1efbc2 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:13.106443 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 249/499] 10.222.0.67 () {56 vars in 1133 bytes} [Thu Jul 14 17:40:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:13.107777 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d187cd51-4e66-4116-8bee-3131e5f1e3c1 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:13.108065 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d187cd51-4e66-4116-8bee-3131e5f1e3c1 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:13.108342 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d187cd51-4e66-4116-8bee-3131e5f1e3c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:13.125838 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c304ffe6-f307-4ab6-91f8-9b2b736a3961 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:13.126851 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-d187cd51-4e66-4116-8bee-3131e5f1e3c1 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:40:13.128092 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-d187cd51-4e66-4116-8bee-3131e5f1e3c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:40:13.164727 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e04d2fe-30d5-4ac4-b483-f81e224a4203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:13.165742 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e04d2fe-30d5-4ac4-b483-f81e224a4203 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:13.166175 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e04d2fe-30d5-4ac4-b483-f81e224a4203 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:13.166563 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e04d2fe-30d5-4ac4-b483-f81e224a4203 None admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:13.167735 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e04d2fe-30d5-4ac4-b483-f81e224a4203 None admin] RBAC: Adding query filter params (name=service) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:13.168197 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e04d2fe-30d5-4ac4-b483-f81e224a4203 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:13.169962 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e04d2fe-30d5-4ac4-b483-f81e224a4203 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:13.179524 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 251/500] 10.222.0.67 () {56 vars in 1103 bytes} [Thu Jul 14 17:40:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:13.181004 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3381a7-3ea8-4763-afcc-7477a49b1fe7 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:13.181173 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3381a7-3ea8-4763-afcc-7477a49b1fe7 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:13.181452 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3381a7-3ea8-4763-afcc-7477a49b1fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:13.199517 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-ac3381a7-3ea8-4763-afcc-7477a49b1fe7 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:40:13.200749 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-ac3381a7-3ea8-4763-afcc-7477a49b1fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:40:13.205410 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 250/501] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:40:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:40:13.206311 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d187cd51-4e66-4116-8bee-3131e5f1e3c1 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:13.300087 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:13.306069 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 252/502] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:40:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:40:13.307978 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3381a7-3ea8-4763-afcc-7477a49b1fe7 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:13.311987 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:13.342042 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d187cd51-4e66-4116-8bee-3131e5f1e3c1 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:13.381745 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b68717-8ae2-4d29-bb36-d5873888cd29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:13.382776 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b68717-8ae2-4d29-bb36-d5873888cd29 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:13.383295 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b68717-8ae2-4d29-bb36-d5873888cd29 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:13.383575 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b68717-8ae2-4d29-bb36-d5873888cd29 None admin] PATH_INFO: `/v3/users/glance` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:13.392921 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b68717-8ae2-4d29-bb36-d5873888cd29 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:13.394753 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b68717-8ae2-4d29-bb36-d5873888cd29 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:13.412645 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-e9b68717-8ae2-4d29-bb36-d5873888cd29 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 14 17:40:13.412645 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:13.412645 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:13.412645 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:13.412645 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:13.412645 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:13.412645 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:13.412645 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:13.412645 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:13.412645 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:13.412645 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:13.412645 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:13.412645 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 17:40:13.412645 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 17:40:13.412645 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 17:40:13.412645 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 17:40:13.413892 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:13.413892 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:13.413892 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 17:40:13.413892 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:40:13.413892 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 17:40:13.413892 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:40:13.413892 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:13.413892 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:13.413892 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:13.413892 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:13.413892 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:13.413892 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:13.413892 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:13.413892 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:13.413892 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:13.413892 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:13.413892 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:13.413892 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:13.414811 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:13.414811 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:13.414811 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 17:40:13.414811 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 17:40:13.414811 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 17:40:13.414811 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 17:40:13.414811 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 17:40:13.414811 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 17:40:13.414811 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 14 17:40:13.414811 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:40:13.414811 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 251/503] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 14 17:40:13 2022] GET /identity/v3/users/glance => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:13.414811 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b68717-8ae2-4d29-bb36-d5873888cd29 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:13.428901 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3381a7-3ea8-4763-afcc-7477a49b1fe7 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:13.474631 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1c0e27-154d-422e-84f3-294314889cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:13.476336 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c0e27-154d-422e-84f3-294314889cd6 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:13.476891 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c0e27-154d-422e-84f3-294314889cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:13.477283 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c0e27-154d-422e-84f3-294314889cd6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:13.526637 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b68717-8ae2-4d29-bb36-d5873888cd29 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:13.556974 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:13.559931 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1c0e27-154d-422e-84f3-294314889cd6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:13.561855 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1c0e27-154d-422e-84f3-294314889cd6 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:13.563462 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc3bdc1-b5c5-455a-800d-7528ebb3ac60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:13.564321 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc3bdc1-b5c5-455a-800d-7528ebb3ac60 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:13.564654 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc3bdc1-b5c5-455a-800d-7528ebb3ac60 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:13.564935 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc3bdc1-b5c5-455a-800d-7528ebb3ac60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:13.568307 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:13.577792 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc3bdc1-b5c5-455a-800d-7528ebb3ac60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:13.579500 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc3bdc1-b5c5-455a-800d-7528ebb3ac60 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:13.599549 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-afc3bdc1-b5c5-455a-800d-7528ebb3ac60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:13.599549 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:13.599549 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:13.599549 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:13.599549 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:13.599549 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:13.599549 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:13.599549 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:13.599549 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:13.599549 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:13.599549 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:13.599549 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:13.599549 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:40:13.599549 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:40:13.599549 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:40:13.601401 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:40:13.601401 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:13.601401 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:13.601401 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:13.601401 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:13.601401 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:13.601401 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:13.601401 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:13.601401 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:13.601401 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:13.601401 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:13.601401 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:13.601401 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:13.601401 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:13.601401 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:13.601401 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:13.601401 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:13.602589 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:40:13.602589 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:40:13.602589 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:13.602589 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:40:13.606015 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 252/504] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:40:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:13.606794 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc3bdc1-b5c5-455a-800d-7528ebb3ac60 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:13.684902 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 253/505] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 14 17:40:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 17:40:13.684902 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1c0e27-154d-422e-84f3-294314889cd6 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:13.724069 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc3bdc1-b5c5-455a-800d-7528ebb3ac60 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:13.767021 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925d40af-a535-4d9c-9d3c-856f20d0a73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:13.767872 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d40af-a535-4d9c-9d3c-856f20d0a73a None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:13.768152 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d40af-a535-4d9c-9d3c-856f20d0a73a None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:13.768427 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d40af-a535-4d9c-9d3c-856f20d0a73a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:13.781129 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925d40af-a535-4d9c-9d3c-856f20d0a73a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:13.782743 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925d40af-a535-4d9c-9d3c-856f20d0a73a None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:13.796508 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:13.799652 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1c0e27-154d-422e-84f3-294314889cd6 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:13.803062 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-925d40af-a535-4d9c-9d3c-856f20d0a73a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:13.803062 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:13.803062 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:13.803062 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:13.803062 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:13.803062 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:13.803062 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:13.803062 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:13.803062 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:13.803062 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:13.803062 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:13.803062 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:13.803062 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:40:13.803062 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:40:13.803062 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:40:13.804114 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:40:13.804114 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:13.804114 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:13.804114 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:13.804114 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:13.804114 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:13.804114 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:13.804114 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:13.804114 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:13.804114 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:13.804114 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:13.804114 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:13.804114 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:13.804114 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:13.804114 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:13.804114 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:13.804114 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:13.805010 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:40:13.805010 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:40:13.805010 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:13.805010 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:40:13.805010 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 253/506] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:40:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:13.805283 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925d40af-a535-4d9c-9d3c-856f20d0a73a None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:13.840764 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a4dda0-71d9-4c38-86d1-8af313f74450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:13.841618 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a4dda0-71d9-4c38-86d1-8af313f74450 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:13.841909 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a4dda0-71d9-4c38-86d1-8af313f74450 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:13.842192 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a4dda0-71d9-4c38-86d1-8af313f74450 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:13.854068 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a4dda0-71d9-4c38-86d1-8af313f74450 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:40:13.855109 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:13.862531 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-09a4dda0-71d9-4c38-86d1-8af313f74450 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 17:40:13.862531 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:13.862531 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:13.862531 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:13.862531 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:13.862531 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:13.862531 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:13.862531 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:13.862531 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:13.862531 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:13.862531 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:13.862531 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:13.862531 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:40:13.862531 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:40:13.862531 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:40:13.862531 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:40:13.863535 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:40:13.863535 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:40:13.863535 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:40:13.863535 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:40:13.863535 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:13.863535 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:13.863535 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:13.863535 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:13.863535 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:13.863535 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:13.863535 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:13.863535 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:13.863535 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:13.863535 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:13.863535 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:13.863535 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:13.864377 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:13.864377 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:13.864377 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:13.864377 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:13.864377 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:40:13.864377 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:40:13.864377 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:40:13.864377 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:40:13.864377 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:40:13.864377 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:40:13.864377 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 17:40:13.864377 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:40:13.864377 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 254/507] 10.222.0.67 () {56 vars in 1102 bytes} [Thu Jul 14 17:40:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:13.865505 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a4dda0-71d9-4c38-86d1-8af313f74450 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:13.923288 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925d40af-a535-4d9c-9d3c-856f20d0a73a None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:13.960850 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e84aae9-dc82-44e1-a865-a3f2957db50b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:13.961579 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e84aae9-dc82-44e1-a865-a3f2957db50b None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:13.961866 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e84aae9-dc82-44e1-a865-a3f2957db50b None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:13.962149 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e84aae9-dc82-44e1-a865-a3f2957db50b None admin] PATH_INFO: `/v3/users` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:13.963022 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e84aae9-dc82-44e1-a865-a3f2957db50b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:13.963334 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e84aae9-dc82-44e1-a865-a3f2957db50b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:13.964833 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e84aae9-dc82-44e1-a865-a3f2957db50b None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:13.975549 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a4dda0-71d9-4c38-86d1-8af313f74450 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:13.984402 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 254/508] 10.222.0.67 () {56 vars in 1137 bytes} [Thu Jul 14 17:40:13 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:13.989666 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e84aae9-dc82-44e1-a865-a3f2957db50b None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:14.015277 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc02099-966d-447c-8a17-60333ae03df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:14.015944 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc02099-966d-447c-8a17-60333ae03df6 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:14.016233 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc02099-966d-447c-8a17-60333ae03df6 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:14.016509 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc02099-966d-447c-8a17-60333ae03df6 None admin] PATH_INFO: `/v3/domains` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:14.017232 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc02099-966d-447c-8a17-60333ae03df6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:14.017548 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc02099-966d-447c-8a17-60333ae03df6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:14.018940 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc02099-966d-447c-8a17-60333ae03df6 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:14.031529 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 255/509] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 14 17:40:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:14.032677 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc02099-966d-447c-8a17-60333ae03df6 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:14.055832 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:14.088081 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:14.092191 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e84aae9-dc82-44e1-a865-a3f2957db50b None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:14.136346 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b4e7e8-4acc-4108-a76f-1a33955e49da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:14.137626 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b4e7e8-4acc-4108-a76f-1a33955e49da None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:14.138076 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b4e7e8-4acc-4108-a76f-1a33955e49da None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:14.138522 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b4e7e8-4acc-4108-a76f-1a33955e49da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:14.153227 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc02099-966d-447c-8a17-60333ae03df6 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:14.153584 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b4e7e8-4acc-4108-a76f-1a33955e49da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:14.155287 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b4e7e8-4acc-4108-a76f-1a33955e49da None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:14.180728 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-d8b4e7e8-4acc-4108-a76f-1a33955e49da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:14.180728 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:14.180728 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:14.180728 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:14.180728 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:14.180728 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:14.180728 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:14.180728 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:14.180728 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:14.180728 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:14.180728 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:14.180728 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:14.180728 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:40:14.180728 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:40:14.180728 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:40:14.182038 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:40:14.182038 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:14.182038 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:14.182038 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:14.182038 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:14.182038 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:14.182038 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:14.182038 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:14.182038 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:14.182038 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:14.182038 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:14.182038 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:14.182038 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:14.182038 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:14.182038 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:14.182038 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:14.182038 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:14.183389 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:40:14.183389 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:40:14.183389 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:14.183389 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:40:14.183389 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 255/510] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:40:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:14.184129 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b4e7e8-4acc-4108-a76f-1a33955e49da None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:14.192093 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96bd6a4-dbeb-4767-8c73-3b53388d0c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:14.193125 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96bd6a4-dbeb-4767-8c73-3b53388d0c8e None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:14.194156 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96bd6a4-dbeb-4767-8c73-3b53388d0c8e None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:14.194595 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96bd6a4-dbeb-4767-8c73-3b53388d0c8e None admin] PATH_INFO: `/v3/domains` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:14.195789 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96bd6a4-dbeb-4767-8c73-3b53388d0c8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:14.196314 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96bd6a4-dbeb-4767-8c73-3b53388d0c8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:14.198746 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96bd6a4-dbeb-4767-8c73-3b53388d0c8e None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:14.216023 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 256/511] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 14 17:40:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:14.216878 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96bd6a4-dbeb-4767-8c73-3b53388d0c8e None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:14.295184 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b4e7e8-4acc-4108-a76f-1a33955e49da None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:14.310935 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:14.334162 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2713cb8e-d7dc-49fe-a8d5-1bbb55d8b3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:14.334585 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96bd6a4-dbeb-4767-8c73-3b53388d0c8e None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:14.334886 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2713cb8e-d7dc-49fe-a8d5-1bbb55d8b3ad None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:14.335182 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2713cb8e-d7dc-49fe-a8d5-1bbb55d8b3ad None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:14.335459 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2713cb8e-d7dc-49fe-a8d5-1bbb55d8b3ad None admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:14.336488 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2713cb8e-d7dc-49fe-a8d5-1bbb55d8b3ad None admin] RBAC: Adding query filter params (name=service) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:14.336923 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2713cb8e-d7dc-49fe-a8d5-1bbb55d8b3ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:14.338719 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2713cb8e-d7dc-49fe-a8d5-1bbb55d8b3ad None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:14.348311 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 256/512] 10.222.0.67 () {56 vars in 1103 bytes} [Thu Jul 14 17:40:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:14.349650 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2713cb8e-d7dc-49fe-a8d5-1bbb55d8b3ad None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:14.367398 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:14.372993 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60939239-56f4-4693-8be7-3dbe7ef4bcbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:14.373685 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60939239-56f4-4693-8be7-3dbe7ef4bcbc None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:14.373969 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60939239-56f4-4693-8be7-3dbe7ef4bcbc None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:14.374242 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60939239-56f4-4693-8be7-3dbe7ef4bcbc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:14.446335 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60939239-56f4-4693-8be7-3dbe7ef4bcbc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:14.447942 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60939239-56f4-4693-8be7-3dbe7ef4bcbc None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:14.461298 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2713cb8e-d7dc-49fe-a8d5-1bbb55d8b3ad None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:14.498692 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d518b827-8629-4d4a-83b7-ebc6847779fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:14.499507 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d518b827-8629-4d4a-83b7-ebc6847779fa None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:14.499798 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d518b827-8629-4d4a-83b7-ebc6847779fa None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:14.500077 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d518b827-8629-4d4a-83b7-ebc6847779fa None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:14.508858 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d518b827-8629-4d4a-83b7-ebc6847779fa None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:14.510363 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d518b827-8629-4d4a-83b7-ebc6847779fa None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:14.526489 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-d518b827-8629-4d4a-83b7-ebc6847779fa None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 17:40:14.526489 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:14.526489 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:14.526489 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:14.526489 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:14.526489 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:14.526489 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:14.526489 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:14.526489 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:14.526489 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:14.526489 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:14.526489 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:14.526489 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 17:40:14.526489 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 17:40:14.526489 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 17:40:14.526489 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 17:40:14.527515 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:14.527515 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:14.527515 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 17:40:14.527515 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:40:14.527515 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 17:40:14.527515 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:40:14.527515 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:14.527515 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:14.527515 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:14.527515 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:14.527515 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:14.527515 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:14.527515 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:14.527515 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:14.527515 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:14.527515 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:14.527515 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:14.527515 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:14.528437 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:14.528437 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:14.528437 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 17:40:14.528437 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 17:40:14.528437 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 17:40:14.528437 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 17:40:14.528437 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 17:40:14.528437 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 17:40:14.528437 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 17:40:14.528437 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:40:14.528437 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 257/513] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 14 17:40:14 2022] GET /identity/v3/users/cinder => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:14.529407 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d518b827-8629-4d4a-83b7-ebc6847779fa None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:14.537996 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:14.559536 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 257/514] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 14 17:40:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 17:40:14.560760 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60939239-56f4-4693-8be7-3dbe7ef4bcbc None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:14.605113 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:14.638302 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d518b827-8629-4d4a-83b7-ebc6847779fa None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:14.668923 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60939239-56f4-4693-8be7-3dbe7ef4bcbc None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:14.673330 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8500bea8-b70a-4b89-8253-ad5f2de86ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:14.674045 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8500bea8-b70a-4b89-8253-ad5f2de86ca3 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:14.674328 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8500bea8-b70a-4b89-8253-ad5f2de86ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:14.674604 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8500bea8-b70a-4b89-8253-ad5f2de86ca3 None admin] PATH_INFO: `/v3/domains` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:14.675342 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8500bea8-b70a-4b89-8253-ad5f2de86ca3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:14.675647 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8500bea8-b70a-4b89-8253-ad5f2de86ca3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:14.677054 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8500bea8-b70a-4b89-8253-ad5f2de86ca3 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:14.691492 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 258/515] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 14 17:40:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:14.692364 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8500bea8-b70a-4b89-8253-ad5f2de86ca3 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:14.707901 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af583bd8-00d6-4878-af3c-0358d791d3dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:14.708603 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af583bd8-00d6-4878-af3c-0358d791d3dd None admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:14.708912 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af583bd8-00d6-4878-af3c-0358d791d3dd None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:14.709203 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af583bd8-00d6-4878-af3c-0358d791d3dd None admin] PATH_INFO: `/v3/users` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:14.709965 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af583bd8-00d6-4878-af3c-0358d791d3dd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:14.711439 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af583bd8-00d6-4878-af3c-0358d791d3dd None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:14.735380 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 258/516] 10.222.0.67 () {60 vars in 1132 bytes} [Thu Jul 14 17:40:14 2022] POST /identity/v3/users => generated 247 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:40:14.736238 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af583bd8-00d6-4878-af3c-0358d791d3dd None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:14.782399 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:14.817231 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8500bea8-b70a-4b89-8253-ad5f2de86ca3 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:14.852855 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:14.859422 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294a86cc-24df-49a8-a515-a19be8f64b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:14.860792 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294a86cc-24df-49a8-a515-a19be8f64b17 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:14.861081 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294a86cc-24df-49a8-a515-a19be8f64b17 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:14.861556 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294a86cc-24df-49a8-a515-a19be8f64b17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:14.865279 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af583bd8-00d6-4878-af3c-0358d791d3dd None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:14.874741 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294a86cc-24df-49a8-a515-a19be8f64b17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:14.876243 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294a86cc-24df-49a8-a515-a19be8f64b17 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:14.895208 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-294a86cc-24df-49a8-a515-a19be8f64b17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:14.895208 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:14.895208 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:14.895208 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:14.895208 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:14.895208 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:14.895208 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:14.895208 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:14.895208 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:14.895208 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:14.895208 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:14.895208 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:14.895208 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:40:14.895208 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:40:14.895208 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:40:14.896287 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:40:14.896287 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:14.896287 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:14.896287 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:14.896287 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:14.896287 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:14.896287 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:14.896287 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:14.896287 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:14.896287 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:14.896287 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:14.896287 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:14.896287 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:14.896287 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:14.896287 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:14.896287 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:14.896287 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:14.898407 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:40:14.898407 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:40:14.898407 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:14.898407 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:40:14.898407 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 259/517] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:40:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:14.898407 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294a86cc-24df-49a8-a515-a19be8f64b17 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:14.907150 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4245cbaf-56d7-4e1b-b0f7-30ed81727fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:14.907866 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4245cbaf-56d7-4e1b-b0f7-30ed81727fe2 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:14.908134 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4245cbaf-56d7-4e1b-b0f7-30ed81727fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:14.908399 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4245cbaf-56d7-4e1b-b0f7-30ed81727fe2 None admin] PATH_INFO: `/v3/users` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:14.909261 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4245cbaf-56d7-4e1b-b0f7-30ed81727fe2 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:14.909608 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4245cbaf-56d7-4e1b-b0f7-30ed81727fe2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:14.911061 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4245cbaf-56d7-4e1b-b0f7-30ed81727fe2 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:14.950657 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 259/518] 10.222.0.67 () {56 vars in 1137 bytes} [Thu Jul 14 17:40:14 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:14.951497 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4245cbaf-56d7-4e1b-b0f7-30ed81727fe2 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:15.017906 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294a86cc-24df-49a8-a515-a19be8f64b17 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:15.048935 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:15.056071 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4245cbaf-56d7-4e1b-b0f7-30ed81727fe2 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:15.057676 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d36b37-4123-4cf5-922d-1b1d1115350b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:15.058608 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d36b37-4123-4cf5-922d-1b1d1115350b None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:15.058888 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d36b37-4123-4cf5-922d-1b1d1115350b None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:15.059169 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d36b37-4123-4cf5-922d-1b1d1115350b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:15.070546 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d36b37-4123-4cf5-922d-1b1d1115350b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:15.072064 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d36b37-4123-4cf5-922d-1b1d1115350b None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:15.091490 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-d3d36b37-4123-4cf5-922d-1b1d1115350b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:15.091490 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:15.091490 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:15.091490 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:15.091490 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:15.091490 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:15.091490 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:15.091490 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:15.091490 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:15.091490 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:15.091490 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:15.091490 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:15.091490 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:40:15.091490 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:40:15.091490 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:40:15.092422 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:40:15.092422 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:15.092422 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:15.092422 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:15.092422 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:15.092422 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:15.092422 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:15.092422 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:15.092422 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:15.092422 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:15.092422 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:15.092422 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:15.092422 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:15.092422 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:15.092422 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:15.092422 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:15.092422 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:15.093312 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:40:15.093312 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:40:15.093312 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:15.093312 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:40:15.093312 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 260/519] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:40:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:15.093644 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d36b37-4123-4cf5-922d-1b1d1115350b None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:15.100726 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaba39ad-2168-4884-b51c-986c7d06149f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:15.101576 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba39ad-2168-4884-b51c-986c7d06149f None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:15.101865 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba39ad-2168-4884-b51c-986c7d06149f None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:15.102141 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba39ad-2168-4884-b51c-986c7d06149f None admin] PATH_INFO: `/v3/projects/service` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:15.111012 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaba39ad-2168-4884-b51c-986c7d06149f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:15.112507 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaba39ad-2168-4884-b51c-986c7d06149f None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:15.129110 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-aaba39ad-2168-4884-b51c-986c7d06149f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:40:15.129110 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:15.129110 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:15.129110 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:15.129110 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:15.129110 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:15.129110 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:15.129110 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:15.129110 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:15.129110 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:15.129110 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:15.129110 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:15.129110 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 17:40:15.129110 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 17:40:15.129110 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 17:40:15.130115 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 17:40:15.130115 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:15.130115 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:15.130115 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:15.130115 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:15.130115 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:15.130115 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:15.130115 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:15.130115 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:15.130115 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:15.130115 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:15.130115 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:15.130115 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:15.130115 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:15.130115 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:15.130115 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:15.130115 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:15.131627 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 17:40:15.131627 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 17:40:15.131627 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 17:40:15.131627 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 17:40:15.131627 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 17:40:15.131627 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 17:40:15.131627 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:40:15.131627 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:40:15.131627 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 260/520] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 14 17:40:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:15.132100 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaba39ad-2168-4884-b51c-986c7d06149f None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:15.140741 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:15.219419 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d36b37-4123-4cf5-922d-1b1d1115350b None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:15.245323 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaba39ad-2168-4884-b51c-986c7d06149f None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:15.260528 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e982ecf6-7503-4852-854a-a62151d3fac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:15.261219 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e982ecf6-7503-4852-854a-a62151d3fac7 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:15.261507 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e982ecf6-7503-4852-854a-a62151d3fac7 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:15.261814 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e982ecf6-7503-4852-854a-a62151d3fac7 None admin] PATH_INFO: `/v3/domains` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:15.262557 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e982ecf6-7503-4852-854a-a62151d3fac7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:15.262867 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e982ecf6-7503-4852-854a-a62151d3fac7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:15.264248 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e982ecf6-7503-4852-854a-a62151d3fac7 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:15.277340 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 261/521] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 14 17:40:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:15.277961 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e982ecf6-7503-4852-854a-a62151d3fac7 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:15.287669 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af3d8b6-a3a8-4f3a-93b3-fcfe3eb2f003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:15.288454 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af3d8b6-a3a8-4f3a-93b3-fcfe3eb2f003 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:15.288644 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af3d8b6-a3a8-4f3a-93b3-fcfe3eb2f003 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:15.288892 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af3d8b6-a3a8-4f3a-93b3-fcfe3eb2f003 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:15.316929 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:15.368826 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af3d8b6-a3a8-4f3a-93b3-fcfe3eb2f003 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:15.370327 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af3d8b6-a3a8-4f3a-93b3-fcfe3eb2f003 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:15.381498 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:15.388252 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e982ecf6-7503-4852-854a-a62151d3fac7 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:15.423523 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d392c244-5b1d-400e-beaa-da1b279f996a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:15.424220 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d392c244-5b1d-400e-beaa-da1b279f996a None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:15.424508 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d392c244-5b1d-400e-beaa-da1b279f996a None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:15.424790 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d392c244-5b1d-400e-beaa-da1b279f996a None admin] PATH_INFO: `/v3/domains` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:15.425581 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d392c244-5b1d-400e-beaa-da1b279f996a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:15.425900 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d392c244-5b1d-400e-beaa-da1b279f996a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:15.427371 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d392c244-5b1d-400e-beaa-da1b279f996a None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:15.441986 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 262/522] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 14 17:40:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:15.442846 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d392c244-5b1d-400e-beaa-da1b279f996a None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:15.492794 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 261/523] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 14 17:40:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 17:40:15.492794 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af3d8b6-a3a8-4f3a-93b3-fcfe3eb2f003 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:15.550507 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:15.566865 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d392c244-5b1d-400e-beaa-da1b279f996a None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:15.601881 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7223f674-1bda-4e28-a7ce-8b039d530174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:15.602549 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223f674-1bda-4e28-a7ce-8b039d530174 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:15.602836 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223f674-1bda-4e28-a7ce-8b039d530174 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:15.603117 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223f674-1bda-4e28-a7ce-8b039d530174 None admin] PATH_INFO: `/v3/projects` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:15.604034 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7223f674-1bda-4e28-a7ce-8b039d530174 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:15.604346 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7223f674-1bda-4e28-a7ce-8b039d530174 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:15.605819 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7223f674-1bda-4e28-a7ce-8b039d530174 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:15.609142 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af3d8b6-a3a8-4f3a-93b3-fcfe3eb2f003 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:15.625886 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 263/524] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 14 17:40:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:15.626648 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7223f674-1bda-4e28-a7ce-8b039d530174 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:15.644619 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:15.658164 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacba467-a4bd-40a7-8ba4-0700e7eb9db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:15.658966 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacba467-a4bd-40a7-8ba4-0700e7eb9db4 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:15.659252 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacba467-a4bd-40a7-8ba4-0700e7eb9db4 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:15.659529 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacba467-a4bd-40a7-8ba4-0700e7eb9db4 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:15.667740 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacba467-a4bd-40a7-8ba4-0700e7eb9db4 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:15.669210 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacba467-a4bd-40a7-8ba4-0700e7eb9db4 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:15.685235 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-aacba467-a4bd-40a7-8ba4-0700e7eb9db4 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 14 17:40:15.685235 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:15.685235 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:15.685235 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:15.685235 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:15.685235 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:15.685235 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:15.685235 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:15.685235 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:15.685235 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:15.685235 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:15.685235 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:15.685235 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 17:40:15.685235 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 17:40:15.685235 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 17:40:15.685235 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 17:40:15.686365 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:15.686365 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:15.686365 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 17:40:15.686365 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:40:15.686365 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 17:40:15.686365 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:40:15.686365 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:15.686365 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:15.686365 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:15.686365 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:15.686365 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:15.686365 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:15.686365 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:15.686365 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:15.686365 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:15.686365 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:15.686365 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:15.686365 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:15.687369 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:15.687369 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:15.687369 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 17:40:15.687369 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 17:40:15.687369 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 17:40:15.687369 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 17:40:15.687369 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 17:40:15.687369 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 17:40:15.687369 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 14 17:40:15.687369 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:40:15.687369 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 262/525] 10.222.0.67 () {56 vars in 1102 bytes} [Thu Jul 14 17:40:15 2022] GET /identity/v3/users/neutron => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:15.687369 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacba467-a4bd-40a7-8ba4-0700e7eb9db4 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:15.751921 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7223f674-1bda-4e28-a7ce-8b039d530174 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:15.791201 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c360d5df-4416-4d2b-b731-5ff6b8ca3e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:15.792015 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c360d5df-4416-4d2b-b731-5ff6b8ca3e3d None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:15.792317 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c360d5df-4416-4d2b-b731-5ff6b8ca3e3d None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:15.792594 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c360d5df-4416-4d2b-b731-5ff6b8ca3e3d None admin] PATH_INFO: `/v3/projects/service` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:15.799823 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c360d5df-4416-4d2b-b731-5ff6b8ca3e3d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:15.801289 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c360d5df-4416-4d2b-b731-5ff6b8ca3e3d None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:15.806413 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacba467-a4bd-40a7-8ba4-0700e7eb9db4 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:15.817368 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-c360d5df-4416-4d2b-b731-5ff6b8ca3e3d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:40:15.817368 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:15.817368 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:15.817368 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:15.817368 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:15.817368 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:15.817368 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:15.817368 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:15.817368 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:15.817368 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:15.817368 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:15.817368 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:15.817368 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 17:40:15.817368 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 17:40:15.817368 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 17:40:15.824400 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 17:40:15.824400 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:15.824400 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:15.824400 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:15.824400 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:15.824400 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:15.824400 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:15.824400 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:15.824400 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:15.824400 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:15.824400 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:15.824400 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:15.824400 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:15.824400 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:15.824400 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:15.824400 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:15.824400 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:15.825293 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 17:40:15.825293 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 17:40:15.825293 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 17:40:15.825293 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 17:40:15.825293 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 17:40:15.825293 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 17:40:15.825293 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:40:15.825293 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:40:15.825293 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 264/526] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 14 17:40:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:15.825293 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c360d5df-4416-4d2b-b731-5ff6b8ca3e3d None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:15.831289 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:15.853492 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8b2324-0627-41a7-b169-662f25718997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:15.854323 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b2324-0627-41a7-b169-662f25718997 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:15.854647 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b2324-0627-41a7-b169-662f25718997 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:15.854890 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b2324-0627-41a7-b169-662f25718997 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:15.868798 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8b2324-0627-41a7-b169-662f25718997 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:15.870380 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8b2324-0627-41a7-b169-662f25718997 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:15.889624 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-6a8b2324-0627-41a7-b169-662f25718997 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:15.889624 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:15.889624 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:15.889624 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:15.889624 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:15.889624 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:15.889624 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:15.889624 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:15.889624 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:15.889624 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:15.889624 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:15.889624 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:15.889624 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:40:15.889624 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:40:15.889624 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:40:15.890703 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:40:15.890703 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:15.890703 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:15.890703 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:15.890703 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:15.890703 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:15.890703 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:15.890703 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:15.890703 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:15.890703 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:15.890703 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:15.890703 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:15.890703 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:15.890703 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:15.890703 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:15.890703 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:15.890703 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:15.891780 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:40:15.891780 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:40:15.891780 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:15.891780 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:40:15.895552 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 263/527] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:40:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:15.896662 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8b2324-0627-41a7-b169-662f25718997 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:15.912745 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:15.939426 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c360d5df-4416-4d2b-b731-5ff6b8ca3e3d None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:15.975181 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e48e20-ca2d-44d7-bb80-76fa2ccf72b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:15.975840 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e48e20-ca2d-44d7-bb80-76fa2ccf72b5 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:15.976120 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e48e20-ca2d-44d7-bb80-76fa2ccf72b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:15.976390 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e48e20-ca2d-44d7-bb80-76fa2ccf72b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:15.977232 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e48e20-ca2d-44d7-bb80-76fa2ccf72b5 None admin] RBAC: Adding query filter params (role.id=edc349453a61464087c153399e397247, scope.project.id=39a570421bb64fac8b1a0129f1bcc7d9, user.id=41b893bdf4ec474dbfa819c22fc29ce9) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:15.977568 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e48e20-ca2d-44d7-bb80-76fa2ccf72b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:15.979012 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e48e20-ca2d-44d7-bb80-76fa2ccf72b5 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:15.986569 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 265/528] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 14 17:40:15 2022] GET /identity/v3/role_assignments?user.id=41b893bdf4ec474dbfa819c22fc29ce9&scope.project.id=39a570421bb64fac8b1a0129f1bcc7d9&role.id=edc349453a61464087c153399e397247 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:15.988265 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e48e20-ca2d-44d7-bb80-76fa2ccf72b5 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:16.019595 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8b2324-0627-41a7-b169-662f25718997 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:16.062113 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f94b2b-79e1-4f93-96de-89182dd8c4d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:16.062934 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f94b2b-79e1-4f93-96de-89182dd8c4d1 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:16.063226 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f94b2b-79e1-4f93-96de-89182dd8c4d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:16.063507 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f94b2b-79e1-4f93-96de-89182dd8c4d1 None admin] PATH_INFO: `/v3/users` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:16.064517 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f94b2b-79e1-4f93-96de-89182dd8c4d1 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:16.064837 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f94b2b-79e1-4f93-96de-89182dd8c4d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:16.066388 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f94b2b-79e1-4f93-96de-89182dd8c4d1 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:16.090862 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 264/529] 10.222.0.67 () {56 vars in 1139 bytes} [Thu Jul 14 17:40:15 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:16.091795 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f94b2b-79e1-4f93-96de-89182dd8c4d1 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:16.130069 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:16.160899 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e48e20-ca2d-44d7-bb80-76fa2ccf72b5 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:16.218886 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b12ec73-8f5d-4d67-9c68-c93f8f59941f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:16.219574 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b12ec73-8f5d-4d67-9c68-c93f8f59941f None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:16.219860 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b12ec73-8f5d-4d67-9c68-c93f8f59941f None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:16.220138 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b12ec73-8f5d-4d67-9c68-c93f8f59941f None admin] PATH_INFO: `/v3/projects` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:16.220961 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b12ec73-8f5d-4d67-9c68-c93f8f59941f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:16.221273 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b12ec73-8f5d-4d67-9c68-c93f8f59941f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:16.221989 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f94b2b-79e1-4f93-96de-89182dd8c4d1 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:16.222901 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b12ec73-8f5d-4d67-9c68-c93f8f59941f None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:16.236133 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:16.240572 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 266/530] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 14 17:40:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:16.241435 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b12ec73-8f5d-4d67-9c68-c93f8f59941f None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:16.269383 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479197bb-040b-42c6-85bb-4267f21c2455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:16.270403 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479197bb-040b-42c6-85bb-4267f21c2455 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:16.270688 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479197bb-040b-42c6-85bb-4267f21c2455 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:16.270969 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479197bb-040b-42c6-85bb-4267f21c2455 None admin] PATH_INFO: `/v3/domains` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:16.272567 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479197bb-040b-42c6-85bb-4267f21c2455 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:16.272887 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479197bb-040b-42c6-85bb-4267f21c2455 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:16.274791 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479197bb-040b-42c6-85bb-4267f21c2455 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:16.291343 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 265/531] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 14 17:40:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:16.293084 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479197bb-040b-42c6-85bb-4267f21c2455 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:16.391517 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b12ec73-8f5d-4d67-9c68-c93f8f59941f None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:16.432186 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022b97cb-863c-4f4f-abf6-ad1a61bc6048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:16.432769 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022b97cb-863c-4f4f-abf6-ad1a61bc6048 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:16.433053 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022b97cb-863c-4f4f-abf6-ad1a61bc6048 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:16.433332 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022b97cb-863c-4f4f-abf6-ad1a61bc6048 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:16.436273 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:16.462734 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479197bb-040b-42c6-85bb-4267f21c2455 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:16.508451 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c00477d-73b7-4c7f-92e9-d6985f7ef4b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:16.509560 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c00477d-73b7-4c7f-92e9-d6985f7ef4b5 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:16.510224 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c00477d-73b7-4c7f-92e9-d6985f7ef4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:16.510830 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c00477d-73b7-4c7f-92e9-d6985f7ef4b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:16.512037 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c00477d-73b7-4c7f-92e9-d6985f7ef4b5 None admin] RBAC: Adding query filter params (role.id=edc349453a61464087c153399e397247, scope.project.id=39a570421bb64fac8b1a0129f1bcc7d9, user.id=4eb7180aab4541b4aab6cf8648eac1f1) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:16.512591 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c00477d-73b7-4c7f-92e9-d6985f7ef4b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:16.514341 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c00477d-73b7-4c7f-92e9-d6985f7ef4b5 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:16.515829 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:16.520098 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022b97cb-863c-4f4f-abf6-ad1a61bc6048 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:16.522527 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022b97cb-863c-4f4f-abf6-ad1a61bc6048 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:16.527820 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 266/532] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 14 17:40:16 2022] GET /identity/v3/role_assignments?user.id=4eb7180aab4541b4aab6cf8648eac1f1&scope.project.id=39a570421bb64fac8b1a0129f1bcc7d9&role.id=edc349453a61464087c153399e397247 => generated 259 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:16.527820 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c00477d-73b7-4c7f-92e9-d6985f7ef4b5 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:16.765019 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c00477d-73b7-4c7f-92e9-d6985f7ef4b5 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:16.774400 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 267/533] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 14 17:40:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 17:40:16.780455 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022b97cb-863c-4f4f-abf6-ad1a61bc6048 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:16.830056 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3796b3-4018-47a7-9d5b-4f9ad1713e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:16.831380 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3796b3-4018-47a7-9d5b-4f9ad1713e2a None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:16.831868 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3796b3-4018-47a7-9d5b-4f9ad1713e2a None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:16.832347 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3796b3-4018-47a7-9d5b-4f9ad1713e2a None admin] PATH_INFO: `/v3/projects/service` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:16.845214 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3796b3-4018-47a7-9d5b-4f9ad1713e2a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:16.848137 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3796b3-4018-47a7-9d5b-4f9ad1713e2a None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:16.876862 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-9a3796b3-4018-47a7-9d5b-4f9ad1713e2a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:40:16.876862 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:16.876862 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:16.876862 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:16.876862 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:16.876862 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:16.876862 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:16.876862 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:16.876862 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:16.876862 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:16.876862 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:16.876862 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:16.876862 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 17:40:16.876862 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 17:40:16.876862 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 17:40:16.877828 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 17:40:16.877828 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:16.877828 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:16.877828 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:16.877828 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:16.877828 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:16.877828 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:16.877828 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:16.877828 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:16.877828 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:16.877828 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:16.877828 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:16.877828 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:16.877828 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:16.877828 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:16.877828 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:16.877828 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:16.878698 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 17:40:16.878698 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 17:40:16.878698 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 17:40:16.878698 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 17:40:16.878698 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 17:40:16.878698 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 17:40:16.878698 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:40:16.878698 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:40:16.879604 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 267/534] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 14 17:40:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:16.886108 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3796b3-4018-47a7-9d5b-4f9ad1713e2a None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:16.904894 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:16.931654 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:16.936349 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022b97cb-863c-4f4f-abf6-ad1a61bc6048 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:16.996642 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c15759-f4b5-44b7-8a66-79a8f9f6a6b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:16.997737 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c15759-f4b5-44b7-8a66-79a8f9f6a6b2 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:16.998166 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c15759-f4b5-44b7-8a66-79a8f9f6a6b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:16.998610 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c15759-f4b5-44b7-8a66-79a8f9f6a6b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:17.011551 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c15759-f4b5-44b7-8a66-79a8f9f6a6b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:17.014037 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c15759-f4b5-44b7-8a66-79a8f9f6a6b2 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:17.035487 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-e6c15759-f4b5-44b7-8a66-79a8f9f6a6b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:17.035487 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:17.035487 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:17.035487 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:17.035487 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:17.035487 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:17.035487 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:17.035487 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:17.035487 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:17.035487 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:17.035487 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:17.035487 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:17.035487 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:40:17.035487 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:40:17.035487 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:40:17.036399 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:40:17.036399 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:17.036399 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:17.036399 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:17.036399 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:17.036399 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:17.036399 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:17.036399 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:17.036399 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:17.036399 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:17.036399 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:17.036399 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:17.036399 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:17.036399 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:17.036399 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:17.036399 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:17.036399 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:17.037831 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:40:17.037831 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:40:17.037831 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:17.037831 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:40:17.040215 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 268/535] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:40:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 17:40:17.041844 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d7edc-01f7-425b-8df7-88f0619c5600 None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:17.042388 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d7edc-01f7-425b-8df7-88f0619c5600 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:17.042861 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d7edc-01f7-425b-8df7-88f0619c5600 None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:17.049084 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 269/536] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:40:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:40:17.050312 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682d7edc-01f7-425b-8df7-88f0619c5600 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:17.063595 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3796b3-4018-47a7-9d5b-4f9ad1713e2a None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:17.124084 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ab4214-6542-40ad-bb4f-b8261884682a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:17.125402 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ab4214-6542-40ad-bb4f-b8261884682a None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:17.126330 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ab4214-6542-40ad-bb4f-b8261884682a None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:17.126641 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ab4214-6542-40ad-bb4f-b8261884682a None admin] PATH_INFO: `/v3/projects` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:17.127495 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ab4214-6542-40ad-bb4f-b8261884682a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:17.128282 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ab4214-6542-40ad-bb4f-b8261884682a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:17.130567 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ab4214-6542-40ad-bb4f-b8261884682a None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:17.159861 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 268/537] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 14 17:40:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:17.161881 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c84080-e4af-4532-be99-c69ba342d8d9 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:17.163113 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c84080-e4af-4532-be99-c69ba342d8d9 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:17.163628 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c84080-e4af-4532-be99-c69ba342d8d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:17.191064 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-74c84080-e4af-4532-be99-c69ba342d8d9 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:40:17.192337 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-74c84080-e4af-4532-be99-c69ba342d8d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:40:17.195244 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682d7edc-01f7-425b-8df7-88f0619c5600 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:17.242337 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466ca55a-0912-4678-9389-1d73deadde92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:17.243538 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ca55a-0912-4678-9389-1d73deadde92 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:17.244096 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ca55a-0912-4678-9389-1d73deadde92 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:17.244597 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ca55a-0912-4678-9389-1d73deadde92 None admin] PATH_INFO: `/v3/domains` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:17.245917 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466ca55a-0912-4678-9389-1d73deadde92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:17.246598 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466ca55a-0912-4678-9389-1d73deadde92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:17.248663 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466ca55a-0912-4678-9389-1d73deadde92 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:17.264051 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 270/538] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 14 17:40:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:17.265482 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466ca55a-0912-4678-9389-1d73deadde92 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:17.280971 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:17.297638 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 269/539] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:40:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:40:17.297638 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c84080-e4af-4532-be99-c69ba342d8d9 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:17.299066 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:17.423634 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c84080-e4af-4532-be99-c69ba342d8d9 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:17.436879 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466ca55a-0912-4678-9389-1d73deadde92 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:17.488430 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c266db-79b1-422e-a55d-5dd38af13d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:17.489235 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c266db-79b1-422e-a55d-5dd38af13d0b None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:17.489557 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c266db-79b1-422e-a55d-5dd38af13d0b None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:17.490601 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c266db-79b1-422e-a55d-5dd38af13d0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:17.492521 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c266db-79b1-422e-a55d-5dd38af13d0b None admin] RBAC: Adding query filter params (role.id=edc349453a61464087c153399e397247, scope.project.id=39a570421bb64fac8b1a0129f1bcc7d9, user.id=de55cae1600841889668e36402861203) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:17.493073 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c266db-79b1-422e-a55d-5dd38af13d0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:17.495724 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c266db-79b1-422e-a55d-5dd38af13d0b None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:17.497062 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7767deb8-c314-493d-928a-0461b290af5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:17.498195 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7767deb8-c314-493d-928a-0461b290af5e None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:17.499268 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7767deb8-c314-493d-928a-0461b290af5e None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:17.499766 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7767deb8-c314-493d-928a-0461b290af5e None admin] PATH_INFO: `/v3/projects/service` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:17.504711 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 271/540] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 14 17:40:17 2022] GET /identity/v3/role_assignments?user.id=de55cae1600841889668e36402861203&scope.project.id=39a570421bb64fac8b1a0129f1bcc7d9&role.id=edc349453a61464087c153399e397247 => generated 259 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:17.510566 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7767deb8-c314-493d-928a-0461b290af5e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:17.511265 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c266db-79b1-422e-a55d-5dd38af13d0b None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:17.513341 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7767deb8-c314-493d-928a-0461b290af5e None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:17.532353 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-7767deb8-c314-493d-928a-0461b290af5e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:40:17.532353 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:17.532353 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:17.532353 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:17.532353 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:17.532353 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:17.532353 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:17.532353 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:17.532353 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:17.532353 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:17.532353 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:17.532353 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:17.532353 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 17:40:17.532353 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 17:40:17.532353 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 17:40:17.533510 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 17:40:17.533510 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:17.533510 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:17.533510 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:17.533510 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:17.533510 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:17.533510 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:17.533510 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:17.533510 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:17.533510 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:17.533510 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:17.533510 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:17.533510 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:17.533510 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:17.533510 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:17.533510 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:17.533510 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:17.534675 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 17:40:17.534675 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 17:40:17.534675 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 17:40:17.534675 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 17:40:17.534675 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 17:40:17.534675 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 17:40:17.534675 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:40:17.534675 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:40:17.538311 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 270/541] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 14 17:40:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:17.547513 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7767deb8-c314-493d-928a-0461b290af5e None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:17.663877 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:17.691547 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:17.692681 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c266db-79b1-422e-a55d-5dd38af13d0b None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:17.737899 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544929ca-8ee8-43ab-bf63-1b576340b075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:17.738741 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544929ca-8ee8-43ab-bf63-1b576340b075 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:17.739027 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544929ca-8ee8-43ab-bf63-1b576340b075 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:17.739311 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544929ca-8ee8-43ab-bf63-1b576340b075 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:17.752432 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544929ca-8ee8-43ab-bf63-1b576340b075 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:40:17.761520 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-544929ca-8ee8-43ab-bf63-1b576340b075 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 17:40:17.761520 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:17.761520 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:17.761520 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:17.761520 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:17.761520 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:17.761520 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:17.761520 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:17.761520 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:17.761520 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:17.761520 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:17.761520 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:17.761520 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:40:17.761520 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:40:17.761520 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:40:17.761520 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:40:17.762580 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:40:17.762580 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:40:17.762580 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:40:17.762580 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:40:17.762580 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:17.762580 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:17.762580 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:17.762580 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:17.762580 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:17.762580 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:17.762580 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:17.762580 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:17.762580 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:17.762580 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:17.762580 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:17.762580 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:17.763533 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:17.763533 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:17.763533 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:17.763533 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:17.763533 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:40:17.763533 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:40:17.763533 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:40:17.763533 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:40:17.763533 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:40:17.763533 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:40:17.763533 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 17:40:17.763533 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:40:17.763533 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 272/542] 10.222.0.67 () {56 vars in 1102 bytes} [Thu Jul 14 17:40:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:17.770074 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544929ca-8ee8-43ab-bf63-1b576340b075 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:17.795521 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7767deb8-c314-493d-928a-0461b290af5e None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:17.857641 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e9a4bb-59b8-4486-999e-c61640602c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:17.858336 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e9a4bb-59b8-4486-999e-c61640602c44 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:17.858618 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e9a4bb-59b8-4486-999e-c61640602c44 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:17.858903 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e9a4bb-59b8-4486-999e-c61640602c44 None admin] PATH_INFO: `/v3/projects` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:17.859743 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e9a4bb-59b8-4486-999e-c61640602c44 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:17.860059 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e9a4bb-59b8-4486-999e-c61640602c44 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:17.861775 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e9a4bb-59b8-4486-999e-c61640602c44 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:17.887901 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 271/543] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 14 17:40:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:17.902692 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e9a4bb-59b8-4486-999e-c61640602c44 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:17.941461 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544929ca-8ee8-43ab-bf63-1b576340b075 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:17.990167 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9dfb68-d7a2-4687-b99a-1dbaec7c642d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:17.991387 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9dfb68-d7a2-4687-b99a-1dbaec7c642d None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:17.991668 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9dfb68-d7a2-4687-b99a-1dbaec7c642d None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:17.991948 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9dfb68-d7a2-4687-b99a-1dbaec7c642d None admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:17.992996 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9dfb68-d7a2-4687-b99a-1dbaec7c642d None admin] RBAC: Adding query filter params (name=service) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:17.993311 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9dfb68-d7a2-4687-b99a-1dbaec7c642d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:17.995018 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9dfb68-d7a2-4687-b99a-1dbaec7c642d None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:17.998087 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:18.009509 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 273/544] 10.222.0.67 () {56 vars in 1103 bytes} [Thu Jul 14 17:40:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:40:18.016248 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9dfb68-d7a2-4687-b99a-1dbaec7c642d None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:18.168369 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9dfb68-d7a2-4687-b99a-1dbaec7c642d None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:18.221315 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e9a4bb-59b8-4486-999e-c61640602c44 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:18.247482 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d58a993-b0c5-4456-834b-aade7e7dccf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:18.248392 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d58a993-b0c5-4456-834b-aade7e7dccf1 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:18.248681 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d58a993-b0c5-4456-834b-aade7e7dccf1 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:18.248958 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d58a993-b0c5-4456-834b-aade7e7dccf1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:18.266420 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:18.271165 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d58a993-b0c5-4456-834b-aade7e7dccf1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:18.272813 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d58a993-b0c5-4456-834b-aade7e7dccf1 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:18.293165 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-4d58a993-b0c5-4456-834b-aade7e7dccf1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:18.293165 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:18.293165 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:18.293165 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:18.293165 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:18.293165 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:18.293165 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:18.293165 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:18.293165 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:18.293165 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:18.293165 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:18.293165 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:18.293165 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:40:18.293165 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:40:18.293165 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:40:18.295211 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:40:18.295211 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:18.295211 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:18.295211 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:18.295211 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:18.295211 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:18.295211 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:18.295211 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:18.295211 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:18.295211 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:18.295211 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:18.295211 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:18.295211 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:18.295211 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:18.295211 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:18.295211 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:18.295211 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:18.297288 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:40:18.297288 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:40:18.297288 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:18.297288 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:40:18.297288 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 274/545] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:40:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:18.302979 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d58a993-b0c5-4456-834b-aade7e7dccf1 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:18.305053 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e7cb26-62e2-45d6-8f69-dd8771120fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:18.308253 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e7cb26-62e2-45d6-8f69-dd8771120fe8 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:18.308551 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e7cb26-62e2-45d6-8f69-dd8771120fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:18.308831 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e7cb26-62e2-45d6-8f69-dd8771120fe8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:18.310511 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e7cb26-62e2-45d6-8f69-dd8771120fe8 None admin] RBAC: Adding query filter params (role.id=edc349453a61464087c153399e397247, scope.project.id=39a570421bb64fac8b1a0129f1bcc7d9, user.id=7bda83c5499f43f9838fda2679a522d4) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:18.310511 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e7cb26-62e2-45d6-8f69-dd8771120fe8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:18.315642 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e7cb26-62e2-45d6-8f69-dd8771120fe8 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:18.320419 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 272/546] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 14 17:40:17 2022] GET /identity/v3/role_assignments?user.id=7bda83c5499f43f9838fda2679a522d4&scope.project.id=39a570421bb64fac8b1a0129f1bcc7d9&role.id=edc349453a61464087c153399e397247 => generated 259 bytes in 418 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:18.410008 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:18.497364 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d58a993-b0c5-4456-834b-aade7e7dccf1 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:18.534052 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88cb13f-a1d0-44b6-ae40-eed3f5dcc034 None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:18.535037 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88cb13f-a1d0-44b6-ae40-eed3f5dcc034 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:18.535577 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88cb13f-a1d0-44b6-ae40-eed3f5dcc034 None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:18.538212 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 273/547] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:40:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 17:40:18.542907 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae95d3c-e240-4fe5-bd11-148aa5a3a188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:18.543316 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae95d3c-e240-4fe5-bd11-148aa5a3a188 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:18.543599 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae95d3c-e240-4fe5-bd11-148aa5a3a188 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:18.543877 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae95d3c-e240-4fe5-bd11-148aa5a3a188 None admin] PATH_INFO: `/v3/domains` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:18.544630 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae95d3c-e240-4fe5-bd11-148aa5a3a188 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:18.544942 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae95d3c-e240-4fe5-bd11-148aa5a3a188 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:18.545704 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396bf39b-06a6-4bfd-9968-28bf2fccf3da None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:18.546195 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396bf39b-06a6-4bfd-9968-28bf2fccf3da None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:18.546387 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae95d3c-e240-4fe5-bd11-148aa5a3a188 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:18.546880 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396bf39b-06a6-4bfd-9968-28bf2fccf3da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:18.560735 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 275/548] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 14 17:40:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:18.572775 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae95d3c-e240-4fe5-bd11-148aa5a3a188 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:18.579961 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-396bf39b-06a6-4bfd-9968-28bf2fccf3da None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:40:18.582420 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-396bf39b-06a6-4bfd-9968-28bf2fccf3da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:40:18.717765 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 274/549] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:40:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:40:18.755080 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae95d3c-e240-4fe5-bd11-148aa5a3a188 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:18.759747 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396bf39b-06a6-4bfd-9968-28bf2fccf3da None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:18.783686 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:18.862297 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d70b5b-7a5c-4727-bb7c-5304a3348258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:18.863116 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d70b5b-7a5c-4727-bb7c-5304a3348258 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:18.863397 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d70b5b-7a5c-4727-bb7c-5304a3348258 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:18.863670 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d70b5b-7a5c-4727-bb7c-5304a3348258 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:18.894481 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d70b5b-7a5c-4727-bb7c-5304a3348258 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:18.895963 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d70b5b-7a5c-4727-bb7c-5304a3348258 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:18.899276 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396bf39b-06a6-4bfd-9968-28bf2fccf3da None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:18.946790 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:18.950757 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-94d70b5b-7a5c-4727-bb7c-5304a3348258 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 14 17:40:18.950757 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:18.950757 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:18.950757 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:18.950757 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:18.950757 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:18.950757 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:18.950757 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:18.950757 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:18.950757 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:18.950757 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:18.950757 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:18.950757 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 17:40:18.950757 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 17:40:18.950757 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 17:40:18.950757 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 17:40:18.953246 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:18.953246 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:18.953246 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 17:40:18.953246 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:40:18.953246 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 17:40:18.953246 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:40:18.953246 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:18.953246 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:18.953246 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:18.953246 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:18.953246 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:18.953246 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:18.953246 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:18.953246 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:18.953246 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:18.953246 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:18.953246 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:18.953246 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:18.955015 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:18.955015 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:18.955015 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 17:40:18.955015 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 17:40:18.955015 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 17:40:18.955015 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 17:40:18.955015 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 17:40:18.955015 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 17:40:18.955015 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 14 17:40:18.955015 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:40:18.959573 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 276/550] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 14 17:40:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 388 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 17:40:18.968524 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d70b5b-7a5c-4727-bb7c-5304a3348258 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:19.000717 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e79d46-ccd7-4386-b0c3-276b66941dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:19.001546 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e79d46-ccd7-4386-b0c3-276b66941dad None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:19.003649 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e79d46-ccd7-4386-b0c3-276b66941dad None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:19.003948 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e79d46-ccd7-4386-b0c3-276b66941dad None admin] PATH_INFO: `/v3/roles/service` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:19.026267 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e79d46-ccd7-4386-b0c3-276b66941dad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:40:19.041564 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-b8e79d46-ccd7-4386-b0c3-276b66941dad None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 17:40:19.041564 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:19.041564 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:19.041564 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:19.041564 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:19.041564 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:19.041564 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:19.041564 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:19.041564 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:19.041564 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:19.041564 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:19.041564 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:19.041564 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:40:19.041564 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:40:19.041564 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:40:19.041564 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:40:19.043265 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:40:19.043265 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:40:19.043265 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:40:19.043265 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:40:19.043265 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:19.043265 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:19.043265 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:19.043265 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:19.043265 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:19.043265 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:19.043265 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:19.043265 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:19.043265 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:19.043265 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:19.043265 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:19.043265 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:19.044970 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:19.044970 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:19.044970 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:19.044970 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:19.044970 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:40:19.044970 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:40:19.044970 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:40:19.044970 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:40:19.044970 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:40:19.044970 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:40:19.044970 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 17:40:19.044970 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:40:19.047112 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 275/551] 10.222.0.67 () {56 vars in 1102 bytes} [Thu Jul 14 17:40:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 17:40:19.056577 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e79d46-ccd7-4386-b0c3-276b66941dad None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:19.157587 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d70b5b-7a5c-4727-bb7c-5304a3348258 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:19.195578 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a917c8df-449a-47e7-ba5f-14d349dc9c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:19.196381 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a917c8df-449a-47e7-ba5f-14d349dc9c09 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:19.196715 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a917c8df-449a-47e7-ba5f-14d349dc9c09 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:19.197055 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a917c8df-449a-47e7-ba5f-14d349dc9c09 None admin] PATH_INFO: `/v3/users` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:19.198030 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a917c8df-449a-47e7-ba5f-14d349dc9c09 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:19.198402 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a917c8df-449a-47e7-ba5f-14d349dc9c09 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:19.205567 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a917c8df-449a-47e7-ba5f-14d349dc9c09 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:19.231147 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 277/552] 10.222.0.67 () {56 vars in 1135 bytes} [Thu Jul 14 17:40:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:19.241192 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a917c8df-449a-47e7-ba5f-14d349dc9c09 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:19.306033 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:19.326022 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e79d46-ccd7-4386-b0c3-276b66941dad None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:19.382351 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a22436-caca-463b-9c83-92e74783a864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:19.383038 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a22436-caca-463b-9c83-92e74783a864 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:19.383323 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a22436-caca-463b-9c83-92e74783a864 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:19.383599 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a22436-caca-463b-9c83-92e74783a864 None admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:19.384470 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a22436-caca-463b-9c83-92e74783a864 None admin] RBAC: Adding query filter params (name=service) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:19.384784 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a22436-caca-463b-9c83-92e74783a864 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:19.386334 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a22436-caca-463b-9c83-92e74783a864 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:19.396113 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 276/553] 10.222.0.67 () {56 vars in 1103 bytes} [Thu Jul 14 17:40:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:40:19.398022 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2461a84a-1af4-4451-84a1-60907ef23d6c None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:19.398313 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2461a84a-1af4-4451-84a1-60907ef23d6c None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:19.398659 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2461a84a-1af4-4451-84a1-60907ef23d6c None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:19.404335 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 277/554] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:40:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:40:19.405365 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2461a84a-1af4-4451-84a1-60907ef23d6c None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:19.415219 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a917c8df-449a-47e7-ba5f-14d349dc9c09 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:19.452313 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:19.453090 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fce1c8f-cc7a-4ad8-8730-af4eaf9f2a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:19.453930 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce1c8f-cc7a-4ad8-8730-af4eaf9f2a45 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:19.456310 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce1c8f-cc7a-4ad8-8730-af4eaf9f2a45 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:19.456310 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce1c8f-cc7a-4ad8-8730-af4eaf9f2a45 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:19.534387 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2461a84a-1af4-4451-84a1-60907ef23d6c None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:19.535921 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fce1c8f-cc7a-4ad8-8730-af4eaf9f2a45 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:19.537620 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fce1c8f-cc7a-4ad8-8730-af4eaf9f2a45 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:19.566796 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:19.573822 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a539be-6e49-44f3-a896-9e3180dbbad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:19.574929 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a539be-6e49-44f3-a896-9e3180dbbad6 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:19.575222 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a539be-6e49-44f3-a896-9e3180dbbad6 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:19.575501 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a539be-6e49-44f3-a896-9e3180dbbad6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:19.586808 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a539be-6e49-44f3-a896-9e3180dbbad6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:19.588407 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a539be-6e49-44f3-a896-9e3180dbbad6 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:19.607570 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-b5a539be-6e49-44f3-a896-9e3180dbbad6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:19.607570 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:19.607570 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:19.607570 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:19.607570 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:19.607570 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:19.607570 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:19.607570 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:19.607570 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:19.607570 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:19.607570 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:19.607570 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:19.607570 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:40:19.607570 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:40:19.607570 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:40:19.609770 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:40:19.609770 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:19.609770 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:19.609770 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:19.609770 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:19.609770 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:19.609770 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:19.609770 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:19.609770 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:19.609770 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:19.609770 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:19.609770 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:19.609770 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:19.609770 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:19.609770 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:19.609770 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:19.609770 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:19.611861 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:40:19.611861 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:40:19.611861 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:19.611861 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:40:19.611861 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 278/555] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:40:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:19.611861 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f6eb37-8147-4578-9d29-3e1dbb90200e None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:19.611861 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f6eb37-8147-4578-9d29-3e1dbb90200e None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:19.611861 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f6eb37-8147-4578-9d29-3e1dbb90200e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:19.630365 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-28f6eb37-8147-4578-9d29-3e1dbb90200e None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:40:19.632143 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-28f6eb37-8147-4578-9d29-3e1dbb90200e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:40:19.655709 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 278/556] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 14 17:40:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 17:40:19.656723 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fce1c8f-cc7a-4ad8-8730-af4eaf9f2a45 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:19.709662 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 279/557] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:40:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:40:19.710692 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f6eb37-8147-4578-9d29-3e1dbb90200e None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:19.748539 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:19.770418 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fce1c8f-cc7a-4ad8-8730-af4eaf9f2a45 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:19.806813 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:19.810257 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a04e6f0-7a24-4a4d-8354-ee90e2bcd959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:19.811195 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a04e6f0-7a24-4a4d-8354-ee90e2bcd959 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:19.811630 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a04e6f0-7a24-4a4d-8354-ee90e2bcd959 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:19.812067 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a04e6f0-7a24-4a4d-8354-ee90e2bcd959 None admin] PATH_INFO: `/v3/domains` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:19.813182 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a04e6f0-7a24-4a4d-8354-ee90e2bcd959 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:19.813673 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a04e6f0-7a24-4a4d-8354-ee90e2bcd959 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:19.815193 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a04e6f0-7a24-4a4d-8354-ee90e2bcd959 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:19.829024 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 279/558] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 14 17:40:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:19.830270 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a04e6f0-7a24-4a4d-8354-ee90e2bcd959 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:19.842497 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f6eb37-8147-4578-9d29-3e1dbb90200e None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:19.881378 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d536a8ae-9964-4ea1-9c77-ebc43e9bdae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:19.882283 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d536a8ae-9964-4ea1-9c77-ebc43e9bdae3 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:19.882575 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d536a8ae-9964-4ea1-9c77-ebc43e9bdae3 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:19.882855 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d536a8ae-9964-4ea1-9c77-ebc43e9bdae3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:19.894006 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d536a8ae-9964-4ea1-9c77-ebc43e9bdae3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:19.895619 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d536a8ae-9964-4ea1-9c77-ebc43e9bdae3 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:19.918348 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-d536a8ae-9964-4ea1-9c77-ebc43e9bdae3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:19.918348 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:19.918348 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:19.918348 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:19.918348 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:19.918348 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:19.918348 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:19.918348 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:19.918348 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:19.918348 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:19.918348 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:19.918348 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:19.918348 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:40:19.918348 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:40:19.918348 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:40:19.919962 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:40:19.919962 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:19.919962 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:19.919962 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:19.919962 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:19.919962 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:19.919962 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:19.919962 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:19.919962 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:19.919962 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:19.919962 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:19.919962 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:19.919962 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:19.919962 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:19.919962 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:19.919962 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:19.919962 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:19.921084 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:40:19.921084 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:40:19.921084 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:19.921084 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:40:19.921084 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 280/559] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:40:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:19.921084 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d536a8ae-9964-4ea1-9c77-ebc43e9bdae3 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:19.952785 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a04e6f0-7a24-4a4d-8354-ee90e2bcd959 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:19.991260 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dd5c54-c2d3-4085-9e52-e25a716caa52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:19.992574 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd5c54-c2d3-4085-9e52-e25a716caa52 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:19.993139 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd5c54-c2d3-4085-9e52-e25a716caa52 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:19.993581 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd5c54-c2d3-4085-9e52-e25a716caa52 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:20.004386 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dd5c54-c2d3-4085-9e52-e25a716caa52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:40:20.012751 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-02dd5c54-c2d3-4085-9e52-e25a716caa52 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 17:40:20.012751 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:20.012751 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:20.012751 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:20.012751 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:20.012751 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:20.012751 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:20.012751 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:20.012751 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:20.012751 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:20.012751 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:20.012751 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:20.012751 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:40:20.012751 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:40:20.012751 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:40:20.012751 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:40:20.013989 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:40:20.013989 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:40:20.013989 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:40:20.013989 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:40:20.013989 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:20.013989 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:20.013989 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:20.013989 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:20.013989 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:20.013989 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:20.013989 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:20.013989 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:20.013989 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:20.013989 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:20.013989 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:20.013989 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:20.014947 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:20.014947 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:20.014947 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:20.014947 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:20.014947 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:40:20.014947 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:40:20.014947 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:40:20.014947 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:40:20.014947 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:40:20.014947 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:40:20.014947 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 17:40:20.014947 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:40:20.014947 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 280/560] 10.222.0.67 () {56 vars in 1102 bytes} [Thu Jul 14 17:40:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:20.015666 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dd5c54-c2d3-4085-9e52-e25a716caa52 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:20.020995 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:20.059533 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d536a8ae-9964-4ea1-9c77-ebc43e9bdae3 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:20.072225 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:20.094636 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145d95df-d230-4d5a-8468-ec4aaa82c4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:20.095354 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d95df-d230-4d5a-8468-ec4aaa82c4a1 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:20.095639 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d95df-d230-4d5a-8468-ec4aaa82c4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:20.095913 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d95df-d230-4d5a-8468-ec4aaa82c4a1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:20.104374 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145d95df-d230-4d5a-8468-ec4aaa82c4a1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:20.106041 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145d95df-d230-4d5a-8468-ec4aaa82c4a1 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:20.122198 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-145d95df-d230-4d5a-8468-ec4aaa82c4a1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 17:40:20.122198 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:20.122198 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:20.122198 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:20.122198 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:20.122198 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:20.122198 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:20.122198 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:20.122198 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:20.122198 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:20.122198 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:20.122198 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:20.122198 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 17:40:20.122198 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 17:40:20.122198 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 17:40:20.122198 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 17:40:20.123225 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:20.123225 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:20.123225 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 17:40:20.123225 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:40:20.123225 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 17:40:20.123225 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:40:20.123225 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:20.123225 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:20.123225 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:20.123225 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:20.123225 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:20.123225 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:20.123225 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:20.123225 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:20.123225 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:20.123225 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:20.123225 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:20.123225 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:20.124219 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:20.124219 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:20.124219 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 17:40:20.124219 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 17:40:20.124219 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 17:40:20.124219 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 17:40:20.124219 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 17:40:20.124219 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 17:40:20.124219 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 17:40:20.124219 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:40:20.124219 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 281/561] 10.222.0.67 () {56 vars in 1093 bytes} [Thu Jul 14 17:40:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:20.124219 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145d95df-d230-4d5a-8468-ec4aaa82c4a1 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:20.128946 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dd5c54-c2d3-4085-9e52-e25a716caa52 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:20.163634 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3453aef-2f92-4ce3-8765-6978fac4defd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:20.164302 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3453aef-2f92-4ce3-8765-6978fac4defd None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:20.164583 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3453aef-2f92-4ce3-8765-6978fac4defd None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:20.164860 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3453aef-2f92-4ce3-8765-6978fac4defd None admin] PATH_INFO: `/v3/domains` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:20.165646 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3453aef-2f92-4ce3-8765-6978fac4defd None admin] RBAC: Adding query filter params (name=Default) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:20.166029 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3453aef-2f92-4ce3-8765-6978fac4defd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:20.167397 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3453aef-2f92-4ce3-8765-6978fac4defd None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:20.179123 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 281/562] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 14 17:40:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:20.180434 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5f7c0f-b499-451b-9f76-1e7ad9e5fb56 None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:20.180717 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5f7c0f-b499-451b-9f76-1e7ad9e5fb56 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:20.180990 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5f7c0f-b499-451b-9f76-1e7ad9e5fb56 None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:20.185642 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 282/563] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:40:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:40:20.185642 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5f7c0f-b499-451b-9f76-1e7ad9e5fb56 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:20.249887 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145d95df-d230-4d5a-8468-ec4aaa82c4a1 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:20.280405 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:20.289859 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f515f5b6-1002-41e8-af51-74c91bc04bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:20.290888 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f515f5b6-1002-41e8-af51-74c91bc04bcb None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:20.291374 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f515f5b6-1002-41e8-af51-74c91bc04bcb None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:20.291763 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f515f5b6-1002-41e8-af51-74c91bc04bcb None admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:20.292609 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f515f5b6-1002-41e8-af51-74c91bc04bcb None admin] RBAC: Adding query filter params (name=service) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:20.292978 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f515f5b6-1002-41e8-af51-74c91bc04bcb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:20.294944 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f515f5b6-1002-41e8-af51-74c91bc04bcb None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:20.302085 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5f7c0f-b499-451b-9f76-1e7ad9e5fb56 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:20.304458 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 282/564] 10.222.0.67 () {56 vars in 1103 bytes} [Thu Jul 14 17:40:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:20.305270 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f515f5b6-1002-41e8-af51-74c91bc04bcb None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:20.318728 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:20.348114 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c17254c-1b28-413a-ab45-a0ef4bfbf6ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:20.348813 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c17254c-1b28-413a-ab45-a0ef4bfbf6ca None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:20.348997 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c17254c-1b28-413a-ab45-a0ef4bfbf6ca None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:20.349253 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c17254c-1b28-413a-ab45-a0ef4bfbf6ca None admin] PATH_INFO: `/v3/users` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:20.350721 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c17254c-1b28-413a-ab45-a0ef4bfbf6ca None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:20.351027 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c17254c-1b28-413a-ab45-a0ef4bfbf6ca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:20.352456 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c17254c-1b28-413a-ab45-a0ef4bfbf6ca None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:20.370927 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 283/565] 10.222.0.67 () {56 vars in 1133 bytes} [Thu Jul 14 17:40:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:20.372233 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b58c3b-b2cb-49af-81ff-374ca4a87121 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:20.372580 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b58c3b-b2cb-49af-81ff-374ca4a87121 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:20.372800 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b58c3b-b2cb-49af-81ff-374ca4a87121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:20.389148 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-15b58c3b-b2cb-49af-81ff-374ca4a87121 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:40:20.390370 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-15b58c3b-b2cb-49af-81ff-374ca4a87121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:40:20.420461 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f515f5b6-1002-41e8-af51-74c91bc04bcb None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:20.466564 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cf81e3-3886-48f4-ac97-ed9790e6528b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:20.467381 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cf81e3-3886-48f4-ac97-ed9790e6528b None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:20.467660 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cf81e3-3886-48f4-ac97-ed9790e6528b None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:20.467931 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cf81e3-3886-48f4-ac97-ed9790e6528b None admin] PATH_INFO: `/v3/projects/service` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:20.478100 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 284/566] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:40:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:40:20.478100 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b58c3b-b2cb-49af-81ff-374ca4a87121 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:20.485204 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cf81e3-3886-48f4-ac97-ed9790e6528b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:20.486886 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cf81e3-3886-48f4-ac97-ed9790e6528b None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:20.503836 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-93cf81e3-3886-48f4-ac97-ed9790e6528b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:40:20.503836 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:20.503836 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:20.503836 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:20.503836 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:20.503836 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:20.503836 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:20.503836 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:20.503836 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:20.503836 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:20.503836 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:20.503836 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:20.503836 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 17:40:20.503836 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 17:40:20.503836 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 17:40:20.504812 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 17:40:20.504812 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:20.504812 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:20.504812 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:20.504812 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:20.504812 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:20.504812 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:20.504812 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:20.504812 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:20.504812 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:20.504812 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:20.504812 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:20.504812 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:20.504812 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:20.504812 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:20.504812 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:20.504812 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:20.506123 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 17:40:20.506123 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 17:40:20.506123 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 17:40:20.506123 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 17:40:20.506123 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 17:40:20.506123 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 17:40:20.506123 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:40:20.506123 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:40:20.506123 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 283/567] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 14 17:40:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:20.506123 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cf81e3-3886-48f4-ac97-ed9790e6528b None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:20.559967 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:20.582635 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:20.589295 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b58c3b-b2cb-49af-81ff-374ca4a87121 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:20.617840 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cf81e3-3886-48f4-ac97-ed9790e6528b None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:20.626582 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9040478a-8fe9-4539-bf03-6e185c22979f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:20.627383 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9040478a-8fe9-4539-bf03-6e185c22979f None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:20.627886 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9040478a-8fe9-4539-bf03-6e185c22979f None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:20.627998 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9040478a-8fe9-4539-bf03-6e185c22979f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:20.639449 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9040478a-8fe9-4539-bf03-6e185c22979f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:20.641134 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9040478a-8fe9-4539-bf03-6e185c22979f None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:20.653389 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9011c389-b9d2-45cd-a8e1-4669a5435b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:20.654222 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9011c389-b9d2-45cd-a8e1-4669a5435b8f None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:20.654507 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9011c389-b9d2-45cd-a8e1-4669a5435b8f None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:20.654780 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9011c389-b9d2-45cd-a8e1-4669a5435b8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:20.659771 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-9040478a-8fe9-4539-bf03-6e185c22979f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:20.659771 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:20.659771 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:20.659771 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:20.659771 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:20.659771 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:20.659771 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:20.659771 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:20.659771 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:20.659771 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:20.659771 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:20.659771 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:20.659771 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:40:20.659771 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:40:20.659771 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:40:20.660717 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:40:20.660717 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:20.660717 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:20.660717 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:20.660717 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:20.660717 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:20.660717 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:20.660717 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:20.660717 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:20.660717 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:20.660717 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:20.660717 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:20.660717 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:20.660717 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:20.660717 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:20.660717 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:20.660717 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:20.666803 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:40:20.666803 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:40:20.666803 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:20.666803 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:40:20.666803 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 285/568] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:40:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:20.666803 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9040478a-8fe9-4539-bf03-6e185c22979f None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:20.671560 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9011c389-b9d2-45cd-a8e1-4669a5435b8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:20.673129 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9011c389-b9d2-45cd-a8e1-4669a5435b8f None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:20.691533 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-9011c389-b9d2-45cd-a8e1-4669a5435b8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:20.691533 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:20.691533 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:20.691533 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:20.691533 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:20.691533 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:20.691533 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:20.691533 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:20.691533 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:20.691533 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:20.691533 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:20.691533 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:20.691533 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:40:20.691533 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:40:20.691533 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:40:20.692471 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:40:20.692471 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:20.692471 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:20.692471 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:20.692471 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:20.692471 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:20.692471 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:20.692471 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:20.692471 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:20.692471 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:20.692471 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:20.692471 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:20.692471 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:20.692471 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:20.692471 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:20.692471 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:20.692471 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:20.693401 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:40:20.693401 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:40:20.693401 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:20.693401 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:40:20.693401 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 284/569] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:40:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:20.693768 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9011c389-b9d2-45cd-a8e1-4669a5435b8f None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:20.776121 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9040478a-8fe9-4539-bf03-6e185c22979f None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:20.806382 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9011c389-b9d2-45cd-a8e1-4669a5435b8f None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:20.807987 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:20.812098 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9997fbfd-2dc1-4cdd-b6f3-aacf9883f4e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:20.812957 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9997fbfd-2dc1-4cdd-b6f3-aacf9883f4e3 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:20.813246 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9997fbfd-2dc1-4cdd-b6f3-aacf9883f4e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:20.813554 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9997fbfd-2dc1-4cdd-b6f3-aacf9883f4e3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:20.824126 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9997fbfd-2dc1-4cdd-b6f3-aacf9883f4e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:40:20.831976 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-9997fbfd-2dc1-4cdd-b6f3-aacf9883f4e3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 17:40:20.831976 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:20.831976 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:20.831976 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:20.831976 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:20.831976 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:20.831976 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:20.831976 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:20.831976 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:20.831976 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:20.831976 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:20.831976 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:20.831976 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:40:20.831976 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:40:20.831976 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:40:20.831976 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:40:20.833125 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:40:20.833125 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:40:20.833125 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:40:20.833125 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:40:20.833125 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:20.833125 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:20.833125 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:20.833125 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:20.833125 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:20.833125 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:20.833125 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:20.833125 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:20.833125 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:20.833125 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:20.833125 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:20.833125 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:20.834302 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:20.834302 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:20.834302 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:20.834302 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:20.834302 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:40:20.834302 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:40:20.834302 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:40:20.834302 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:40:20.834302 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:40:20.834302 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:40:20.834302 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 17:40:20.834302 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:40:20.834302 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 286/570] 10.222.0.67 () {56 vars in 1102 bytes} [Thu Jul 14 17:40:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:20.834302 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9997fbfd-2dc1-4cdd-b6f3-aacf9883f4e3 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:20.845140 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:20.845599 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bc5874-1432-475f-814e-fee896bdb0cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:20.846273 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc5874-1432-475f-814e-fee896bdb0cd None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:20.846582 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc5874-1432-475f-814e-fee896bdb0cd None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:20.846836 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc5874-1432-475f-814e-fee896bdb0cd None admin] PATH_INFO: `/v3/projects` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:20.847994 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bc5874-1432-475f-814e-fee896bdb0cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:20.848484 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bc5874-1432-475f-814e-fee896bdb0cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:20.850498 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bc5874-1432-475f-814e-fee896bdb0cd None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:20.862205 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 285/571] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 14 17:40:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:20.863126 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bc5874-1432-475f-814e-fee896bdb0cd None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:20.938635 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9997fbfd-2dc1-4cdd-b6f3-aacf9883f4e3 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:20.963520 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bc5874-1432-475f-814e-fee896bdb0cd None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:20.972607 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecbf3d0-2097-4d70-8d28-90eb777f0055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:20.973273 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecbf3d0-2097-4d70-8d28-90eb777f0055 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:20.973588 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecbf3d0-2097-4d70-8d28-90eb777f0055 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:20.973869 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecbf3d0-2097-4d70-8d28-90eb777f0055 None admin] PATH_INFO: `/v3/domains` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:20.974602 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecbf3d0-2097-4d70-8d28-90eb777f0055 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:20.975550 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecbf3d0-2097-4d70-8d28-90eb777f0055 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:20.976933 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecbf3d0-2097-4d70-8d28-90eb777f0055 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:20.989776 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 287/572] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 14 17:40:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:20.990924 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae364ea-5a36-4d15-8412-c21ac12e6b47 None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:20.991216 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae364ea-5a36-4d15-8412-c21ac12e6b47 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:20.991495 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae364ea-5a36-4d15-8412-c21ac12e6b47 None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:20.992989 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 288/573] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:40:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:40:20.993711 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae364ea-5a36-4d15-8412-c21ac12e6b47 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:21.004692 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d3f187-4e3c-408c-b206-086a0722d4b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:21.005370 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d3f187-4e3c-408c-b206-086a0722d4b2 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:21.005691 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d3f187-4e3c-408c-b206-086a0722d4b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:21.005973 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d3f187-4e3c-408c-b206-086a0722d4b2 None admin] PATH_INFO: `/v3/domains` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:21.006705 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d3f187-4e3c-408c-b206-086a0722d4b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:21.007018 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d3f187-4e3c-408c-b206-086a0722d4b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:21.008396 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d3f187-4e3c-408c-b206-086a0722d4b2 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:21.020367 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 286/574] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 14 17:40:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:21.021117 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d3f187-4e3c-408c-b206-086a0722d4b2 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:21.046137 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:21.066610 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:21.107559 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae364ea-5a36-4d15-8412-c21ac12e6b47 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:21.130155 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d3f187-4e3c-408c-b206-086a0722d4b2 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:21.145263 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34de69e-504f-4a10-b45c-21e25f648193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:21.145987 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34de69e-504f-4a10-b45c-21e25f648193 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:21.146270 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34de69e-504f-4a10-b45c-21e25f648193 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:21.146548 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34de69e-504f-4a10-b45c-21e25f648193 None admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:21.147348 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34de69e-504f-4a10-b45c-21e25f648193 None admin] RBAC: Adding query filter params (name=service) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:21.147658 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34de69e-504f-4a10-b45c-21e25f648193 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:21.149068 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34de69e-504f-4a10-b45c-21e25f648193 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:21.157888 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 289/575] 10.222.0.67 () {56 vars in 1103 bytes} [Thu Jul 14 17:40:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:21.158859 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34de69e-504f-4a10-b45c-21e25f648193 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:21.171153 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a3b4e7-6491-428f-b00a-e497f20eb14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:21.171815 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a3b4e7-6491-428f-b00a-e497f20eb14d None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:21.172105 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a3b4e7-6491-428f-b00a-e497f20eb14d None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:21.172386 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a3b4e7-6491-428f-b00a-e497f20eb14d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:21.173239 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a3b4e7-6491-428f-b00a-e497f20eb14d None admin] RBAC: Adding query filter params (role.id=edc349453a61464087c153399e397247, scope.project.id=39a570421bb64fac8b1a0129f1bcc7d9, user.id=c65607a396474192a43c374d306ef5ba) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:21.173584 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a3b4e7-6491-428f-b00a-e497f20eb14d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:21.175090 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a3b4e7-6491-428f-b00a-e497f20eb14d None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:21.181887 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 287/576] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 14 17:40:21 2022] GET /identity/v3/role_assignments?user.id=c65607a396474192a43c374d306ef5ba&scope.project.id=39a570421bb64fac8b1a0129f1bcc7d9&role.id=edc349453a61464087c153399e397247 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:21.183206 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b6d073-aa2a-473d-ab09-d51453345b4b None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:21.183499 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b6d073-aa2a-473d-ab09-d51453345b4b None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:21.183778 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b6d073-aa2a-473d-ab09-d51453345b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:21.204319 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-16b6d073-aa2a-473d-ab09-d51453345b4b None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:40:21.205645 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-16b6d073-aa2a-473d-ab09-d51453345b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:40:21.288973 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34de69e-504f-4a10-b45c-21e25f648193 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:21.292082 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 288/577] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:40:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:40:21.292962 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b6d073-aa2a-473d-ab09-d51453345b4b None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:21.320526 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:21.336904 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:21.343734 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3c55a4-fe3b-4146-8e25-628484eab733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:21.344547 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3c55a4-fe3b-4146-8e25-628484eab733 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:21.344835 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3c55a4-fe3b-4146-8e25-628484eab733 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:21.345111 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3c55a4-fe3b-4146-8e25-628484eab733 None admin] PATH_INFO: `/v3/users/glance` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:21.355966 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3c55a4-fe3b-4146-8e25-628484eab733 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:21.357516 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3c55a4-fe3b-4146-8e25-628484eab733 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:21.373804 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-2b3c55a4-fe3b-4146-8e25-628484eab733 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 14 17:40:21.373804 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:21.373804 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:21.373804 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:21.373804 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:21.373804 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:21.373804 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:21.373804 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:21.373804 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:21.373804 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:21.373804 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:21.373804 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:21.373804 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 17:40:21.373804 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 17:40:21.373804 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 17:40:21.373804 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 17:40:21.374831 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:21.374831 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:21.374831 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 17:40:21.374831 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:40:21.374831 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 17:40:21.374831 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:40:21.374831 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:21.374831 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:21.374831 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:21.374831 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:21.374831 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:21.374831 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:21.374831 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:21.374831 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:21.374831 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:21.374831 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:21.374831 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:21.374831 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:21.375804 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:21.375804 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:21.375804 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 17:40:21.375804 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 17:40:21.375804 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 17:40:21.375804 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 17:40:21.375804 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 17:40:21.375804 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 17:40:21.375804 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 14 17:40:21.375804 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:40:21.375804 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 290/578] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 14 17:40:21 2022] GET /identity/v3/users/glance => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:21.376425 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3c55a4-fe3b-4146-8e25-628484eab733 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:21.426837 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b6d073-aa2a-473d-ab09-d51453345b4b None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:21.466737 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc3d602-21be-4a65-9fae-8deb74092d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:21.467543 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc3d602-21be-4a65-9fae-8deb74092d2f None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:21.467821 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc3d602-21be-4a65-9fae-8deb74092d2f None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:21.468315 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc3d602-21be-4a65-9fae-8deb74092d2f None admin] PATH_INFO: `/v3/projects/service` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:21.476266 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc3d602-21be-4a65-9fae-8deb74092d2f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:21.477741 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc3d602-21be-4a65-9fae-8deb74092d2f None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:21.484468 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3c55a4-fe3b-4146-8e25-628484eab733 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:21.492121 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-dcc3d602-21be-4a65-9fae-8deb74092d2f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:40:21.492121 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:21.492121 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:21.492121 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:21.492121 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:21.492121 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:21.492121 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:21.492121 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:21.492121 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:21.492121 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:21.492121 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:21.492121 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:21.492121 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 17:40:21.492121 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 17:40:21.492121 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 17:40:21.493288 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 17:40:21.493288 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:21.493288 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:21.493288 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:21.493288 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:21.493288 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:21.493288 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:21.493288 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:21.493288 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:21.493288 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:21.493288 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:21.493288 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:21.493288 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:21.493288 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:21.493288 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:21.493288 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:21.493288 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:21.494526 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 17:40:21.494526 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 17:40:21.494526 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 17:40:21.494526 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 17:40:21.494526 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 17:40:21.494526 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 17:40:21.494526 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:40:21.494526 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:40:21.494526 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 289/579] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 14 17:40:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:21.494526 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc3d602-21be-4a65-9fae-8deb74092d2f None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:21.528272 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0137aed-cfab-40aa-be15-cc05fa73ae37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:21.529092 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0137aed-cfab-40aa-be15-cc05fa73ae37 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:21.529361 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0137aed-cfab-40aa-be15-cc05fa73ae37 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:21.529667 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0137aed-cfab-40aa-be15-cc05fa73ae37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:21.542547 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0137aed-cfab-40aa-be15-cc05fa73ae37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:21.544069 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0137aed-cfab-40aa-be15-cc05fa73ae37 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:21.562954 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-b0137aed-cfab-40aa-be15-cc05fa73ae37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:21.562954 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:21.562954 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:21.562954 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:21.562954 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:21.562954 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:21.562954 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:21.562954 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:21.562954 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:21.562954 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:21.562954 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:21.562954 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:21.562954 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:40:21.562954 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:40:21.562954 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:40:21.563905 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:40:21.563905 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:21.563905 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:21.563905 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:21.563905 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:21.563905 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:21.563905 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:21.563905 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:21.563905 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:21.563905 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:21.563905 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:21.563905 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:21.563905 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:21.563905 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:21.563905 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:21.563905 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:21.563905 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:21.564812 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:40:21.564812 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:40:21.564812 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:21.564812 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:40:21.568843 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 291/580] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:40:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:21.569481 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0137aed-cfab-40aa-be15-cc05fa73ae37 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:21.577824 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:21.603790 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc3d602-21be-4a65-9fae-8deb74092d2f None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:21.616710 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:21.640838 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9838d5e-2438-49d7-ae16-e0cb98cb46be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:21.642117 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9838d5e-2438-49d7-ae16-e0cb98cb46be None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:21.642117 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9838d5e-2438-49d7-ae16-e0cb98cb46be None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:21.642339 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9838d5e-2438-49d7-ae16-e0cb98cb46be None admin] PATH_INFO: `/v3/roles/service` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:21.655805 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9838d5e-2438-49d7-ae16-e0cb98cb46be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:40:21.666676 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-c9838d5e-2438-49d7-ae16-e0cb98cb46be None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 17:40:21.666676 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:21.666676 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:21.666676 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:21.666676 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:21.666676 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:21.666676 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:21.666676 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:21.666676 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:21.666676 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:21.666676 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:21.666676 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:21.666676 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:40:21.666676 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:40:21.666676 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:40:21.666676 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:40:21.667747 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:40:21.667747 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:40:21.667747 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:40:21.667747 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:40:21.667747 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:21.667747 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:21.667747 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:21.667747 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:21.667747 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:21.667747 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:21.667747 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:21.667747 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:21.667747 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:21.667747 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:21.667747 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:21.667747 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:21.668622 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:21.668622 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:21.668622 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:21.668622 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:21.668622 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:40:21.668622 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:40:21.668622 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:40:21.668622 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:40:21.668622 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:40:21.668622 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:40:21.668622 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 17:40:21.668622 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:40:21.669937 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 290/581] 10.222.0.67 () {56 vars in 1102 bytes} [Thu Jul 14 17:40:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:21.669937 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9838d5e-2438-49d7-ae16-e0cb98cb46be None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:21.677374 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0137aed-cfab-40aa-be15-cc05fa73ae37 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:21.712983 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea5fc25-7b7a-4e22-a1e9-f75b65a95d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:21.713936 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5fc25-7b7a-4e22-a1e9-f75b65a95d8d None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:21.714223 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5fc25-7b7a-4e22-a1e9-f75b65a95d8d None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:21.714502 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5fc25-7b7a-4e22-a1e9-f75b65a95d8d None admin] PATH_INFO: `/v3/users` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:21.715361 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea5fc25-7b7a-4e22-a1e9-f75b65a95d8d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:21.715676 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea5fc25-7b7a-4e22-a1e9-f75b65a95d8d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:21.717136 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea5fc25-7b7a-4e22-a1e9-f75b65a95d8d None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:21.746267 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 292/582] 10.222.0.67 () {56 vars in 1137 bytes} [Thu Jul 14 17:40:21 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:21.746267 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea5fc25-7b7a-4e22-a1e9-f75b65a95d8d None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:21.803678 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9838d5e-2438-49d7-ae16-e0cb98cb46be None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:21.843865 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15273ccf-0d94-41d4-abc5-552b97082ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:21.844537 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15273ccf-0d94-41d4-abc5-552b97082ff6 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:21.844870 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15273ccf-0d94-41d4-abc5-552b97082ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:21.845281 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15273ccf-0d94-41d4-abc5-552b97082ff6 None admin] PATH_INFO: `/v3/projects` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:21.846107 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15273ccf-0d94-41d4-abc5-552b97082ff6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:21.846422 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15273ccf-0d94-41d4-abc5-552b97082ff6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:21.847981 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15273ccf-0d94-41d4-abc5-552b97082ff6 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:21.851501 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:21.868660 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 291/583] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 14 17:40:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:21.869427 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15273ccf-0d94-41d4-abc5-552b97082ff6 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:21.869564 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:21.873577 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea5fc25-7b7a-4e22-a1e9-f75b65a95d8d None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:21.909513 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64ce395-c514-4113-8470-98df05a10be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:21.910212 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64ce395-c514-4113-8470-98df05a10be9 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:21.910498 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64ce395-c514-4113-8470-98df05a10be9 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:21.910774 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64ce395-c514-4113-8470-98df05a10be9 None admin] PATH_INFO: `/v3/domains` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:21.911509 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64ce395-c514-4113-8470-98df05a10be9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:21.911812 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64ce395-c514-4113-8470-98df05a10be9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:21.913801 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64ce395-c514-4113-8470-98df05a10be9 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:21.925398 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 293/584] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 14 17:40:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:21.926479 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64ce395-c514-4113-8470-98df05a10be9 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:21.993965 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15273ccf-0d94-41d4-abc5-552b97082ff6 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:22.028311 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf77ceb1-e479-4329-84e4-0d1c85ff69ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:22.028988 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf77ceb1-e479-4329-84e4-0d1c85ff69ca None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:22.029277 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf77ceb1-e479-4329-84e4-0d1c85ff69ca None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:22.029573 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf77ceb1-e479-4329-84e4-0d1c85ff69ca None admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:22.030322 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf77ceb1-e479-4329-84e4-0d1c85ff69ca None admin] RBAC: Adding query filter params (name=service) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:22.030634 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf77ceb1-e479-4329-84e4-0d1c85ff69ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:22.032001 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf77ceb1-e479-4329-84e4-0d1c85ff69ca None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:22.037769 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64ce395-c514-4113-8470-98df05a10be9 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:22.040693 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 292/585] 10.222.0.67 () {56 vars in 1103 bytes} [Thu Jul 14 17:40:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:22.041303 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf77ceb1-e479-4329-84e4-0d1c85ff69ca None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:22.080182 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e162b70f-fc04-4dc4-b5df-e7e10ac8de8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:22.081341 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e162b70f-fc04-4dc4-b5df-e7e10ac8de8b None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:22.081856 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e162b70f-fc04-4dc4-b5df-e7e10ac8de8b None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:22.082318 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e162b70f-fc04-4dc4-b5df-e7e10ac8de8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:22.094364 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e162b70f-fc04-4dc4-b5df-e7e10ac8de8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:22.096063 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e162b70f-fc04-4dc4-b5df-e7e10ac8de8b None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:22.106277 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:22.113792 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-e162b70f-fc04-4dc4-b5df-e7e10ac8de8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:22.113792 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:22.113792 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:22.113792 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:22.113792 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:22.113792 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:22.113792 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:22.113792 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:22.113792 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:22.113792 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:22.113792 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:22.113792 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:22.113792 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:40:22.113792 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:40:22.113792 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:40:22.114727 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:40:22.114727 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:22.114727 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:22.114727 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:22.114727 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:22.114727 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:22.114727 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:22.114727 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:22.114727 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:22.114727 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:22.114727 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:22.114727 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:22.114727 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:22.114727 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:22.114727 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:22.114727 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:22.114727 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:22.115737 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:40:22.115737 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:40:22.115737 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:22.115737 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:40:22.115737 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 294/586] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:40:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:22.116053 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e162b70f-fc04-4dc4-b5df-e7e10ac8de8b None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:22.136136 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:22.159044 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf77ceb1-e479-4329-84e4-0d1c85ff69ca None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:22.194360 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc15b236-4b8d-4cbc-85e4-ca4beaac2030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:22.195266 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc15b236-4b8d-4cbc-85e4-ca4beaac2030 None admin] REQUEST_METHOD: `PUT` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:22.195552 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc15b236-4b8d-4cbc-85e4-ca4beaac2030 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:22.195835 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc15b236-4b8d-4cbc-85e4-ca4beaac2030 None admin] PATH_INFO: `/v3/projects/39a570421bb64fac8b1a0129f1bcc7d9/users/41b893bdf4ec474dbfa819c22fc29ce9/roles/edc349453a61464087c153399e397247` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:22.212234 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc15b236-4b8d-4cbc-85e4-ca4beaac2030 None admin] RBAC: Authorizing `identity:create_grant(project_id=39a570421bb64fac8b1a0129f1bcc7d9, user_id=41b893bdf4ec474dbfa819c22fc29ce9, role_id=edc349453a61464087c153399e397247)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:22.213721 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc15b236-4b8d-4cbc-85e4-ca4beaac2030 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:22.229737 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e162b70f-fc04-4dc4-b5df-e7e10ac8de8b None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:22.237630 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 293/587] 10.222.0.67 () {58 vars in 1439 bytes} [Thu Jul 14 17:40:22 2022] PUT /identity/v3/projects/39a570421bb64fac8b1a0129f1bcc7d9/users/41b893bdf4ec474dbfa819c22fc29ce9/roles/edc349453a61464087c153399e397247 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:40:22.238741 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc15b236-4b8d-4cbc-85e4-ca4beaac2030 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:22.278226 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078e54a0-5dd9-489e-ac6c-0ecbcb18b88e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:22.278963 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e54a0-5dd9-489e-ac6c-0ecbcb18b88e None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:22.279246 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e54a0-5dd9-489e-ac6c-0ecbcb18b88e None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:22.279522 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e54a0-5dd9-489e-ac6c-0ecbcb18b88e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:22.289020 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078e54a0-5dd9-489e-ac6c-0ecbcb18b88e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:22.290806 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078e54a0-5dd9-489e-ac6c-0ecbcb18b88e None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:22.312175 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-078e54a0-5dd9-489e-ac6c-0ecbcb18b88e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 17:40:22.312175 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:22.312175 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:22.312175 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:22.312175 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:22.312175 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:22.312175 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:22.312175 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:22.312175 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:22.312175 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:22.312175 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:22.312175 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:22.312175 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 17:40:22.312175 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 17:40:22.312175 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 17:40:22.312175 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 17:40:22.313244 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:22.313244 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:22.313244 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 17:40:22.313244 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:40:22.313244 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 17:40:22.313244 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:40:22.313244 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:22.313244 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:22.313244 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:22.313244 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:22.313244 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:22.313244 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:22.313244 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:22.313244 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:22.313244 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:22.313244 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:22.313244 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:22.313244 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:22.314250 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:22.314250 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:22.314250 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 17:40:22.314250 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 17:40:22.314250 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 17:40:22.314250 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 17:40:22.314250 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 17:40:22.314250 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 17:40:22.314250 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 17:40:22.314250 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:40:22.317708 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 295/588] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 14 17:40:22 2022] GET /identity/v3/users/cinder => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:22.319246 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078e54a0-5dd9-489e-ac6c-0ecbcb18b88e None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:22.383471 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc15b236-4b8d-4cbc-85e4-ca4beaac2030 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:22.396783 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:22.419889 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:22.433868 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a959ca1-f94d-4af2-bcc2-9478afb230fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:22.434936 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a959ca1-f94d-4af2-bcc2-9478afb230fe None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:22.435361 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a959ca1-f94d-4af2-bcc2-9478afb230fe None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:22.435645 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a959ca1-f94d-4af2-bcc2-9478afb230fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:22.448326 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a959ca1-f94d-4af2-bcc2-9478afb230fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:22.449818 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a959ca1-f94d-4af2-bcc2-9478afb230fe None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:22.469033 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078e54a0-5dd9-489e-ac6c-0ecbcb18b88e None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:22.470053 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-5a959ca1-f94d-4af2-bcc2-9478afb230fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:22.470053 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:22.470053 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:22.470053 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:22.470053 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:22.470053 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:22.470053 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:22.470053 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:22.470053 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:22.470053 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:22.470053 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:22.470053 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:22.470053 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:40:22.470053 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:40:22.470053 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:40:22.470932 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:40:22.470932 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:22.470932 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:22.470932 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:22.470932 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:22.470932 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:22.470932 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:22.470932 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:22.470932 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:22.470932 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:22.470932 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:22.470932 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:22.470932 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:22.470932 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:22.470932 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:22.470932 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:22.470932 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:22.471853 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:40:22.471853 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:40:22.471853 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:22.471853 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:40:22.471853 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 294/589] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:40:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:22.471853 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a959ca1-f94d-4af2-bcc2-9478afb230fe None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:22.520421 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4a308a-9139-496c-9536-90df696a58fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:22.521227 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a308a-9139-496c-9536-90df696a58fb None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:22.521655 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a308a-9139-496c-9536-90df696a58fb None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:22.522008 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a308a-9139-496c-9536-90df696a58fb None admin] PATH_INFO: `/v3/domains` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:22.522818 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4a308a-9139-496c-9536-90df696a58fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:22.523197 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4a308a-9139-496c-9536-90df696a58fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:22.524646 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4a308a-9139-496c-9536-90df696a58fb None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:22.541453 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 296/590] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 14 17:40:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:22.542352 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4a308a-9139-496c-9536-90df696a58fb None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:22.604652 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a959ca1-f94d-4af2-bcc2-9478afb230fe None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:22.655334 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f76d0d-986d-485b-a1c6-5e737c72443f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:22.656603 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f76d0d-986d-485b-a1c6-5e737c72443f None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:22.657317 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f76d0d-986d-485b-a1c6-5e737c72443f None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:22.657825 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f76d0d-986d-485b-a1c6-5e737c72443f None admin] PATH_INFO: `/v3/users` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:22.659581 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f76d0d-986d-485b-a1c6-5e737c72443f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:22.660156 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f76d0d-986d-485b-a1c6-5e737c72443f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:22.663143 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f76d0d-986d-485b-a1c6-5e737c72443f None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:22.674076 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4a308a-9139-496c-9536-90df696a58fb None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:22.683991 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 295/591] 10.222.0.67 () {56 vars in 1137 bytes} [Thu Jul 14 17:40:22 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:22.685003 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f76d0d-986d-485b-a1c6-5e737c72443f None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:22.704778 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:22.718700 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:22.728994 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059f0a9b-7108-47cd-9709-245c435f09eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:22.730407 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f0a9b-7108-47cd-9709-245c435f09eb None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:22.731001 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f0a9b-7108-47cd-9709-245c435f09eb None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:22.731535 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f0a9b-7108-47cd-9709-245c435f09eb None admin] PATH_INFO: `/v3/domains` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:22.732537 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059f0a9b-7108-47cd-9709-245c435f09eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:22.733063 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059f0a9b-7108-47cd-9709-245c435f09eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:22.735673 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059f0a9b-7108-47cd-9709-245c435f09eb None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:22.753327 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 297/592] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 14 17:40:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:22.755021 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059f0a9b-7108-47cd-9709-245c435f09eb None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:22.817570 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f76d0d-986d-485b-a1c6-5e737c72443f None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:22.854646 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626b74ef-3e5c-4e9e-a20f-86e88e16315f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:22.855552 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b74ef-3e5c-4e9e-a20f-86e88e16315f None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:22.855835 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b74ef-3e5c-4e9e-a20f-86e88e16315f None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:22.856106 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b74ef-3e5c-4e9e-a20f-86e88e16315f None admin] PATH_INFO: `/v3/projects/service` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:22.863768 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626b74ef-3e5c-4e9e-a20f-86e88e16315f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:22.865197 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626b74ef-3e5c-4e9e-a20f-86e88e16315f None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:22.874384 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059f0a9b-7108-47cd-9709-245c435f09eb None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:22.881021 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-626b74ef-3e5c-4e9e-a20f-86e88e16315f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:40:22.881021 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:22.881021 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:22.881021 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:22.881021 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:22.881021 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:22.881021 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:22.881021 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:22.881021 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:22.881021 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:22.881021 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:22.881021 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:22.881021 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 17:40:22.881021 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 17:40:22.881021 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 17:40:22.882008 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 17:40:22.882008 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:22.882008 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:22.882008 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:22.882008 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:22.882008 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:22.882008 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:22.882008 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:22.882008 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:22.882008 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:22.882008 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:22.882008 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:22.882008 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:22.882008 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:22.882008 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:22.882008 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:22.882008 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:22.882931 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 17:40:22.882931 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 17:40:22.882931 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 17:40:22.882931 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 17:40:22.882931 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 17:40:22.882931 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 17:40:22.882931 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:40:22.882931 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:40:22.882931 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 296/593] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 14 17:40:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:22.883447 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626b74ef-3e5c-4e9e-a20f-86e88e16315f None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:22.914913 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5998be15-f4c7-4e2a-90e8-b0255cede98d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:22.916131 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5998be15-f4c7-4e2a-90e8-b0255cede98d None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:22.916619 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5998be15-f4c7-4e2a-90e8-b0255cede98d None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:22.917128 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5998be15-f4c7-4e2a-90e8-b0255cede98d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:22.929494 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5998be15-f4c7-4e2a-90e8-b0255cede98d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:22.931400 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5998be15-f4c7-4e2a-90e8-b0255cede98d None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:22.950996 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-5998be15-f4c7-4e2a-90e8-b0255cede98d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:22.950996 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:22.950996 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:22.950996 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:22.950996 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:22.950996 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:22.950996 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:22.950996 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:22.950996 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:22.950996 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:22.950996 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:22.950996 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:22.950996 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:40:22.950996 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:40:22.950996 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:40:22.951984 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:40:22.951984 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:22.951984 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:22.951984 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:22.951984 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:22.951984 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:22.951984 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:22.951984 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:22.951984 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:22.951984 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:22.951984 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:22.951984 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:22.951984 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:22.951984 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:22.951984 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:22.951984 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:22.951984 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:22.952889 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:40:22.952889 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:40:22.952889 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:22.952889 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:40:22.955092 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 298/594] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:40:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:22.956088 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5998be15-f4c7-4e2a-90e8-b0255cede98d None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:22.978043 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:23.002547 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626b74ef-3e5c-4e9e-a20f-86e88e16315f None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:23.010001 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:23.041653 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b55906-3f2f-4d21-a284-ff835b0cedb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:23.042463 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b55906-3f2f-4d21-a284-ff835b0cedb6 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:23.042749 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b55906-3f2f-4d21-a284-ff835b0cedb6 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:23.043023 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b55906-3f2f-4d21-a284-ff835b0cedb6 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:23.051519 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b55906-3f2f-4d21-a284-ff835b0cedb6 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:23.053690 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b55906-3f2f-4d21-a284-ff835b0cedb6 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:23.069394 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-65b55906-3f2f-4d21-a284-ff835b0cedb6 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 14 17:40:23.069394 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:23.069394 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:23.069394 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:23.069394 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:23.069394 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:23.069394 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:23.069394 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:23.069394 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:23.069394 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:23.069394 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:23.069394 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:23.069394 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 17:40:23.069394 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 17:40:23.069394 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 17:40:23.069394 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 17:40:23.070530 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:23.070530 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:23.070530 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 17:40:23.070530 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:40:23.070530 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 17:40:23.070530 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:40:23.070530 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:23.070530 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:23.070530 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:23.070530 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:23.070530 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:23.070530 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:23.070530 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:23.070530 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:23.070530 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:23.070530 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:23.070530 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:23.070530 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:23.071513 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:23.071513 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:23.071513 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 17:40:23.071513 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 17:40:23.071513 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 17:40:23.071513 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 17:40:23.071513 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 17:40:23.071513 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 17:40:23.071513 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 14 17:40:23.071513 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:40:23.075401 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 297/595] 10.222.0.67 () {56 vars in 1102 bytes} [Thu Jul 14 17:40:22 2022] GET /identity/v3/users/neutron => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:23.076298 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b55906-3f2f-4d21-a284-ff835b0cedb6 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:23.076897 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5998be15-f4c7-4e2a-90e8-b0255cede98d None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:23.115509 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b967e2-408c-40e2-be02-b90b3a5c1102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:23.117025 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b967e2-408c-40e2-be02-b90b3a5c1102 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:23.117814 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b967e2-408c-40e2-be02-b90b3a5c1102 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:23.118292 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b967e2-408c-40e2-be02-b90b3a5c1102 None admin] PATH_INFO: `/v3/projects` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:23.119324 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b967e2-408c-40e2-be02-b90b3a5c1102 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:23.119835 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b967e2-408c-40e2-be02-b90b3a5c1102 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:23.121657 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b967e2-408c-40e2-be02-b90b3a5c1102 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:23.135800 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 299/596] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 14 17:40:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:23.137227 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b967e2-408c-40e2-be02-b90b3a5c1102 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:23.190146 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b55906-3f2f-4d21-a284-ff835b0cedb6 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:23.226399 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530b0912-8e62-4328-9be9-c78fe70d3611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:23.227071 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530b0912-8e62-4328-9be9-c78fe70d3611 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:23.227379 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530b0912-8e62-4328-9be9-c78fe70d3611 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:23.227626 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530b0912-8e62-4328-9be9-c78fe70d3611 None admin] PATH_INFO: `/v3/domains` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:23.231995 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530b0912-8e62-4328-9be9-c78fe70d3611 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:23.231995 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530b0912-8e62-4328-9be9-c78fe70d3611 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:23.231995 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530b0912-8e62-4328-9be9-c78fe70d3611 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:23.241133 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:23.244284 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 298/597] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 14 17:40:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:23.248542 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530b0912-8e62-4328-9be9-c78fe70d3611 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:23.274308 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b967e2-408c-40e2-be02-b90b3a5c1102 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:23.278704 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:23.312179 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21275ae-e3ad-4c55-972f-64194c1bdf49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:23.312876 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21275ae-e3ad-4c55-972f-64194c1bdf49 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:23.313154 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21275ae-e3ad-4c55-972f-64194c1bdf49 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:23.313424 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21275ae-e3ad-4c55-972f-64194c1bdf49 None admin] PATH_INFO: `/v3/users` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:23.314298 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21275ae-e3ad-4c55-972f-64194c1bdf49 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:23.314605 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21275ae-e3ad-4c55-972f-64194c1bdf49 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:23.316029 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21275ae-e3ad-4c55-972f-64194c1bdf49 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:23.338403 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 300/598] 10.222.0.67 () {56 vars in 1139 bytes} [Thu Jul 14 17:40:23 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:23.338403 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21275ae-e3ad-4c55-972f-64194c1bdf49 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:23.370236 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530b0912-8e62-4328-9be9-c78fe70d3611 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:23.404875 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58afba60-9926-43b8-b61d-371417a256a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:23.405882 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58afba60-9926-43b8-b61d-371417a256a1 None admin] REQUEST_METHOD: `PUT` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:23.406163 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58afba60-9926-43b8-b61d-371417a256a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:23.406438 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58afba60-9926-43b8-b61d-371417a256a1 None admin] PATH_INFO: `/v3/projects/39a570421bb64fac8b1a0129f1bcc7d9/users/4eb7180aab4541b4aab6cf8648eac1f1/roles/edc349453a61464087c153399e397247` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:23.426189 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58afba60-9926-43b8-b61d-371417a256a1 None admin] RBAC: Authorizing `identity:create_grant(project_id=39a570421bb64fac8b1a0129f1bcc7d9, user_id=4eb7180aab4541b4aab6cf8648eac1f1, role_id=edc349453a61464087c153399e397247)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:23.427647 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58afba60-9926-43b8-b61d-371417a256a1 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:23.435987 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21275ae-e3ad-4c55-972f-64194c1bdf49 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:23.441618 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 299/599] 10.222.0.67 () {58 vars in 1439 bytes} [Thu Jul 14 17:40:23 2022] PUT /identity/v3/projects/39a570421bb64fac8b1a0129f1bcc7d9/users/4eb7180aab4541b4aab6cf8648eac1f1/roles/edc349453a61464087c153399e397247 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:40:23.448821 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf8b2c-6613-4d83-8869-77870b3b4725 None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:23.448821 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf8b2c-6613-4d83-8869-77870b3b4725 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:23.448821 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf8b2c-6613-4d83-8869-77870b3b4725 None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:23.448821 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 300/600] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:40:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:40:23.448821 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bf8b2c-6613-4d83-8869-77870b3b4725 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:23.497180 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee89f314-5ec6-484a-be5b-860f8678eb09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:23.498232 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee89f314-5ec6-484a-be5b-860f8678eb09 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:23.498582 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee89f314-5ec6-484a-be5b-860f8678eb09 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:23.498924 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee89f314-5ec6-484a-be5b-860f8678eb09 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:23.507517 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee89f314-5ec6-484a-be5b-860f8678eb09 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:23.509363 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:23.509652 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee89f314-5ec6-484a-be5b-860f8678eb09 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:23.528349 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-ee89f314-5ec6-484a-be5b-860f8678eb09 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:40:23.528349 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:23.528349 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:23.528349 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:23.528349 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:23.528349 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:23.528349 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:23.528349 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:23.528349 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:23.528349 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:23.528349 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:23.528349 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:23.528349 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 17:40:23.528349 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 17:40:23.528349 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 17:40:23.529648 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 17:40:23.529648 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:23.529648 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:23.529648 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:23.529648 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:23.529648 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:23.529648 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:23.529648 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:23.529648 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:23.529648 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:23.529648 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:23.529648 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:23.529648 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:23.529648 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:23.529648 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:23.529648 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:23.529648 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:23.530605 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 17:40:23.530605 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 17:40:23.530605 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 17:40:23.530605 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 17:40:23.530605 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 17:40:23.530605 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 17:40:23.530605 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:40:23.530605 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:40:23.533892 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 301/601] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 14 17:40:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:23.535547 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823dea9b-cbd8-41ba-93f2-7358a077b313 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:23.536124 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823dea9b-cbd8-41ba-93f2-7358a077b313 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:23.536583 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823dea9b-cbd8-41ba-93f2-7358a077b313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:23.556063 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-823dea9b-cbd8-41ba-93f2-7358a077b313 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:40:23.557854 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-823dea9b-cbd8-41ba-93f2-7358a077b313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:40:23.572842 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bf8b2c-6613-4d83-8869-77870b3b4725 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:23.585121 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:23.613279 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe44c1a1-82b6-48f7-8be9-3ada67e18641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:23.614159 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe44c1a1-82b6-48f7-8be9-3ada67e18641 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:23.614445 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe44c1a1-82b6-48f7-8be9-3ada67e18641 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:23.614721 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe44c1a1-82b6-48f7-8be9-3ada67e18641 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:23.627385 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe44c1a1-82b6-48f7-8be9-3ada67e18641 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:23.628939 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe44c1a1-82b6-48f7-8be9-3ada67e18641 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:23.649287 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-fe44c1a1-82b6-48f7-8be9-3ada67e18641 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:23.649287 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:23.649287 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:23.649287 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:23.649287 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:23.649287 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:23.649287 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:23.649287 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:23.649287 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:23.649287 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:23.649287 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:23.649287 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:23.649287 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:40:23.649287 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:40:23.649287 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:40:23.650261 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:40:23.650261 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:23.650261 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:23.650261 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:23.650261 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:23.650261 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:23.650261 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:23.650261 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:23.650261 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:23.650261 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:23.650261 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:23.650261 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:23.650261 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:23.650261 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:23.650261 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:23.650261 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:23.650261 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:23.651577 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:40:23.651577 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:40:23.651577 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:23.651577 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:40:23.651577 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 301/603] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:40:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:23.651577 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe44c1a1-82b6-48f7-8be9-3ada67e18641 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:23.652218 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 302/603] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:40:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:40:23.657326 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823dea9b-cbd8-41ba-93f2-7358a077b313 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:23.792543 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823dea9b-cbd8-41ba-93f2-7358a077b313 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:23.795151 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:23.799476 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe44c1a1-82b6-48f7-8be9-3ada67e18641 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:23.842579 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bc8aa5-c8f8-4a55-a958-0f1eeb486fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:23.843503 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc8aa5-c8f8-4a55-a958-0f1eeb486fd5 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:23.843991 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc8aa5-c8f8-4a55-a958-0f1eeb486fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:23.844283 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dbcce0-109d-4800-9fbf-9235ce3e44c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:23.844623 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc8aa5-c8f8-4a55-a958-0f1eeb486fd5 None admin] PATH_INFO: `/v3/projects` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:23.845137 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dbcce0-109d-4800-9fbf-9235ce3e44c8 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:23.845511 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dbcce0-109d-4800-9fbf-9235ce3e44c8 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:23.845906 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dbcce0-109d-4800-9fbf-9235ce3e44c8 None admin] PATH_INFO: `/v3/domains` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:23.846217 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bc8aa5-c8f8-4a55-a958-0f1eeb486fd5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:23.846689 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bc8aa5-c8f8-4a55-a958-0f1eeb486fd5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:23.846911 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dbcce0-109d-4800-9fbf-9235ce3e44c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:23.847309 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dbcce0-109d-4800-9fbf-9235ce3e44c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:23.848599 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bc8aa5-c8f8-4a55-a958-0f1eeb486fd5 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:23.848839 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dbcce0-109d-4800-9fbf-9235ce3e44c8 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:23.869297 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 303/604] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 14 17:40:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:40:23.870381 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dbcce0-109d-4800-9fbf-9235ce3e44c8 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:23.872651 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 302/605] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 14 17:40:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:23.874428 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bc8aa5-c8f8-4a55-a958-0f1eeb486fd5 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:23.898964 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:24.009339 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bc8aa5-c8f8-4a55-a958-0f1eeb486fd5 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:24.015555 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dbcce0-109d-4800-9fbf-9235ce3e44c8 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:24.053997 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17d9819-7636-499e-b7af-80bbea880f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:24.055085 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17d9819-7636-499e-b7af-80bbea880f63 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:24.055441 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17d9819-7636-499e-b7af-80bbea880f63 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:24.055786 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17d9819-7636-499e-b7af-80bbea880f63 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:24.056717 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ee21c7-fd07-4dca-9acf-073b9830d5b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:24.057772 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee21c7-fd07-4dca-9acf-073b9830d5b9 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:24.058233 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee21c7-fd07-4dca-9acf-073b9830d5b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:24.058682 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee21c7-fd07-4dca-9acf-073b9830d5b9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:24.066775 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17d9819-7636-499e-b7af-80bbea880f63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:40:24.067262 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ee21c7-fd07-4dca-9acf-073b9830d5b9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:24.069464 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ee21c7-fd07-4dca-9acf-073b9830d5b9 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:24.075497 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-b17d9819-7636-499e-b7af-80bbea880f63 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 17:40:24.075497 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:24.075497 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:24.075497 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:24.075497 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:24.075497 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:24.075497 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:24.075497 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:24.075497 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:24.075497 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:24.075497 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:24.075497 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:24.075497 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:40:24.075497 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:40:24.075497 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:40:24.075497 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:40:24.076481 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:40:24.076481 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:40:24.076481 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:40:24.076481 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:40:24.076481 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:24.076481 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:24.076481 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:24.076481 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:24.076481 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:24.076481 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:24.076481 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:24.076481 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:24.076481 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:24.076481 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:24.076481 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:24.076481 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:24.077841 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:24.077841 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:24.077841 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:24.077841 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:24.077841 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:40:24.077841 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:40:24.077841 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:40:24.077841 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:40:24.077841 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:40:24.077841 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:40:24.077841 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 17:40:24.077841 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:40:24.081886 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 304/606] 10.222.0.67 () {56 vars in 1102 bytes} [Thu Jul 14 17:40:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:24.082857 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17d9819-7636-499e-b7af-80bbea880f63 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:24.089441 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-18ee21c7-fd07-4dca-9acf-073b9830d5b9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:40:24.089441 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:24.089441 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:24.089441 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:24.089441 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:24.089441 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:24.089441 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:24.089441 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:24.089441 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:24.089441 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:24.089441 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:24.089441 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:24.089441 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 17:40:24.089441 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 17:40:24.089441 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 17:40:24.090386 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 17:40:24.090386 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:24.090386 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:24.090386 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:24.090386 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:24.090386 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:24.090386 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:24.090386 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:24.090386 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:24.090386 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:24.090386 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:24.090386 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:24.090386 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:24.090386 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:24.090386 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:24.090386 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:24.090386 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:24.091304 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 17:40:24.091304 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 17:40:24.091304 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 17:40:24.091304 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 17:40:24.091304 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 17:40:24.091304 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 17:40:24.091304 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:40:24.091304 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:40:24.094329 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 303/607] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 14 17:40:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:24.095695 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ee21c7-fd07-4dca-9acf-073b9830d5b9 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:24.129491 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:24.163903 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:24.207745 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17d9819-7636-499e-b7af-80bbea880f63 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:24.239732 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ee21c7-fd07-4dca-9acf-073b9830d5b9 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:24.252623 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f00136-c032-4ff0-a216-f49914fa49a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:24.254287 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f00136-c032-4ff0-a216-f49914fa49a2 None admin] REQUEST_METHOD: `PUT` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:24.255062 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f00136-c032-4ff0-a216-f49914fa49a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:24.255574 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f00136-c032-4ff0-a216-f49914fa49a2 None admin] PATH_INFO: `/v3/projects/39a570421bb64fac8b1a0129f1bcc7d9/users/de55cae1600841889668e36402861203/roles/edc349453a61464087c153399e397247` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:24.275782 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f00136-c032-4ff0-a216-f49914fa49a2 None admin] RBAC: Authorizing `identity:create_grant(project_id=39a570421bb64fac8b1a0129f1bcc7d9, user_id=de55cae1600841889668e36402861203, role_id=edc349453a61464087c153399e397247)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:24.277957 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f00136-c032-4ff0-a216-f49914fa49a2 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:24.280293 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d75c2f-a377-40a6-9512-8125f23badb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:24.281162 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d75c2f-a377-40a6-9512-8125f23badb5 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:24.281447 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d75c2f-a377-40a6-9512-8125f23badb5 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:24.281814 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d75c2f-a377-40a6-9512-8125f23badb5 None admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:24.283144 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d75c2f-a377-40a6-9512-8125f23badb5 None admin] RBAC: Adding query filter params (name=service) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:24.283419 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d75c2f-a377-40a6-9512-8125f23badb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:24.285195 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d75c2f-a377-40a6-9512-8125f23badb5 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:24.297999 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 304/608] 10.222.0.67 () {56 vars in 1103 bytes} [Thu Jul 14 17:40:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:24.299399 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d75c2f-a377-40a6-9512-8125f23badb5 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:24.305703 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 305/609] 10.222.0.67 () {58 vars in 1439 bytes} [Thu Jul 14 17:40:24 2022] PUT /identity/v3/projects/39a570421bb64fac8b1a0129f1bcc7d9/users/de55cae1600841889668e36402861203/roles/edc349453a61464087c153399e397247 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:40:24.306723 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f00136-c032-4ff0-a216-f49914fa49a2 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:24.403615 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:24.442959 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d75c2f-a377-40a6-9512-8125f23badb5 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:24.457647 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f00136-c032-4ff0-a216-f49914fa49a2 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:24.484350 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:24.496985 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86e2611-5377-4295-b182-01506d89b4ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:24.497735 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86e2611-5377-4295-b182-01506d89b4ee None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:24.498011 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86e2611-5377-4295-b182-01506d89b4ee None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:24.498288 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86e2611-5377-4295-b182-01506d89b4ee None admin] PATH_INFO: `/v3/projects` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:24.499092 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86e2611-5377-4295-b182-01506d89b4ee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:24.499588 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86e2611-5377-4295-b182-01506d89b4ee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:24.499909 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf801cc8-d839-4acd-b014-61b482f22727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:24.500982 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf801cc8-d839-4acd-b014-61b482f22727 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:24.501463 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf801cc8-d839-4acd-b014-61b482f22727 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:24.502016 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf801cc8-d839-4acd-b014-61b482f22727 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:24.502190 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86e2611-5377-4295-b182-01506d89b4ee None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:24.514240 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf801cc8-d839-4acd-b014-61b482f22727 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:24.515935 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf801cc8-d839-4acd-b014-61b482f22727 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:24.516937 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 305/610] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 14 17:40:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:24.518504 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d5b7a0-cc74-4662-a372-30117afd840c None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:24.518793 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d5b7a0-cc74-4662-a372-30117afd840c None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:24.519067 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d5b7a0-cc74-4662-a372-30117afd840c None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:24.525142 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 306/611] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:40:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:40:24.526182 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d5b7a0-cc74-4662-a372-30117afd840c None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:24.542172 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-bf801cc8-d839-4acd-b014-61b482f22727 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:24.542172 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:24.542172 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:24.542172 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:24.542172 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:24.542172 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:24.542172 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:24.542172 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:24.542172 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:24.542172 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:24.542172 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:24.542172 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:24.542172 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:40:24.542172 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:40:24.542172 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:40:24.543327 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:40:24.543327 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:24.543327 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:24.543327 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:24.543327 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:24.543327 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:24.543327 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:24.543327 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:24.543327 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:24.543327 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:24.543327 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:24.543327 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:24.543327 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:24.543327 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:24.543327 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:24.543327 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:24.543327 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:24.544458 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:40:24.544458 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:40:24.544458 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:24.544458 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:40:24.546284 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 306/612] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:40:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:24.547823 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d987a03-5692-4c94-b70c-4f43d3a894cf None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:24.548207 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d987a03-5692-4c94-b70c-4f43d3a894cf None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:24.548580 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d987a03-5692-4c94-b70c-4f43d3a894cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:24.568236 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-6d987a03-5692-4c94-b70c-4f43d3a894cf None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:40:24.569671 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-6d987a03-5692-4c94-b70c-4f43d3a894cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:40:24.647519 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d5b7a0-cc74-4662-a372-30117afd840c None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:24.661906 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 307/613] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:40:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:40:24.663619 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d987a03-5692-4c94-b70c-4f43d3a894cf None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:24.707226 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce19f28-1c58-40b9-8f78-ea9a883b10a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:24.708164 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce19f28-1c58-40b9-8f78-ea9a883b10a9 None admin] REQUEST_METHOD: `PUT` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:24.708446 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce19f28-1c58-40b9-8f78-ea9a883b10a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:24.708720 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce19f28-1c58-40b9-8f78-ea9a883b10a9 None admin] PATH_INFO: `/v3/projects/39a570421bb64fac8b1a0129f1bcc7d9/users/7bda83c5499f43f9838fda2679a522d4/roles/edc349453a61464087c153399e397247` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:24.724263 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:24.728636 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce19f28-1c58-40b9-8f78-ea9a883b10a9 None admin] RBAC: Authorizing `identity:create_grant(project_id=39a570421bb64fac8b1a0129f1bcc7d9, user_id=7bda83c5499f43f9838fda2679a522d4, role_id=edc349453a61464087c153399e397247)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:24.730913 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce19f28-1c58-40b9-8f78-ea9a883b10a9 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:24.747828 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 307/614] 10.222.0.67 () {58 vars in 1439 bytes} [Thu Jul 14 17:40:24 2022] PUT /identity/v3/projects/39a570421bb64fac8b1a0129f1bcc7d9/users/7bda83c5499f43f9838fda2679a522d4/roles/edc349453a61464087c153399e397247 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:40:24.749052 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce19f28-1c58-40b9-8f78-ea9a883b10a9 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:24.791199 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d987a03-5692-4c94-b70c-4f43d3a894cf None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:24.794992 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:24.830737 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7514cb48-ddf8-47e4-9155-df2bbe6b4517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:24.831816 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7514cb48-ddf8-47e4-9155-df2bbe6b4517 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:24.832301 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7514cb48-ddf8-47e4-9155-df2bbe6b4517 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:24.832779 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7514cb48-ddf8-47e4-9155-df2bbe6b4517 None admin] PATH_INFO: `/v3/domains` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:24.833789 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7514cb48-ddf8-47e4-9155-df2bbe6b4517 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:24.834856 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7514cb48-ddf8-47e4-9155-df2bbe6b4517 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:24.836494 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7514cb48-ddf8-47e4-9155-df2bbe6b4517 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:24.850522 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 308/615] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 14 17:40:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:24.862856 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7514cb48-ddf8-47e4-9155-df2bbe6b4517 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:24.868606 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce19f28-1c58-40b9-8f78-ea9a883b10a9 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:24.908442 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04916393-ea46-4826-9241-66c080d1ac1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:24.909287 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04916393-ea46-4826-9241-66c080d1ac1b None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:24.909639 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04916393-ea46-4826-9241-66c080d1ac1b None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:24.909918 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04916393-ea46-4826-9241-66c080d1ac1b None admin] PATH_INFO: `/v3/roles/service` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:24.923508 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04916393-ea46-4826-9241-66c080d1ac1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:40:24.937563 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-04916393-ea46-4826-9241-66c080d1ac1b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 17:40:24.937563 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:24.937563 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:24.937563 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:24.937563 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:24.937563 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:24.937563 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:24.937563 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:24.937563 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:24.937563 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:24.937563 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:24.937563 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:24.937563 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:40:24.937563 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:40:24.937563 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:40:24.937563 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:40:24.938652 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:40:24.938652 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:40:24.938652 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:40:24.938652 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:40:24.938652 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:24.938652 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:24.938652 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:24.938652 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:24.938652 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:24.938652 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:24.938652 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:24.938652 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:24.938652 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:24.938652 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:24.938652 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:24.938652 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:24.939540 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:24.939540 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:24.939540 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:24.939540 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:24.939540 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:40:24.939540 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:40:24.939540 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:40:24.939540 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:40:24.939540 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:40:24.939540 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:40:24.939540 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 17:40:24.939540 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:40:24.939540 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 308/616] 10.222.0.67 () {56 vars in 1102 bytes} [Thu Jul 14 17:40:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:24.940785 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04916393-ea46-4826-9241-66c080d1ac1b None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:25.011468 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:25.050006 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7514cb48-ddf8-47e4-9155-df2bbe6b4517 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:25.073363 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04916393-ea46-4826-9241-66c080d1ac1b None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:25.091337 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c3966a-f7b7-4cf6-b48c-55d25ba8feab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:25.092417 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c3966a-f7b7-4cf6-b48c-55d25ba8feab None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:25.092747 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c3966a-f7b7-4cf6-b48c-55d25ba8feab None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:25.093023 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c3966a-f7b7-4cf6-b48c-55d25ba8feab None admin] PATH_INFO: `/v3/users/swift` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:25.104326 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c3966a-f7b7-4cf6-b48c-55d25ba8feab None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:25.106566 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c3966a-f7b7-4cf6-b48c-55d25ba8feab None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:25.115177 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0160cd-cb3e-49c9-acc6-fe429d9fd7e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:25.116589 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0160cd-cb3e-49c9-acc6-fe429d9fd7e2 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:25.116978 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0160cd-cb3e-49c9-acc6-fe429d9fd7e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:25.117718 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0160cd-cb3e-49c9-acc6-fe429d9fd7e2 None admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:25.118595 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0160cd-cb3e-49c9-acc6-fe429d9fd7e2 None admin] RBAC: Adding query filter params (name=service) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:25.119007 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0160cd-cb3e-49c9-acc6-fe429d9fd7e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:25.120547 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0160cd-cb3e-49c9-acc6-fe429d9fd7e2 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:25.124633 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-98c3966a-f7b7-4cf6-b48c-55d25ba8feab None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 14 17:40:25.124633 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:25.124633 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:25.124633 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:25.124633 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:25.124633 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:25.124633 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:25.124633 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:25.124633 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:25.124633 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:25.124633 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:25.124633 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:25.124633 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 17:40:25.124633 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 17:40:25.124633 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 17:40:25.124633 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 17:40:25.125960 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:25.125960 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:25.125960 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 17:40:25.125960 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:40:25.125960 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 17:40:25.125960 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:40:25.125960 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:25.125960 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:25.125960 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:25.125960 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:25.125960 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:25.125960 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:25.125960 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:25.125960 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:25.125960 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:25.125960 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:25.125960 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:25.125960 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:25.127286 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:25.127286 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:25.127286 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 17:40:25.127286 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 17:40:25.127286 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 17:40:25.127286 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 17:40:25.127286 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 17:40:25.127286 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 17:40:25.127286 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 14 17:40:25.127286 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:40:25.127286 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 309/617] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 14 17:40:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:25.136139 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 309/618] 10.222.0.67 () {56 vars in 1103 bytes} [Thu Jul 14 17:40:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:40:25.138551 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c3966a-f7b7-4cf6-b48c-55d25ba8feab None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:25.142065 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0160cd-cb3e-49c9-acc6-fe429d9fd7e2 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:25.196505 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:25.298816 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0160cd-cb3e-49c9-acc6-fe429d9fd7e2 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:25.321884 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:25.338239 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fde45c-f536-4d4f-8430-1c22446e47c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:25.339348 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fde45c-f536-4d4f-8430-1c22446e47c2 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:25.339645 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fde45c-f536-4d4f-8430-1c22446e47c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:25.340065 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fde45c-f536-4d4f-8430-1c22446e47c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:25.353349 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fde45c-f536-4d4f-8430-1c22446e47c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:25.355048 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fde45c-f536-4d4f-8430-1c22446e47c2 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:25.375843 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-45fde45c-f536-4d4f-8430-1c22446e47c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:25.375843 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:25.375843 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:25.375843 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:25.375843 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:25.375843 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:25.375843 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:25.375843 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:25.375843 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:25.375843 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:25.375843 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:25.375843 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:25.375843 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:40:25.375843 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:40:25.375843 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:40:25.377043 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:40:25.377043 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:25.377043 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:25.377043 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:25.377043 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:25.377043 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:25.377043 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:25.377043 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:25.377043 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:25.377043 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:25.377043 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:25.377043 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:25.377043 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:25.377043 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:25.377043 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:25.377043 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:25.377043 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:25.377971 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:40:25.377971 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:40:25.377971 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:25.377971 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:40:25.377971 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 310/619] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:40:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:25.383406 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fde45c-f536-4d4f-8430-1c22446e47c2 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:25.395847 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c3966a-f7b7-4cf6-b48c-55d25ba8feab None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:25.473553 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1475a159-4cff-42ed-9a87-1e77555097ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:25.473553 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1475a159-4cff-42ed-9a87-1e77555097ce None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:25.473553 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1475a159-4cff-42ed-9a87-1e77555097ce None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:25.473553 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1475a159-4cff-42ed-9a87-1e77555097ce None admin] PATH_INFO: `/v3/users` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:25.473946 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1475a159-4cff-42ed-9a87-1e77555097ce None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:25.473946 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1475a159-4cff-42ed-9a87-1e77555097ce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:25.473946 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1475a159-4cff-42ed-9a87-1e77555097ce None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:25.511925 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 310/620] 10.222.0.67 () {56 vars in 1135 bytes} [Thu Jul 14 17:40:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:25.516969 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1475a159-4cff-42ed-9a87-1e77555097ce None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:25.583360 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fde45c-f536-4d4f-8430-1c22446e47c2 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:25.658357 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bb6405-ca5e-4425-9abc-fec0a6cc63b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:25.659204 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb6405-ca5e-4425-9abc-fec0a6cc63b0 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:25.659371 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb6405-ca5e-4425-9abc-fec0a6cc63b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:25.659611 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb6405-ca5e-4425-9abc-fec0a6cc63b0 None admin] PATH_INFO: `/v3/domains` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:25.660352 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bb6405-ca5e-4425-9abc-fec0a6cc63b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:25.660716 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bb6405-ca5e-4425-9abc-fec0a6cc63b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:25.662277 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bb6405-ca5e-4425-9abc-fec0a6cc63b0 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:25.679971 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:25.690709 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 311/621] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 14 17:40:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:25.692794 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bb6405-ca5e-4425-9abc-fec0a6cc63b0 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:25.716004 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1475a159-4cff-42ed-9a87-1e77555097ce None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:25.745149 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:25.765803 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e45def1-a54e-4ff0-a571-5f80600529c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:25.767046 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45def1-a54e-4ff0-a571-5f80600529c1 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:25.767554 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45def1-a54e-4ff0-a571-5f80600529c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:25.768036 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45def1-a54e-4ff0-a571-5f80600529c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:25.779505 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e45def1-a54e-4ff0-a571-5f80600529c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:25.781276 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e45def1-a54e-4ff0-a571-5f80600529c1 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:25.801447 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-6e45def1-a54e-4ff0-a571-5f80600529c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:25.801447 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:25.801447 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:25.801447 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:25.801447 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:25.801447 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:25.801447 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:25.801447 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:25.801447 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:25.801447 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:25.801447 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:25.801447 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:25.801447 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:40:25.801447 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:40:25.801447 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:40:25.802587 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:40:25.802587 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:25.802587 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:25.802587 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:25.802587 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:25.802587 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:25.802587 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:25.802587 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:25.802587 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:25.802587 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:25.802587 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:25.802587 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:25.802587 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:25.802587 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:25.802587 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:25.802587 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:25.802587 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:25.804486 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:40:25.804486 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:40:25.804486 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:25.804486 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:40:25.811345 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 311/622] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:40:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 17:40:25.812014 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f331f5-a608-4287-937b-aa82631aace5 None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:25.812014 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f331f5-a608-4287-937b-aa82631aace5 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:25.812264 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f331f5-a608-4287-937b-aa82631aace5 None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:25.814752 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 312/623] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:40:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:40:25.816011 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f331f5-a608-4287-937b-aa82631aace5 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:25.840581 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bb6405-ca5e-4425-9abc-fec0a6cc63b0 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:25.893782 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a43fe12-9955-4ecc-8c44-ed942dfe7416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:25.895228 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a43fe12-9955-4ecc-8c44-ed942dfe7416 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:25.895646 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a43fe12-9955-4ecc-8c44-ed942dfe7416 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:25.896093 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a43fe12-9955-4ecc-8c44-ed942dfe7416 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:25.908781 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a43fe12-9955-4ecc-8c44-ed942dfe7416 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:25.910437 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a43fe12-9955-4ecc-8c44-ed942dfe7416 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:25.930187 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-1a43fe12-9955-4ecc-8c44-ed942dfe7416 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 17:40:25.930187 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:25.930187 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:25.930187 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:25.930187 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:25.930187 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:25.930187 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:25.930187 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:25.930187 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:25.930187 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:25.930187 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:25.930187 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:25.930187 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 17:40:25.930187 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 17:40:25.930187 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 17:40:25.930187 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 17:40:25.931220 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:25.931220 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:25.931220 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 17:40:25.931220 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:40:25.931220 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 17:40:25.931220 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:40:25.931220 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:25.931220 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:25.931220 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:25.931220 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:25.931220 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:25.931220 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:25.931220 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:25.931220 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:25.931220 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:25.931220 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:25.931220 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:25.931220 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:25.932200 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:25.932200 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:25.932200 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 17:40:25.932200 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 17:40:25.932200 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 17:40:25.932200 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 17:40:25.932200 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 17:40:25.932200 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 17:40:25.932200 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 17:40:25.932200 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:40:25.938801 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f331f5-a608-4287-937b-aa82631aace5 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:25.939363 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 312/624] 10.222.0.67 () {56 vars in 1093 bytes} [Thu Jul 14 17:40:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:25.940857 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66986092-bd7f-431b-9387-31220cab8aa8 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:25.941353 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66986092-bd7f-431b-9387-31220cab8aa8 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:25.941899 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66986092-bd7f-431b-9387-31220cab8aa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:25.959095 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-66986092-bd7f-431b-9387-31220cab8aa8 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:40:25.960733 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-66986092-bd7f-431b-9387-31220cab8aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:40:25.980165 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fd2510-2897-44c7-81b8-f2001686ea76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:25.980771 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fd2510-2897-44c7-81b8-f2001686ea76 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:25.981098 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fd2510-2897-44c7-81b8-f2001686ea76 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:25.981375 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fd2510-2897-44c7-81b8-f2001686ea76 None admin] PATH_INFO: `/v3/domains` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:25.982146 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fd2510-2897-44c7-81b8-f2001686ea76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:25.982454 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fd2510-2897-44c7-81b8-f2001686ea76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:25.983841 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fd2510-2897-44c7-81b8-f2001686ea76 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:25.986080 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:26.004360 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 313/625] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 14 17:40:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:26.006780 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fd2510-2897-44c7-81b8-f2001686ea76 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:26.061551 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 313/626] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:40:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:40:26.061551 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66986092-bd7f-431b-9387-31220cab8aa8 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:26.086191 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:26.155406 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fd2510-2897-44c7-81b8-f2001686ea76 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:26.177887 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66986092-bd7f-431b-9387-31220cab8aa8 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:26.195198 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d6a02e-dc42-4480-bc91-7b977f0496a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:26.196293 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d6a02e-dc42-4480-bc91-7b977f0496a4 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:26.196581 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d6a02e-dc42-4480-bc91-7b977f0496a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:26.196860 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d6a02e-dc42-4480-bc91-7b977f0496a4 None admin] PATH_INFO: `/v3/users` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:26.197892 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d6a02e-dc42-4480-bc91-7b977f0496a4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:26.198320 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d6a02e-dc42-4480-bc91-7b977f0496a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:26.199918 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d6a02e-dc42-4480-bc91-7b977f0496a4 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:26.218643 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88124a0-2667-4928-bad3-6056bc728455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:26.219810 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88124a0-2667-4928-bad3-6056bc728455 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:26.220297 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88124a0-2667-4928-bad3-6056bc728455 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:26.220777 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88124a0-2667-4928-bad3-6056bc728455 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:26.225833 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 314/627] 10.222.0.67 () {56 vars in 1133 bytes} [Thu Jul 14 17:40:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:26.225833 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d6a02e-dc42-4480-bc91-7b977f0496a4 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:26.233710 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88124a0-2667-4928-bad3-6056bc728455 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:26.235597 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88124a0-2667-4928-bad3-6056bc728455 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:26.251694 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-c88124a0-2667-4928-bad3-6056bc728455 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:40:26.251694 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:26.251694 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:26.251694 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:26.251694 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:26.251694 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:26.251694 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:26.251694 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:26.251694 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:26.251694 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:26.251694 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:26.251694 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:26.251694 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 17:40:26.251694 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 17:40:26.251694 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 17:40:26.252675 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 17:40:26.252675 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:26.252675 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:26.252675 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:26.252675 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:26.252675 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:26.252675 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:26.252675 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:26.252675 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:26.252675 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:26.252675 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:26.252675 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:26.252675 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:26.252675 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:26.252675 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:26.252675 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:26.252675 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:26.254002 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 17:40:26.254002 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 17:40:26.254002 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 17:40:26.254002 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 17:40:26.254002 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 17:40:26.254002 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 17:40:26.254002 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:40:26.254002 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:40:26.257125 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 314/628] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 14 17:40:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:26.258350 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88124a0-2667-4928-bad3-6056bc728455 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:26.281852 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:26.340739 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d6a02e-dc42-4480-bc91-7b977f0496a4 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:26.344697 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:26.371233 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88124a0-2667-4928-bad3-6056bc728455 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:26.384092 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cab8ded-930f-4fc1-b4d1-6bd1b8bc5b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:26.385170 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cab8ded-930f-4fc1-b4d1-6bd1b8bc5b15 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:26.385456 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cab8ded-930f-4fc1-b4d1-6bd1b8bc5b15 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:26.385760 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cab8ded-930f-4fc1-b4d1-6bd1b8bc5b15 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:26.398862 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cab8ded-930f-4fc1-b4d1-6bd1b8bc5b15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:40:26.408392 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-5cab8ded-930f-4fc1-b4d1-6bd1b8bc5b15 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 17:40:26.408392 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:26.408392 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:26.408392 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:26.408392 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:26.408392 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:26.408392 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:26.408392 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:26.408392 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:26.408392 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:26.408392 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:26.408392 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:26.408392 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:40:26.408392 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:40:26.408392 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:40:26.408392 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:40:26.409376 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:40:26.409376 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:40:26.409376 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:40:26.409376 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:40:26.409376 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:26.409376 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:26.409376 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:26.409376 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:26.409376 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:26.409376 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:26.409376 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:26.409376 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:26.409376 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:26.409376 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:26.409376 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:26.409376 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:26.410858 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:26.410858 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:26.410858 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:26.410858 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:26.410858 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:40:26.410858 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:40:26.410858 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:40:26.410858 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:40:26.410858 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:40:26.410858 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:40:26.410858 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 17:40:26.410858 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:40:26.410858 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 315/629] 10.222.0.67 () {56 vars in 1102 bytes} [Thu Jul 14 17:40:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:26.410858 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cab8ded-930f-4fc1-b4d1-6bd1b8bc5b15 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:26.412412 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f92de4f-f46f-4f07-b43c-b0538865883f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:26.413655 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f92de4f-f46f-4f07-b43c-b0538865883f None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:26.414303 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f92de4f-f46f-4f07-b43c-b0538865883f None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:26.414772 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f92de4f-f46f-4f07-b43c-b0538865883f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:26.511132 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f92de4f-f46f-4f07-b43c-b0538865883f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:26.512526 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f92de4f-f46f-4f07-b43c-b0538865883f None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:26.540725 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cab8ded-930f-4fc1-b4d1-6bd1b8bc5b15 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:26.557539 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:26.582665 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3990e0-0574-460c-b1eb-500ce5cad80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:26.583499 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3990e0-0574-460c-b1eb-500ce5cad80f None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:26.583708 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3990e0-0574-460c-b1eb-500ce5cad80f None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:26.583985 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3990e0-0574-460c-b1eb-500ce5cad80f None admin] PATH_INFO: `/v3/projects` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:26.585614 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3990e0-0574-460c-b1eb-500ce5cad80f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:26.585927 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3990e0-0574-460c-b1eb-500ce5cad80f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:26.587472 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3990e0-0574-460c-b1eb-500ce5cad80f None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:26.601551 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 316/630] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 14 17:40:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:26.602325 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3990e0-0574-460c-b1eb-500ce5cad80f None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:26.610218 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:26.647873 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 315/631] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 14 17:40:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 17:40:26.647873 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f92de4f-f46f-4f07-b43c-b0538865883f None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:26.732756 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3990e0-0574-460c-b1eb-500ce5cad80f None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:26.773550 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f92de4f-f46f-4f07-b43c-b0538865883f None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:26.777357 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd5371d-8131-4d62-bf97-0aec2fee5266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:26.778254 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd5371d-8131-4d62-bf97-0aec2fee5266 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:26.778707 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd5371d-8131-4d62-bf97-0aec2fee5266 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:26.779177 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd5371d-8131-4d62-bf97-0aec2fee5266 None admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:26.780108 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd5371d-8131-4d62-bf97-0aec2fee5266 None admin] RBAC: Adding query filter params (name=service) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:26.780586 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd5371d-8131-4d62-bf97-0aec2fee5266 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:26.782170 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd5371d-8131-4d62-bf97-0aec2fee5266 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:26.791809 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 317/632] 10.222.0.67 () {56 vars in 1103 bytes} [Thu Jul 14 17:40:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:26.793161 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd5371d-8131-4d62-bf97-0aec2fee5266 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:26.814949 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b5472f-f001-42f1-8749-4f08611e5137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:26.815844 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5472f-f001-42f1-8749-4f08611e5137 None admin] REQUEST_METHOD: `PUT` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:26.816124 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5472f-f001-42f1-8749-4f08611e5137 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:26.816398 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5472f-f001-42f1-8749-4f08611e5137 None admin] PATH_INFO: `/v3/projects/39a570421bb64fac8b1a0129f1bcc7d9/users/c65607a396474192a43c374d306ef5ba/roles/edc349453a61464087c153399e397247` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:26.831605 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:26.832168 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b5472f-f001-42f1-8749-4f08611e5137 None admin] RBAC: Authorizing `identity:create_grant(project_id=39a570421bb64fac8b1a0129f1bcc7d9, user_id=c65607a396474192a43c374d306ef5ba, role_id=edc349453a61464087c153399e397247)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:26.834936 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b5472f-f001-42f1-8749-4f08611e5137 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:26.848388 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 316/633] 10.222.0.67 () {58 vars in 1439 bytes} [Thu Jul 14 17:40:26 2022] PUT /identity/v3/projects/39a570421bb64fac8b1a0129f1bcc7d9/users/c65607a396474192a43c374d306ef5ba/roles/edc349453a61464087c153399e397247 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:40:26.850460 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2bce08-6de5-4405-a51c-250c5cad8ddd None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:26.850924 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2bce08-6de5-4405-a51c-250c5cad8ddd None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:26.851347 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2bce08-6de5-4405-a51c-250c5cad8ddd None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:26.852828 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 317/634] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:40:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:40:26.853767 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2bce08-6de5-4405-a51c-250c5cad8ddd None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:26.907168 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:26.935517 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd5371d-8131-4d62-bf97-0aec2fee5266 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:26.973740 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f9e717-95a4-41ad-b755-cba5cd260fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:26.974932 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f9e717-95a4-41ad-b755-cba5cd260fdf None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:26.975924 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f9e717-95a4-41ad-b755-cba5cd260fdf None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:26.976349 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f9e717-95a4-41ad-b755-cba5cd260fdf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:26.988844 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f9e717-95a4-41ad-b755-cba5cd260fdf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:26.990653 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f9e717-95a4-41ad-b755-cba5cd260fdf None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:27.010542 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-79f9e717-95a4-41ad-b755-cba5cd260fdf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:27.010542 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:27.010542 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:27.010542 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:27.010542 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:27.010542 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:27.010542 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:27.010542 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:27.010542 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:27.010542 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:27.010542 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:27.010542 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:27.010542 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:40:27.010542 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:40:27.010542 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:40:27.011632 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:40:27.011632 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:27.011632 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:27.011632 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:27.011632 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:27.011632 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:27.011632 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:27.011632 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:27.011632 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:27.011632 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:27.011632 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:27.011632 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:27.011632 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:27.011632 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:27.011632 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:27.011632 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:27.011632 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:27.012697 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:40:27.012697 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:40:27.012697 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:27.012697 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:40:27.014364 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 318/635] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:40:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:27.016365 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91206043-a7a4-46cc-93d6-d5c38d6e8034 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:27.016853 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91206043-a7a4-46cc-93d6-d5c38d6e8034 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:27.017321 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91206043-a7a4-46cc-93d6-d5c38d6e8034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:27.036962 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-91206043-a7a4-46cc-93d6-d5c38d6e8034 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:40:27.039194 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-91206043-a7a4-46cc-93d6-d5c38d6e8034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:40:27.068988 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2bce08-6de5-4405-a51c-250c5cad8ddd None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:27.115173 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dba41d-fedf-414c-9633-69b28f36ed37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:27.116277 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dba41d-fedf-414c-9633-69b28f36ed37 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:27.116710 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dba41d-fedf-414c-9633-69b28f36ed37 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:27.116994 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dba41d-fedf-414c-9633-69b28f36ed37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:27.122440 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 319/636] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:40:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:40:27.123207 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91206043-a7a4-46cc-93d6-d5c38d6e8034 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:27.129279 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dba41d-fedf-414c-9633-69b28f36ed37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:27.130760 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dba41d-fedf-414c-9633-69b28f36ed37 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:27.150794 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:27.154501 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-51dba41d-fedf-414c-9633-69b28f36ed37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:27.154501 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:27.154501 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:27.154501 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:27.154501 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:27.154501 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:27.154501 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:27.154501 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:27.154501 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:27.154501 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:27.154501 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:27.154501 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:27.154501 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:40:27.154501 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:40:27.154501 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:40:27.155589 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:40:27.155589 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:27.155589 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:27.155589 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:27.155589 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:27.155589 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:27.155589 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:27.155589 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:27.155589 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:27.155589 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:27.155589 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:27.155589 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:27.155589 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:27.155589 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:27.155589 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:27.155589 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:27.155589 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:27.156609 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:40:27.156609 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:40:27.156609 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:27.156609 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:40:27.160321 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 318/637] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:40:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:27.161779 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610c961-35b5-4695-aa6a-16ab128a19ab None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:27.162412 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610c961-35b5-4695-aa6a-16ab128a19ab None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:27.163301 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610c961-35b5-4695-aa6a-16ab128a19ab None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:27.164828 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 319/638] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:40:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:40:27.165359 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e610c961-35b5-4695-aa6a-16ab128a19ab None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:27.254371 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:27.268706 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91206043-a7a4-46cc-93d6-d5c38d6e8034 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:27.280961 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e610c961-35b5-4695-aa6a-16ab128a19ab None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:27.304266 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b8a36a-7820-4b7b-852c-33a7d97f2152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:27.304879 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b8a36a-7820-4b7b-852c-33a7d97f2152 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:27.305159 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b8a36a-7820-4b7b-852c-33a7d97f2152 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:27.305431 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b8a36a-7820-4b7b-852c-33a7d97f2152 None admin] PATH_INFO: `/v3/domains` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:27.306285 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b8a36a-7820-4b7b-852c-33a7d97f2152 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:27.306595 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b8a36a-7820-4b7b-852c-33a7d97f2152 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:27.307957 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b8a36a-7820-4b7b-852c-33a7d97f2152 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:27.318241 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974f8daa-d423-4cf4-b988-fdfd18a18775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:27.319443 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f8daa-d423-4cf4-b988-fdfd18a18775 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:27.319722 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f8daa-d423-4cf4-b988-fdfd18a18775 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:27.319990 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f8daa-d423-4cf4-b988-fdfd18a18775 None admin] PATH_INFO: `/v3/domains` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:27.324611 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 320/639] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 14 17:40:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:27.324745 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974f8daa-d423-4cf4-b988-fdfd18a18775 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:27.324745 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974f8daa-d423-4cf4-b988-fdfd18a18775 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:27.324912 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b8a36a-7820-4b7b-852c-33a7d97f2152 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:27.324986 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974f8daa-d423-4cf4-b988-fdfd18a18775 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:27.339244 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 320/640] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 14 17:40:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:27.339244 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10863e27-6ace-47aa-923e-0a4bcc019763 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:27.339244 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10863e27-6ace-47aa-923e-0a4bcc019763 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:27.339244 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10863e27-6ace-47aa-923e-0a4bcc019763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:27.355584 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-10863e27-6ace-47aa-923e-0a4bcc019763 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:40:27.356847 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-10863e27-6ace-47aa-923e-0a4bcc019763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:40:27.422334 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:27.429351 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 321/641] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:40:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:40:27.430099 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10863e27-6ace-47aa-923e-0a4bcc019763 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:27.459416 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b8a36a-7820-4b7b-852c-33a7d97f2152 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:27.496753 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5049b38-8df1-4cf7-ac9b-e7e29230c48b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:27.497569 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5049b38-8df1-4cf7-ac9b-e7e29230c48b None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:27.497866 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5049b38-8df1-4cf7-ac9b-e7e29230c48b None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:27.498129 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5049b38-8df1-4cf7-ac9b-e7e29230c48b None admin] PATH_INFO: `/v3/roles/service` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:27.503130 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:27.509759 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5049b38-8df1-4cf7-ac9b-e7e29230c48b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:40:27.517825 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-c5049b38-8df1-4cf7-ac9b-e7e29230c48b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 17:40:27.517825 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:27.517825 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:27.517825 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:27.517825 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:27.517825 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:27.517825 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:27.517825 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:27.517825 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:27.517825 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:27.517825 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:27.517825 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:27.517825 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:40:27.517825 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:40:27.517825 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:40:27.517825 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:40:27.518778 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:40:27.518778 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:40:27.518778 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:40:27.518778 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:40:27.518778 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:27.518778 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:27.518778 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:27.518778 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:27.518778 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:27.518778 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:27.518778 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:27.518778 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:27.518778 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:27.518778 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:27.518778 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:27.518778 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:27.519637 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:27.519637 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:27.519637 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:27.519637 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:27.519637 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:40:27.519637 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:40:27.519637 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:40:27.519637 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:40:27.519637 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:40:27.519637 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:40:27.519637 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 17:40:27.519637 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:40:27.519637 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 321/642] 10.222.0.67 () {56 vars in 1102 bytes} [Thu Jul 14 17:40:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:27.521031 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5049b38-8df1-4cf7-ac9b-e7e29230c48b None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:27.539911 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10863e27-6ace-47aa-923e-0a4bcc019763 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:27.577777 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2301ef5-aee9-49fc-9798-67fc8b21e4c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:27.578497 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2301ef5-aee9-49fc-9798-67fc8b21e4c0 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:27.578781 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2301ef5-aee9-49fc-9798-67fc8b21e4c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:27.579056 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2301ef5-aee9-49fc-9798-67fc8b21e4c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:27.586504 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2301ef5-aee9-49fc-9798-67fc8b21e4c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:27.587937 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2301ef5-aee9-49fc-9798-67fc8b21e4c0 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:27.601975 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-f2301ef5-aee9-49fc-9798-67fc8b21e4c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:40:27.601975 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:27.601975 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:27.601975 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:27.601975 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:27.601975 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:27.601975 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:27.601975 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:27.601975 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:27.601975 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:27.601975 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:27.601975 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:27.601975 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 17:40:27.601975 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 17:40:27.601975 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 17:40:27.602970 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 17:40:27.602970 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:27.602970 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:27.602970 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:27.602970 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:27.602970 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:27.602970 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:27.602970 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:27.602970 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:27.602970 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:27.602970 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:27.602970 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:27.602970 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:27.602970 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:27.602970 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:27.602970 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:27.602970 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:27.608651 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 17:40:27.608651 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 17:40:27.608651 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 17:40:27.608651 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 17:40:27.608651 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 17:40:27.608651 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 17:40:27.608651 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:40:27.608651 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:40:27.608651 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 322/643] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 14 17:40:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:27.608651 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2301ef5-aee9-49fc-9798-67fc8b21e4c0 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:27.638938 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5049b38-8df1-4cf7-ac9b-e7e29230c48b None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:27.674835 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c347995a-1c1b-4907-a6d4-46653b93ebe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:27.675632 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c347995a-1c1b-4907-a6d4-46653b93ebe6 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:27.675919 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c347995a-1c1b-4907-a6d4-46653b93ebe6 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:27.676194 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c347995a-1c1b-4907-a6d4-46653b93ebe6 None admin] PATH_INFO: `/v3/users/glance` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:27.679108 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:27.686445 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c347995a-1c1b-4907-a6d4-46653b93ebe6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:27.688291 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c347995a-1c1b-4907-a6d4-46653b93ebe6 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:27.703024 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-c347995a-1c1b-4907-a6d4-46653b93ebe6 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 14 17:40:27.703024 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:27.703024 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:27.703024 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:27.703024 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:27.703024 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:27.703024 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:27.703024 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:27.703024 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:27.703024 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:27.703024 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:27.703024 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:27.703024 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 17:40:27.703024 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 17:40:27.703024 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 17:40:27.703024 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 17:40:27.704029 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:27.704029 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:27.704029 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 17:40:27.704029 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:40:27.704029 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 17:40:27.704029 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:40:27.704029 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:27.704029 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:27.704029 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:27.704029 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:27.704029 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:27.704029 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:27.704029 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:27.704029 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:27.704029 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:27.704029 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:27.704029 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:27.704029 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:27.705073 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:27.705073 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:27.705073 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 17:40:27.705073 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 17:40:27.705073 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 17:40:27.705073 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 17:40:27.705073 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 17:40:27.705073 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 17:40:27.705073 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 14 17:40:27.705073 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:40:27.705073 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 322/644] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 14 17:40:27 2022] GET /identity/v3/users/glance => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:27.705073 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c347995a-1c1b-4907-a6d4-46653b93ebe6 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:27.718058 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2301ef5-aee9-49fc-9798-67fc8b21e4c0 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:27.746492 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:27.756858 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be878e8f-d10f-486d-a3f0-ef4719419c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:27.757732 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be878e8f-d10f-486d-a3f0-ef4719419c9e None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:27.758016 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be878e8f-d10f-486d-a3f0-ef4719419c9e None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:27.758293 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be878e8f-d10f-486d-a3f0-ef4719419c9e None admin] PATH_INFO: `/v3/roles/service` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:27.770301 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be878e8f-d10f-486d-a3f0-ef4719419c9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:40:27.778860 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-be878e8f-d10f-486d-a3f0-ef4719419c9e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 17:40:27.778860 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:27.778860 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:27.778860 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:27.778860 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:27.778860 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:27.778860 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:27.778860 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:27.778860 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:27.778860 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:27.778860 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:27.778860 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:27.778860 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:40:27.778860 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:40:27.778860 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:40:27.778860 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:40:27.780549 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:40:27.780549 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:40:27.780549 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:40:27.780549 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:40:27.780549 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:27.780549 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:27.780549 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:27.780549 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:27.780549 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:27.780549 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:27.780549 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:27.780549 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:27.780549 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:27.780549 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:27.780549 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:27.780549 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:27.781481 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:27.781481 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:27.781481 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:27.781481 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:27.781481 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:40:27.781481 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:40:27.781481 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:40:27.781481 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:40:27.781481 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:40:27.781481 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:40:27.781481 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 17:40:27.781481 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:40:27.781481 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 323/645] 10.222.0.67 () {56 vars in 1102 bytes} [Thu Jul 14 17:40:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:27.781481 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be878e8f-d10f-486d-a3f0-ef4719419c9e None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:27.828756 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c347995a-1c1b-4907-a6d4-46653b93ebe6 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:27.867384 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd822c93-546e-414c-a9de-659563c1842b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:27.868320 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd822c93-546e-414c-a9de-659563c1842b None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:27.868602 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd822c93-546e-414c-a9de-659563c1842b None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:27.868876 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd822c93-546e-414c-a9de-659563c1842b None admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:27.869673 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd822c93-546e-414c-a9de-659563c1842b None admin] RBAC: Adding query filter params (name=service) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:27.869984 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd822c93-546e-414c-a9de-659563c1842b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:27.871393 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd822c93-546e-414c-a9de-659563c1842b None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:27.885369 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 323/646] 10.222.0.67 () {56 vars in 1103 bytes} [Thu Jul 14 17:40:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:27.885369 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd822c93-546e-414c-a9de-659563c1842b None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:27.907270 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be878e8f-d10f-486d-a3f0-ef4719419c9e None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:27.946907 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:27.948708 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace09e20-435d-48cc-8326-2e58ec892bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:27.949479 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace09e20-435d-48cc-8326-2e58ec892bee None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:27.949800 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace09e20-435d-48cc-8326-2e58ec892bee None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:27.950031 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace09e20-435d-48cc-8326-2e58ec892bee None admin] PATH_INFO: `/v3/projects` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:27.950790 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace09e20-435d-48cc-8326-2e58ec892bee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:27.951176 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace09e20-435d-48cc-8326-2e58ec892bee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:27.952551 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace09e20-435d-48cc-8326-2e58ec892bee None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:27.972255 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 324/647] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 14 17:40:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:27.972255 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace09e20-435d-48cc-8326-2e58ec892bee None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:27.994423 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd822c93-546e-414c-a9de-659563c1842b None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:28.029594 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:28.040544 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93801e6-956d-4d0c-9d38-58651000e3e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:28.041333 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93801e6-956d-4d0c-9d38-58651000e3e3 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:28.041542 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93801e6-956d-4d0c-9d38-58651000e3e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:28.041847 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93801e6-956d-4d0c-9d38-58651000e3e3 None admin] PATH_INFO: `/v3/users` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:28.042825 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93801e6-956d-4d0c-9d38-58651000e3e3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:28.043039 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93801e6-956d-4d0c-9d38-58651000e3e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:28.044532 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93801e6-956d-4d0c-9d38-58651000e3e3 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:28.069604 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 324/648] 10.222.0.67 () {56 vars in 1137 bytes} [Thu Jul 14 17:40:27 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:28.070615 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93801e6-956d-4d0c-9d38-58651000e3e3 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:28.091852 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace09e20-435d-48cc-8326-2e58ec892bee None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:28.132576 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d312879-21b2-4ea2-8591-aa04e4ac97a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:28.133246 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d312879-21b2-4ea2-8591-aa04e4ac97a7 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:28.133554 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d312879-21b2-4ea2-8591-aa04e4ac97a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:28.133827 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d312879-21b2-4ea2-8591-aa04e4ac97a7 None admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:28.134572 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d312879-21b2-4ea2-8591-aa04e4ac97a7 None admin] RBAC: Adding query filter params (name=service) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:28.134876 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d312879-21b2-4ea2-8591-aa04e4ac97a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:28.136317 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d312879-21b2-4ea2-8591-aa04e4ac97a7 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:28.150387 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 325/649] 10.222.0.67 () {56 vars in 1103 bytes} [Thu Jul 14 17:40:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:28.151254 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d312879-21b2-4ea2-8591-aa04e4ac97a7 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:28.176705 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93801e6-956d-4d0c-9d38-58651000e3e3 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:28.194440 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:28.214336 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3272aaaa-490b-4995-85ef-d58146762995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:28.215147 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3272aaaa-490b-4995-85ef-d58146762995 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:28.215432 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3272aaaa-490b-4995-85ef-d58146762995 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:28.215917 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3272aaaa-490b-4995-85ef-d58146762995 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:28.225967 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3272aaaa-490b-4995-85ef-d58146762995 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:28.227714 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3272aaaa-490b-4995-85ef-d58146762995 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:28.247325 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-3272aaaa-490b-4995-85ef-d58146762995 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:28.247325 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:28.247325 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:28.247325 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:28.247325 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:28.247325 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:28.247325 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:28.247325 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:28.247325 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:28.247325 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:28.247325 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:28.247325 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:28.247325 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:40:28.247325 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:40:28.247325 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:40:28.248301 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:40:28.248301 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:28.248301 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:28.248301 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:28.248301 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:28.248301 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:28.248301 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:28.248301 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:28.248301 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:28.248301 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:28.248301 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:28.248301 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:28.248301 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:28.248301 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:28.248301 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:28.248301 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:28.248301 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:28.254187 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:40:28.254187 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:40:28.254187 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:28.254187 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:40:28.254187 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 325/650] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:40:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:28.254187 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3272aaaa-490b-4995-85ef-d58146762995 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:28.268473 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d312879-21b2-4ea2-8591-aa04e4ac97a7 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:28.281014 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:28.306529 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbee5d22-184d-4eb5-8fbe-c0aa23030a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:28.307290 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbee5d22-184d-4eb5-8fbe-c0aa23030a3d None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:28.308038 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbee5d22-184d-4eb5-8fbe-c0aa23030a3d None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:28.308326 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbee5d22-184d-4eb5-8fbe-c0aa23030a3d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:28.309216 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbee5d22-184d-4eb5-8fbe-c0aa23030a3d None admin] RBAC: Adding query filter params (role.id=edc349453a61464087c153399e397247, scope.project.id=39a570421bb64fac8b1a0129f1bcc7d9, user.id=41b893bdf4ec474dbfa819c22fc29ce9) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:28.309551 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbee5d22-184d-4eb5-8fbe-c0aa23030a3d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:28.311151 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbee5d22-184d-4eb5-8fbe-c0aa23030a3d None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:28.325557 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 326/651] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 14 17:40:28 2022] GET /identity/v3/role_assignments?user.id=41b893bdf4ec474dbfa819c22fc29ce9&scope.project.id=39a570421bb64fac8b1a0129f1bcc7d9&role.id=edc349453a61464087c153399e397247 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:28.325557 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbee5d22-184d-4eb5-8fbe-c0aa23030a3d None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:28.374250 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3272aaaa-490b-4995-85ef-d58146762995 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:28.417043 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7266085-9aff-4d1b-9918-5a7207f57881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:28.417746 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7266085-9aff-4d1b-9918-5a7207f57881 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:28.418131 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7266085-9aff-4d1b-9918-5a7207f57881 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:28.418414 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7266085-9aff-4d1b-9918-5a7207f57881 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:28.434642 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbee5d22-184d-4eb5-8fbe-c0aa23030a3d None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:28.476081 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5c512e-10a1-4569-a74d-1457f09eaf8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:28.476888 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c512e-10a1-4569-a74d-1457f09eaf8e None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:28.477170 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c512e-10a1-4569-a74d-1457f09eaf8e None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:28.478038 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c512e-10a1-4569-a74d-1457f09eaf8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:28.480267 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:28.494634 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5c512e-10a1-4569-a74d-1457f09eaf8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:28.496190 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5c512e-10a1-4569-a74d-1457f09eaf8e None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:28.514576 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-6e5c512e-10a1-4569-a74d-1457f09eaf8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:28.514576 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:28.514576 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:28.514576 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:28.514576 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:28.514576 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:28.514576 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:28.514576 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:28.514576 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:28.514576 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:28.514576 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:28.514576 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:28.514576 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:40:28.514576 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:40:28.514576 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:40:28.515734 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:40:28.515734 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:28.515734 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:28.515734 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:28.515734 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:28.515734 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:28.515734 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:28.515734 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:28.515734 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:28.515734 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:28.515734 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:28.515734 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:28.515734 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:28.515734 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:28.515734 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:28.515734 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:28.515734 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:28.516735 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:40:28.516735 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:40:28.516735 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:28.516735 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:40:28.516735 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 327/652] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:40:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:28.517079 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5c512e-10a1-4569-a74d-1457f09eaf8e None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:28.526415 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7266085-9aff-4d1b-9918-5a7207f57881 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:28.528297 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7266085-9aff-4d1b-9918-5a7207f57881 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:28.550158 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:28.651829 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5c512e-10a1-4569-a74d-1457f09eaf8e None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:28.665546 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 326/653] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 14 17:40:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 17:40:28.666630 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7266085-9aff-4d1b-9918-5a7207f57881 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:28.703272 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de58119-06f2-42bd-8181-37c4f0296da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:28.704198 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de58119-06f2-42bd-8181-37c4f0296da8 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:28.704485 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de58119-06f2-42bd-8181-37c4f0296da8 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:28.705169 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de58119-06f2-42bd-8181-37c4f0296da8 None admin] PATH_INFO: `/v3/domains` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:28.706268 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de58119-06f2-42bd-8181-37c4f0296da8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:28.706582 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de58119-06f2-42bd-8181-37c4f0296da8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:28.708262 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de58119-06f2-42bd-8181-37c4f0296da8 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:28.727637 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 328/654] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 14 17:40:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:28.729107 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de58119-06f2-42bd-8181-37c4f0296da8 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:28.761405 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:28.810472 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7266085-9aff-4d1b-9918-5a7207f57881 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:28.831309 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:28.849027 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de58119-06f2-42bd-8181-37c4f0296da8 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:28.852838 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8daa13-8ee3-411b-90da-5cfa794260cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:28.853811 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8daa13-8ee3-411b-90da-5cfa794260cc None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:28.854280 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8daa13-8ee3-411b-90da-5cfa794260cc None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:28.854734 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8daa13-8ee3-411b-90da-5cfa794260cc None admin] PATH_INFO: `/v3/domains` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:28.855654 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8daa13-8ee3-411b-90da-5cfa794260cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:28.856167 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8daa13-8ee3-411b-90da-5cfa794260cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:28.857770 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8daa13-8ee3-411b-90da-5cfa794260cc None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:28.871407 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 327/655] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 14 17:40:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:28.872582 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8daa13-8ee3-411b-90da-5cfa794260cc None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:28.888901 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beb939d-ed2c-4302-af78-ce3c1ba8cdd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:28.890122 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb939d-ed2c-4302-af78-ce3c1ba8cdd4 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:28.890122 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb939d-ed2c-4302-af78-ce3c1ba8cdd4 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:28.890444 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb939d-ed2c-4302-af78-ce3c1ba8cdd4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:28.901792 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beb939d-ed2c-4302-af78-ce3c1ba8cdd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:28.903423 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beb939d-ed2c-4302-af78-ce3c1ba8cdd4 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:28.927208 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-4beb939d-ed2c-4302-af78-ce3c1ba8cdd4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:28.927208 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:28.927208 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:28.927208 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:28.927208 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:28.927208 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:28.927208 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:28.927208 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:28.927208 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:28.927208 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:28.927208 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:28.927208 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:28.927208 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:40:28.927208 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:40:28.927208 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:40:28.928820 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:40:28.928820 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:28.928820 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:28.928820 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:28.928820 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:28.928820 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:28.928820 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:28.928820 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:28.928820 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:28.928820 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:28.928820 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:28.928820 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:28.928820 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:28.928820 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:28.928820 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:28.928820 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:28.928820 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:28.929947 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:40:28.929947 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:40:28.929947 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:28.929947 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:40:28.932340 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 329/656] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:40:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:28.933384 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beb939d-ed2c-4302-af78-ce3c1ba8cdd4 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:28.999074 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8daa13-8ee3-411b-90da-5cfa794260cc None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:29.033678 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:29.042907 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df55ea15-db52-48f7-b021-874eec24e5b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:29.043708 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df55ea15-db52-48f7-b021-874eec24e5b5 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:29.043989 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df55ea15-db52-48f7-b021-874eec24e5b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:29.044262 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df55ea15-db52-48f7-b021-874eec24e5b5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:29.045997 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beb939d-ed2c-4302-af78-ce3c1ba8cdd4 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:29.052054 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df55ea15-db52-48f7-b021-874eec24e5b5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:29.054134 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df55ea15-db52-48f7-b021-874eec24e5b5 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:29.068397 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-df55ea15-db52-48f7-b021-874eec24e5b5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 17:40:29.068397 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:29.068397 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:29.068397 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:29.068397 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:29.068397 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:29.068397 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:29.068397 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:29.068397 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:29.068397 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:29.068397 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:29.068397 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:29.068397 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 17:40:29.068397 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 17:40:29.068397 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 17:40:29.068397 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 17:40:29.069671 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:29.069671 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:29.069671 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 17:40:29.069671 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:40:29.069671 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 17:40:29.069671 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:40:29.069671 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:29.069671 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:29.069671 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:29.069671 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:29.069671 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:29.069671 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:29.069671 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:29.069671 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:29.069671 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:29.069671 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:29.069671 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:29.069671 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:29.070655 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:29.070655 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:29.070655 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 17:40:29.070655 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 17:40:29.070655 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 17:40:29.070655 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 17:40:29.070655 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 17:40:29.070655 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 17:40:29.070655 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 17:40:29.070655 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:40:29.070655 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 328/657] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 14 17:40:28 2022] GET /identity/v3/users/cinder => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:29.071255 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df55ea15-db52-48f7-b021-874eec24e5b5 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:29.090985 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8921e02-b81d-485c-b60b-46286ece4060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:29.091724 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8921e02-b81d-485c-b60b-46286ece4060 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:29.092004 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8921e02-b81d-485c-b60b-46286ece4060 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:29.092279 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8921e02-b81d-485c-b60b-46286ece4060 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:29.101318 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8921e02-b81d-485c-b60b-46286ece4060 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:29.103019 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8921e02-b81d-485c-b60b-46286ece4060 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:29.105289 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:29.121218 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-d8921e02-b81d-485c-b60b-46286ece4060 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 14 17:40:29.121218 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:29.121218 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:29.121218 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:29.121218 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:29.121218 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:29.121218 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:29.121218 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:29.121218 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:29.121218 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:29.121218 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:29.121218 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:29.121218 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 17:40:29.121218 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 17:40:29.121218 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 17:40:29.121218 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 17:40:29.122294 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:29.122294 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:29.122294 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 17:40:29.122294 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:40:29.122294 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 17:40:29.122294 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:40:29.122294 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:29.122294 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:29.122294 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:29.122294 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:29.122294 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:29.122294 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:29.122294 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:29.122294 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:29.122294 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:29.122294 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:29.122294 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:29.122294 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:29.123253 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:29.123253 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:29.123253 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 17:40:29.123253 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 17:40:29.123253 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 17:40:29.123253 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 17:40:29.123253 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 17:40:29.123253 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 17:40:29.123253 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 14 17:40:29.123253 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:40:29.123253 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 330/658] 10.222.0.67 () {56 vars in 1102 bytes} [Thu Jul 14 17:40:28 2022] GET /identity/v3/users/neutron => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:29.123877 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e2516-a88b-464c-8eec-ec111f90a4ad None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:29.124453 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e2516-a88b-464c-8eec-ec111f90a4ad None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:29.124453 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e2516-a88b-464c-8eec-ec111f90a4ad None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:29.129545 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 331/659] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:40:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:40:29.129545 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6e2516-a88b-464c-8eec-ec111f90a4ad None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:29.183691 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df55ea15-db52-48f7-b021-874eec24e5b5 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:29.218330 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100f4487-fc79-4ec7-8d6b-58512acbe119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:29.218998 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100f4487-fc79-4ec7-8d6b-58512acbe119 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:29.219280 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100f4487-fc79-4ec7-8d6b-58512acbe119 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:29.219551 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100f4487-fc79-4ec7-8d6b-58512acbe119 None admin] PATH_INFO: `/v3/domains` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:29.220274 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100f4487-fc79-4ec7-8d6b-58512acbe119 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:29.220580 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100f4487-fc79-4ec7-8d6b-58512acbe119 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:29.221978 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100f4487-fc79-4ec7-8d6b-58512acbe119 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:29.237982 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 329/660] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 14 17:40:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:29.237982 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100f4487-fc79-4ec7-8d6b-58512acbe119 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:29.245799 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6e2516-a88b-464c-8eec-ec111f90a4ad None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:29.282529 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0ed1ea-e67b-414b-98c6-71fe4d577ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:29.283284 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0ed1ea-e67b-414b-98c6-71fe4d577ad8 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:29.283568 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0ed1ea-e67b-414b-98c6-71fe4d577ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:29.283851 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0ed1ea-e67b-414b-98c6-71fe4d577ad8 None admin] PATH_INFO: `/v3/users` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:29.284664 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0ed1ea-e67b-414b-98c6-71fe4d577ad8 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:29.284972 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0ed1ea-e67b-414b-98c6-71fe4d577ad8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:29.286449 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0ed1ea-e67b-414b-98c6-71fe4d577ad8 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:29.289786 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:29.308757 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 332/661] 10.222.0.67 () {56 vars in 1137 bytes} [Thu Jul 14 17:40:29 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:29.308757 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7bae3d-b8e5-4ab4-b7f8-693577d2670d None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:29.308757 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7bae3d-b8e5-4ab4-b7f8-693577d2670d None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:29.308757 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7bae3d-b8e5-4ab4-b7f8-693577d2670d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:29.324360 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-3d7bae3d-b8e5-4ab4-b7f8-693577d2670d None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:40:29.325593 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-3d7bae3d-b8e5-4ab4-b7f8-693577d2670d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:40:29.349358 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100f4487-fc79-4ec7-8d6b-58512acbe119 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:29.380406 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:29.390313 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9d4fa6-3a83-42d4-9be6-d89268a67228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:29.391022 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d4fa6-3a83-42d4-9be6-d89268a67228 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:29.391302 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d4fa6-3a83-42d4-9be6-d89268a67228 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:29.391747 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d4fa6-3a83-42d4-9be6-d89268a67228 None admin] PATH_INFO: `/v3/users` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:29.393015 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9d4fa6-3a83-42d4-9be6-d89268a67228 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:29.393648 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9d4fa6-3a83-42d4-9be6-d89268a67228 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:29.395321 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9d4fa6-3a83-42d4-9be6-d89268a67228 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:29.405594 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 333/662] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:40:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:40:29.405594 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7bae3d-b8e5-4ab4-b7f8-693577d2670d None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:29.418785 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 330/663] 10.222.0.67 () {56 vars in 1139 bytes} [Thu Jul 14 17:40:29 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:29.420053 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9d4fa6-3a83-42d4-9be6-d89268a67228 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:29.515397 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7bae3d-b8e5-4ab4-b7f8-693577d2670d None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:29.535570 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9d4fa6-3a83-42d4-9be6-d89268a67228 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:29.543746 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:29.552058 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1515183-37d0-4296-a9da-b60aa1ca6915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:29.552864 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1515183-37d0-4296-a9da-b60aa1ca6915 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:29.553175 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1515183-37d0-4296-a9da-b60aa1ca6915 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:29.554211 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1515183-37d0-4296-a9da-b60aa1ca6915 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:29.561883 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1515183-37d0-4296-a9da-b60aa1ca6915 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:29.563847 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1515183-37d0-4296-a9da-b60aa1ca6915 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:29.573918 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bd836b-506f-4ca1-b8d0-8b88930aa2db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:29.574584 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bd836b-506f-4ca1-b8d0-8b88930aa2db None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:29.574915 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bd836b-506f-4ca1-b8d0-8b88930aa2db None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:29.575154 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bd836b-506f-4ca1-b8d0-8b88930aa2db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:29.580970 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-b1515183-37d0-4296-a9da-b60aa1ca6915 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:40:29.580970 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:29.580970 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:29.580970 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:29.580970 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:29.580970 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:29.580970 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:29.580970 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:29.580970 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:29.580970 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:29.580970 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:29.580970 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:29.580970 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 17:40:29.580970 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 17:40:29.580970 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 17:40:29.582242 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 17:40:29.582242 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:29.582242 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:29.582242 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:29.582242 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:29.582242 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:29.582242 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:29.582242 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:29.582242 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:29.582242 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:29.582242 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:29.582242 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:29.582242 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:29.582242 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:29.582242 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:29.582242 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:29.582242 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:29.583169 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 17:40:29.583169 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 17:40:29.583169 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 17:40:29.583169 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 17:40:29.583169 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 17:40:29.583169 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 17:40:29.583169 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:40:29.583169 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:40:29.585708 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 334/664] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 14 17:40:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:29.586806 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1515183-37d0-4296-a9da-b60aa1ca6915 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:29.636701 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:29.653211 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bd836b-506f-4ca1-b8d0-8b88930aa2db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:29.654695 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bd836b-506f-4ca1-b8d0-8b88930aa2db None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:29.696558 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1515183-37d0-4296-a9da-b60aa1ca6915 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:29.733478 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5dd8bf-a1c8-4864-8cce-31bb1704f3dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:29.734232 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5dd8bf-a1c8-4864-8cce-31bb1704f3dc None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:29.734514 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5dd8bf-a1c8-4864-8cce-31bb1704f3dc None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:29.735570 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5dd8bf-a1c8-4864-8cce-31bb1704f3dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:29.770814 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 331/665] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 14 17:40:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 17:40:29.770814 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bd836b-506f-4ca1-b8d0-8b88930aa2db None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:29.778000 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:29.814022 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5dd8bf-a1c8-4864-8cce-31bb1704f3dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:29.815578 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5dd8bf-a1c8-4864-8cce-31bb1704f3dc None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:29.861040 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:29.874664 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bd836b-506f-4ca1-b8d0-8b88930aa2db None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:29.909578 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d1f192-0a54-4afe-82ca-74847de5f192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:29.910364 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d1f192-0a54-4afe-82ca-74847de5f192 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:29.910648 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d1f192-0a54-4afe-82ca-74847de5f192 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:29.910922 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d1f192-0a54-4afe-82ca-74847de5f192 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:29.920095 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 335/666] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 14 17:40:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 17:40:29.920949 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5dd8bf-a1c8-4864-8cce-31bb1704f3dc None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:29.922641 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d1f192-0a54-4afe-82ca-74847de5f192 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:40:29.931644 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-b5d1f192-0a54-4afe-82ca-74847de5f192 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 17:40:29.931644 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:29.931644 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:29.931644 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:29.931644 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:29.931644 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:29.931644 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:29.931644 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:29.931644 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:29.931644 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:29.931644 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:29.931644 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:29.931644 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:40:29.931644 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:40:29.931644 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:40:29.931644 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:40:29.932672 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:40:29.932672 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:40:29.932672 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:40:29.932672 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:40:29.932672 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:29.932672 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:29.932672 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:29.932672 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:29.932672 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:29.932672 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:29.932672 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:29.932672 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:29.932672 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:29.932672 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:29.932672 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:29.932672 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:29.933520 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:29.933520 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:29.933520 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:29.933520 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:29.933520 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:40:29.933520 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:40:29.933520 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:40:29.933520 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:40:29.933520 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:40:29.933520 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:40:29.933520 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 17:40:29.933520 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:40:29.933520 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 332/667] 10.222.0.67 () {56 vars in 1102 bytes} [Thu Jul 14 17:40:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:29.934272 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d1f192-0a54-4afe-82ca-74847de5f192 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:30.005771 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:30.033648 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5dd8bf-a1c8-4864-8cce-31bb1704f3dc None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:30.045639 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d1f192-0a54-4afe-82ca-74847de5f192 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:30.068834 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c0658f-4f40-46b2-99c5-83652fa6daa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:30.070030 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c0658f-4f40-46b2-99c5-83652fa6daa3 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:30.070309 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c0658f-4f40-46b2-99c5-83652fa6daa3 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:30.070580 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c0658f-4f40-46b2-99c5-83652fa6daa3 None admin] PATH_INFO: `/v3/projects` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:30.071358 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c0658f-4f40-46b2-99c5-83652fa6daa3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:30.071664 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c0658f-4f40-46b2-99c5-83652fa6daa3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:30.073086 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c0658f-4f40-46b2-99c5-83652fa6daa3 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:30.082615 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85429131-a5bd-400c-84b0-8c4af6d246e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:30.083502 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85429131-a5bd-400c-84b0-8c4af6d246e3 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:30.083824 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85429131-a5bd-400c-84b0-8c4af6d246e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:30.084098 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85429131-a5bd-400c-84b0-8c4af6d246e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:30.085733 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 336/668] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 14 17:40:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:30.086471 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c0658f-4f40-46b2-99c5-83652fa6daa3 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:30.095542 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:30.101322 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85429131-a5bd-400c-84b0-8c4af6d246e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:30.103110 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85429131-a5bd-400c-84b0-8c4af6d246e3 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:30.128669 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-85429131-a5bd-400c-84b0-8c4af6d246e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:30.128669 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:30.128669 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:30.128669 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:30.128669 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:30.128669 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:30.128669 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:30.128669 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:30.128669 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:30.128669 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:30.128669 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:30.128669 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:30.128669 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:40:30.128669 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:40:30.128669 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:40:30.129654 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:40:30.129654 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:30.129654 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:30.129654 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:30.129654 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:30.129654 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:30.129654 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:30.129654 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:30.129654 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:30.129654 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:30.129654 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:30.129654 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:30.129654 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:30.129654 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:30.129654 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:30.129654 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:30.129654 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:30.130574 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:40:30.130574 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:40:30.130574 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:30.130574 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:40:30.130574 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 333/669] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:40:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:30.130853 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85429131-a5bd-400c-84b0-8c4af6d246e3 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:30.202428 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c0658f-4f40-46b2-99c5-83652fa6daa3 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:30.238734 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85429131-a5bd-400c-84b0-8c4af6d246e3 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:30.238937 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baccd6c-0bff-4ff9-8f82-4d9381dca7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:30.241564 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baccd6c-0bff-4ff9-8f82-4d9381dca7de None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:30.241564 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baccd6c-0bff-4ff9-8f82-4d9381dca7de None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:30.242971 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baccd6c-0bff-4ff9-8f82-4d9381dca7de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:30.253918 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baccd6c-0bff-4ff9-8f82-4d9381dca7de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:30.255642 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baccd6c-0bff-4ff9-8f82-4d9381dca7de None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:30.259144 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:30.277270 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-7baccd6c-0bff-4ff9-8f82-4d9381dca7de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:30.277270 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:30.277270 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:30.277270 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:30.277270 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:30.277270 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:30.277270 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:30.277270 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:30.277270 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:30.277270 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:30.277270 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:30.277270 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:30.277270 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:40:30.277270 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:40:30.277270 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:40:30.278470 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:40:30.278470 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:30.278470 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:30.278470 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:30.278470 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:30.278470 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:30.278470 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:30.278470 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:30.278470 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:30.278470 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:30.278470 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:30.278470 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:30.278470 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:30.278470 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:30.278470 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:30.278470 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:30.278470 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:30.279401 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:40:30.279401 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:40:30.279401 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:30.279401 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:40:30.279401 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 337/670] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:40:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:30.279683 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baccd6c-0bff-4ff9-8f82-4d9381dca7de None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:30.284496 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934ec898-280b-444d-b0fc-cb61df15c38b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:30.285181 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ec898-280b-444d-b0fc-cb61df15c38b None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:30.285464 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ec898-280b-444d-b0fc-cb61df15c38b None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:30.285773 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ec898-280b-444d-b0fc-cb61df15c38b None admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:30.286537 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934ec898-280b-444d-b0fc-cb61df15c38b None admin] RBAC: Adding query filter params (name=service) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:30.286843 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934ec898-280b-444d-b0fc-cb61df15c38b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:30.288751 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934ec898-280b-444d-b0fc-cb61df15c38b None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:30.297557 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 334/671] 10.222.0.67 () {56 vars in 1103 bytes} [Thu Jul 14 17:40:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:30.302501 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934ec898-280b-444d-b0fc-cb61df15c38b None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:30.342730 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:30.394372 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baccd6c-0bff-4ff9-8f82-4d9381dca7de None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:30.408783 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934ec898-280b-444d-b0fc-cb61df15c38b None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:30.434277 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93b7236-a03d-436f-b391-cba25921e3cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:30.434949 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b7236-a03d-436f-b391-cba25921e3cc None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:30.435230 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b7236-a03d-436f-b391-cba25921e3cc None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:30.435502 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b7236-a03d-436f-b391-cba25921e3cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:30.436332 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93b7236-a03d-436f-b391-cba25921e3cc None admin] RBAC: Adding query filter params (role.id=edc349453a61464087c153399e397247, scope.project.id=39a570421bb64fac8b1a0129f1bcc7d9, user.id=4eb7180aab4541b4aab6cf8648eac1f1) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:30.436638 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93b7236-a03d-436f-b391-cba25921e3cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:30.438369 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93b7236-a03d-436f-b391-cba25921e3cc None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:30.453556 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 338/672] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 14 17:40:30 2022] GET /identity/v3/role_assignments?user.id=4eb7180aab4541b4aab6cf8648eac1f1&scope.project.id=39a570421bb64fac8b1a0129f1bcc7d9&role.id=edc349453a61464087c153399e397247 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:30.453556 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93b7236-a03d-436f-b391-cba25921e3cc None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:30.453870 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cd9712-3e49-4cd5-b025-a582436487af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:30.453870 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd9712-3e49-4cd5-b025-a582436487af None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:30.453870 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd9712-3e49-4cd5-b025-a582436487af None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:30.453870 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd9712-3e49-4cd5-b025-a582436487af None admin] PATH_INFO: `/v3/domains` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:30.454197 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cd9712-3e49-4cd5-b025-a582436487af None admin] RBAC: Adding query filter params (name=Default) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:30.454197 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cd9712-3e49-4cd5-b025-a582436487af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:30.454197 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cd9712-3e49-4cd5-b025-a582436487af None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:30.473594 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 335/673] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 14 17:40:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:30.474597 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cd9712-3e49-4cd5-b025-a582436487af None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:30.522460 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:30.579096 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93b7236-a03d-436f-b391-cba25921e3cc None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:30.593324 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cd9712-3e49-4cd5-b025-a582436487af None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:30.605426 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:30.620032 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bdce5f-293e-4644-aeb9-d9138bfbc510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:30.620722 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bdce5f-293e-4644-aeb9-d9138bfbc510 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:30.621009 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bdce5f-293e-4644-aeb9-d9138bfbc510 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:30.621287 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bdce5f-293e-4644-aeb9-d9138bfbc510 None admin] PATH_INFO: `/v3/domains` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:30.622057 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bdce5f-293e-4644-aeb9-d9138bfbc510 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:30.622367 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bdce5f-293e-4644-aeb9-d9138bfbc510 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:30.623834 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bdce5f-293e-4644-aeb9-d9138bfbc510 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:30.635520 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70aaafe-5753-4ea7-acaa-ca7cc9836bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:30.636323 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70aaafe-5753-4ea7-acaa-ca7cc9836bf9 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:30.636602 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70aaafe-5753-4ea7-acaa-ca7cc9836bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:30.636886 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70aaafe-5753-4ea7-acaa-ca7cc9836bf9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:30.643604 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 339/674] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 14 17:40:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:30.643604 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bdce5f-293e-4644-aeb9-d9138bfbc510 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:30.650272 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70aaafe-5753-4ea7-acaa-ca7cc9836bf9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:30.651752 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70aaafe-5753-4ea7-acaa-ca7cc9836bf9 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:30.674842 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-b70aaafe-5753-4ea7-acaa-ca7cc9836bf9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:30.674842 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:30.674842 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:30.674842 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:30.674842 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:30.674842 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:30.674842 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:30.674842 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:30.674842 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:30.674842 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:30.674842 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:30.674842 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:30.674842 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:40:30.674842 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:40:30.674842 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:40:30.675815 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:40:30.675815 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:30.675815 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:30.675815 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:30.675815 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:30.675815 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:30.675815 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:30.675815 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:30.675815 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:30.675815 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:30.675815 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:30.675815 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:30.675815 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:30.675815 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:30.675815 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:30.675815 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:30.675815 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:30.678324 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:40:30.678324 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:40:30.678324 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:30.678324 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:40:30.678324 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 336/675] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:40:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:30.678324 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda8716-1f16-46b6-9f62-77a27e7c3b73 None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:30.678324 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda8716-1f16-46b6-9f62-77a27e7c3b73 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:30.678324 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda8716-1f16-46b6-9f62-77a27e7c3b73 None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:30.680972 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 337/676] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:40:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:40:30.680972 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fda8716-1f16-46b6-9f62-77a27e7c3b73 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:30.763196 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bdce5f-293e-4644-aeb9-d9138bfbc510 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:30.781736 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:30.792454 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fda8716-1f16-46b6-9f62-77a27e7c3b73 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:30.801095 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb602d9c-d1cb-40fb-8608-0b7af0a48566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:30.801918 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb602d9c-d1cb-40fb-8608-0b7af0a48566 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:30.802388 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb602d9c-d1cb-40fb-8608-0b7af0a48566 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:30.802499 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb602d9c-d1cb-40fb-8608-0b7af0a48566 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:30.810372 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb602d9c-d1cb-40fb-8608-0b7af0a48566 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:30.812089 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb602d9c-d1cb-40fb-8608-0b7af0a48566 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:30.827704 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-fb602d9c-d1cb-40fb-8608-0b7af0a48566 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:40:30.827704 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:30.827704 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:30.827704 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:30.827704 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:30.827704 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:30.827704 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:30.827704 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:30.827704 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:30.827704 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:30.827704 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:30.827704 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:30.827704 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 17:40:30.827704 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 17:40:30.827704 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 17:40:30.828652 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 17:40:30.828652 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:30.828652 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:30.828652 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:30.828652 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:30.828652 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:30.828652 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:30.828652 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:30.828652 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:30.828652 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:30.828652 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:30.828652 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:30.828652 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:30.828652 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:30.828652 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:30.828652 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:30.828652 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:30.829611 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 17:40:30.829611 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 17:40:30.829611 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 17:40:30.829611 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 17:40:30.829611 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 17:40:30.829611 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 17:40:30.829611 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:40:30.829611 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:40:30.829611 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 340/677] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 14 17:40:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:30.829611 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb602d9c-d1cb-40fb-8608-0b7af0a48566 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:30.838206 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b116a659-d4b4-4347-a0c2-9a052b3c1d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:30.839016 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b116a659-d4b4-4347-a0c2-9a052b3c1d6f None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:30.839302 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b116a659-d4b4-4347-a0c2-9a052b3c1d6f None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:30.839580 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b116a659-d4b4-4347-a0c2-9a052b3c1d6f None admin] PATH_INFO: `/v3/projects/service` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:30.847332 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b116a659-d4b4-4347-a0c2-9a052b3c1d6f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:30.848829 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b116a659-d4b4-4347-a0c2-9a052b3c1d6f None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:30.863398 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-b116a659-d4b4-4347-a0c2-9a052b3c1d6f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:40:30.863398 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:30.863398 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:30.863398 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:30.863398 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:30.863398 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:30.863398 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:30.863398 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:30.863398 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:30.863398 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:30.863398 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:30.863398 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:30.863398 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 17:40:30.863398 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 17:40:30.863398 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 17:40:30.864558 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 17:40:30.864558 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:30.864558 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:30.864558 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:30.864558 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:30.864558 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:30.864558 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:30.864558 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:30.864558 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:30.864558 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:30.864558 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:30.864558 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:30.864558 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:30.864558 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:30.864558 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:30.864558 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:30.864558 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:30.865498 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 17:40:30.865498 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 17:40:30.865498 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 17:40:30.865498 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 17:40:30.865498 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 17:40:30.865498 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 17:40:30.865498 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:40:30.865498 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:40:30.865498 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 338/678] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 14 17:40:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:30.866571 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9065137d-f22b-4924-b20f-00ebf38b6295 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:30.867022 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9065137d-f22b-4924-b20f-00ebf38b6295 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:30.867022 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9065137d-f22b-4924-b20f-00ebf38b6295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:30.884434 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-9065137d-f22b-4924-b20f-00ebf38b6295 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:40:30.885682 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-9065137d-f22b-4924-b20f-00ebf38b6295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:40:30.887195 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:30.952917 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb602d9c-d1cb-40fb-8608-0b7af0a48566 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:30.964316 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 339/679] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:40:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:40:30.964994 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9065137d-f22b-4924-b20f-00ebf38b6295 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:31.003364 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb64497-ec11-41bd-b0b9-1087335a3d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:31.004344 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb64497-ec11-41bd-b0b9-1087335a3d22 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:31.004810 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb64497-ec11-41bd-b0b9-1087335a3d22 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:31.005264 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb64497-ec11-41bd-b0b9-1087335a3d22 None admin] PATH_INFO: `/v3/domains` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:31.006822 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb64497-ec11-41bd-b0b9-1087335a3d22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:31.007325 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb64497-ec11-41bd-b0b9-1087335a3d22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:31.008943 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb64497-ec11-41bd-b0b9-1087335a3d22 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:31.023937 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 341/680] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 14 17:40:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:31.025446 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb64497-ec11-41bd-b0b9-1087335a3d22 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:31.055839 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:31.077990 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9065137d-f22b-4924-b20f-00ebf38b6295 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:31.124594 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb37433e-34b2-46de-a107-1f142a1a6f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:31.125289 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb37433e-34b2-46de-a107-1f142a1a6f37 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:31.125605 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb37433e-34b2-46de-a107-1f142a1a6f37 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:31.125888 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb37433e-34b2-46de-a107-1f142a1a6f37 None admin] PATH_INFO: `/v3/projects` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:31.126832 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb37433e-34b2-46de-a107-1f142a1a6f37 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:31.127154 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb37433e-34b2-46de-a107-1f142a1a6f37 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:31.128665 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb37433e-34b2-46de-a107-1f142a1a6f37 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:31.142186 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 340/681] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 14 17:40:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:31.143051 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb37433e-34b2-46de-a107-1f142a1a6f37 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:31.160410 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb64497-ec11-41bd-b0b9-1087335a3d22 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:31.162322 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:31.207485 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec957b0-d737-4952-8e4f-7a2be1753660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:31.208168 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec957b0-d737-4952-8e4f-7a2be1753660 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:31.208451 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec957b0-d737-4952-8e4f-7a2be1753660 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:31.208745 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec957b0-d737-4952-8e4f-7a2be1753660 None admin] PATH_INFO: `/v3/projects` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:31.210313 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec957b0-d737-4952-8e4f-7a2be1753660 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:31.210534 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec957b0-d737-4952-8e4f-7a2be1753660 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:31.212003 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec957b0-d737-4952-8e4f-7a2be1753660 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:31.227080 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 342/682] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 14 17:40:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:31.228654 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec957b0-d737-4952-8e4f-7a2be1753660 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:31.254455 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb37433e-34b2-46de-a107-1f142a1a6f37 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:31.294384 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b6a9e5-0eaf-4a47-b6ff-048d9bf8a37a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:31.295458 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b6a9e5-0eaf-4a47-b6ff-048d9bf8a37a None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:31.295738 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b6a9e5-0eaf-4a47-b6ff-048d9bf8a37a None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:31.296132 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b6a9e5-0eaf-4a47-b6ff-048d9bf8a37a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:31.308711 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b6a9e5-0eaf-4a47-b6ff-048d9bf8a37a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:40:31.316722 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-14b6a9e5-0eaf-4a47-b6ff-048d9bf8a37a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 17:40:31.316722 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:31.316722 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:31.316722 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:31.316722 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:31.316722 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:31.316722 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:31.316722 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:31.316722 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:31.316722 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:31.316722 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:31.316722 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:31.316722 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:40:31.316722 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:40:31.316722 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:40:31.316722 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:40:31.317895 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:40:31.317895 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:40:31.317895 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:40:31.317895 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:40:31.317895 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:31.317895 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:31.317895 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:31.317895 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:31.317895 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:31.317895 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:31.317895 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:31.317895 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:31.317895 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:31.317895 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:31.317895 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:31.317895 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:31.319285 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:31.319285 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:31.319285 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:31.319285 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:31.319285 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:40:31.319285 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:40:31.319285 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:40:31.319285 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:40:31.319285 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:40:31.319285 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:40:31.319285 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 17:40:31.319285 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:40:31.319285 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 341/683] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 14 17:40:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:31.320014 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b6a9e5-0eaf-4a47-b6ff-048d9bf8a37a None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:31.325998 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:31.358594 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec957b0-d737-4952-8e4f-7a2be1753660 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:31.395548 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad286587-2b98-4444-aad7-4def8e483c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:31.396344 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad286587-2b98-4444-aad7-4def8e483c23 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:31.396626 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad286587-2b98-4444-aad7-4def8e483c23 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:31.396929 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad286587-2b98-4444-aad7-4def8e483c23 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:31.404805 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad286587-2b98-4444-aad7-4def8e483c23 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:31.406274 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad286587-2b98-4444-aad7-4def8e483c23 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:31.421190 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-ad286587-2b98-4444-aad7-4def8e483c23 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 14 17:40:31.421190 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:31.421190 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:31.421190 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:31.421190 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:31.421190 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:31.421190 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:31.421190 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:31.421190 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:31.421190 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:31.421190 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:31.421190 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:31.421190 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 17:40:31.421190 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 17:40:31.421190 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 17:40:31.421190 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 17:40:31.422250 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:31.422250 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:31.422250 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 17:40:31.422250 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:40:31.422250 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 17:40:31.422250 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:40:31.422250 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:31.422250 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:31.422250 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:31.422250 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:31.422250 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:31.422250 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:31.422250 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:31.422250 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:31.422250 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:31.422250 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:31.422250 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:31.422250 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:31.423234 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:31.423234 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:31.423234 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 17:40:31.423234 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 17:40:31.423234 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 17:40:31.423234 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 17:40:31.423234 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 17:40:31.423234 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 17:40:31.423234 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 14 17:40:31.423234 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:40:31.423234 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 343/684] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 14 17:40:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:31.423234 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad286587-2b98-4444-aad7-4def8e483c23 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:31.442676 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b6a9e5-0eaf-4a47-b6ff-048d9bf8a37a None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:31.461158 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:31.486079 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c98ff7-3992-4704-bce1-ba360b9cf841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:31.486748 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c98ff7-3992-4704-bce1-ba360b9cf841 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:31.487042 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c98ff7-3992-4704-bce1-ba360b9cf841 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:31.487315 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c98ff7-3992-4704-bce1-ba360b9cf841 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:31.488151 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c98ff7-3992-4704-bce1-ba360b9cf841 None admin] RBAC: Adding query filter params (role.id=edc349453a61464087c153399e397247, scope.project.id=39a570421bb64fac8b1a0129f1bcc7d9, user.id=de55cae1600841889668e36402861203) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:31.488464 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c98ff7-3992-4704-bce1-ba360b9cf841 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:31.489930 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c98ff7-3992-4704-bce1-ba360b9cf841 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:31.496613 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 342/685] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 14 17:40:31 2022] GET /identity/v3/role_assignments?user.id=de55cae1600841889668e36402861203&scope.project.id=39a570421bb64fac8b1a0129f1bcc7d9&role.id=edc349453a61464087c153399e397247 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:31.497602 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c98ff7-3992-4704-bce1-ba360b9cf841 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:31.557591 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad286587-2b98-4444-aad7-4def8e483c23 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:31.573411 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:31.607001 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814893a2-deda-4ca8-a280-a679ba152522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:31.608131 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814893a2-deda-4ca8-a280-a679ba152522 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:31.608511 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814893a2-deda-4ca8-a280-a679ba152522 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:31.608887 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814893a2-deda-4ca8-a280-a679ba152522 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:31.610141 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814893a2-deda-4ca8-a280-a679ba152522 None admin] RBAC: Adding query filter params (role.id=edc349453a61464087c153399e397247, scope.project.id=39a570421bb64fac8b1a0129f1bcc7d9, user.id=7bda83c5499f43f9838fda2679a522d4) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:31.610989 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814893a2-deda-4ca8-a280-a679ba152522 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:31.613013 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814893a2-deda-4ca8-a280-a679ba152522 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:31.617491 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c98ff7-3992-4704-bce1-ba360b9cf841 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:31.629345 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 344/686] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 14 17:40:31 2022] GET /identity/v3/role_assignments?user.id=7bda83c5499f43f9838fda2679a522d4&scope.project.id=39a570421bb64fac8b1a0129f1bcc7d9&role.id=edc349453a61464087c153399e397247 => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:31.632845 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814893a2-deda-4ca8-a280-a679ba152522 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:31.670412 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d66d149-df1c-41bc-bf5c-b63c6dfd9b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:31.671229 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d66d149-df1c-41bc-bf5c-b63c6dfd9b9b None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:31.671519 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d66d149-df1c-41bc-bf5c-b63c6dfd9b9b None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:31.671799 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d66d149-df1c-41bc-bf5c-b63c6dfd9b9b None admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:31.672606 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d66d149-df1c-41bc-bf5c-b63c6dfd9b9b None admin] RBAC: Adding query filter params (name=admin) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:31.672918 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d66d149-df1c-41bc-bf5c-b63c6dfd9b9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:31.676860 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d66d149-df1c-41bc-bf5c-b63c6dfd9b9b None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:31.692057 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 343/687] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 14 17:40:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:31.693560 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d66d149-df1c-41bc-bf5c-b63c6dfd9b9b None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:31.751497 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:31.768540 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814893a2-deda-4ca8-a280-a679ba152522 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:31.817581 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6c4a53-cf1f-4700-9abd-7a167d68382c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:31.818316 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c4a53-cf1f-4700-9abd-7a167d68382c None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:31.818600 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c4a53-cf1f-4700-9abd-7a167d68382c None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:31.819106 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c4a53-cf1f-4700-9abd-7a167d68382c None admin] PATH_INFO: `/v3/users` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:31.819973 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6c4a53-cf1f-4700-9abd-7a167d68382c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:31.820283 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6c4a53-cf1f-4700-9abd-7a167d68382c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:31.822441 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6c4a53-cf1f-4700-9abd-7a167d68382c None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:31.823598 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d66d149-df1c-41bc-bf5c-b63c6dfd9b9b None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:31.846147 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 345/688] 10.222.0.67 () {56 vars in 1135 bytes} [Thu Jul 14 17:40:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:31.852763 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6c4a53-cf1f-4700-9abd-7a167d68382c None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:31.861852 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:31.870996 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f2f4bf-28a1-4acb-86ce-9938fabcf31d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:31.871829 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f2f4bf-28a1-4acb-86ce-9938fabcf31d None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:31.872139 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f2f4bf-28a1-4acb-86ce-9938fabcf31d None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:31.872450 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f2f4bf-28a1-4acb-86ce-9938fabcf31d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:31.883824 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f2f4bf-28a1-4acb-86ce-9938fabcf31d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:31.885332 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f2f4bf-28a1-4acb-86ce-9938fabcf31d None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:31.907385 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-67f2f4bf-28a1-4acb-86ce-9938fabcf31d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:31.907385 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:31.907385 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:31.907385 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:31.907385 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:31.907385 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:31.907385 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:31.907385 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:31.907385 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:31.907385 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:31.907385 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:31.907385 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:31.907385 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:40:31.907385 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:40:31.907385 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:40:31.908349 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:40:31.908349 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:31.908349 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:31.908349 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:31.908349 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:31.908349 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:31.908349 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:31.908349 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:31.908349 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:31.908349 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:31.908349 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:31.908349 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:31.908349 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:31.908349 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:31.908349 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:31.908349 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:31.908349 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:31.909260 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:40:31.909260 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:40:31.909260 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:31.909260 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:40:31.909260 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 344/689] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:40:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 17:40:31.918455 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f2f4bf-28a1-4acb-86ce-9938fabcf31d None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:31.977173 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6c4a53-cf1f-4700-9abd-7a167d68382c None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:32.015873 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0277b04f-636a-41f6-a809-5c5e4804be63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:32.016601 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0277b04f-636a-41f6-a809-5c5e4804be63 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:32.016885 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0277b04f-636a-41f6-a809-5c5e4804be63 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:32.017211 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0277b04f-636a-41f6-a809-5c5e4804be63 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:32.049914 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:32.132308 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0277b04f-636a-41f6-a809-5c5e4804be63 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:32.133839 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0277b04f-636a-41f6-a809-5c5e4804be63 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:32.151928 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f2f4bf-28a1-4acb-86ce-9938fabcf31d None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:32.215710 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e926b60-a2ac-42f5-9752-5ebdd6ab5b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:32.216401 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e926b60-a2ac-42f5-9752-5ebdd6ab5b25 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:32.216682 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e926b60-a2ac-42f5-9752-5ebdd6ab5b25 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:32.216953 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e926b60-a2ac-42f5-9752-5ebdd6ab5b25 None admin] PATH_INFO: `/v3/domains` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:32.217734 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e926b60-a2ac-42f5-9752-5ebdd6ab5b25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:32.218038 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e926b60-a2ac-42f5-9752-5ebdd6ab5b25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:32.219452 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e926b60-a2ac-42f5-9752-5ebdd6ab5b25 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:32.245609 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 345/690] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 14 17:40:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:32.252325 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e926b60-a2ac-42f5-9752-5ebdd6ab5b25 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:32.324138 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 346/691] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 14 17:40:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 17:40:32.327978 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:32.330228 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0277b04f-636a-41f6-a809-5c5e4804be63 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:32.387438 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:32.457949 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e926b60-a2ac-42f5-9752-5ebdd6ab5b25 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:32.492663 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0277b04f-636a-41f6-a809-5c5e4804be63 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:32.508574 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4862ad30-bd5d-43d2-9621-f8c86020866a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:32.509391 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4862ad30-bd5d-43d2-9621-f8c86020866a None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:32.509697 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4862ad30-bd5d-43d2-9621-f8c86020866a None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:32.509973 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4862ad30-bd5d-43d2-9621-f8c86020866a None admin] PATH_INFO: `/v3/users/nova` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:32.522077 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4862ad30-bd5d-43d2-9621-f8c86020866a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:32.524028 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4862ad30-bd5d-43d2-9621-f8c86020866a None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:32.556533 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578f52c4-4147-4643-a2c9-7a13cc675052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:32.557337 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578f52c4-4147-4643-a2c9-7a13cc675052 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:32.557641 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578f52c4-4147-4643-a2c9-7a13cc675052 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:32.557918 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578f52c4-4147-4643-a2c9-7a13cc675052 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:32.559616 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-4862ad30-bd5d-43d2-9621-f8c86020866a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 17:40:32.559616 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:32.559616 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:32.559616 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:32.559616 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:32.559616 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:32.559616 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:32.559616 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:32.559616 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:32.559616 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:32.559616 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:32.559616 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:32.559616 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 17:40:32.559616 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 17:40:32.559616 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 17:40:32.559616 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 17:40:32.560698 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:32.560698 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:32.560698 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 17:40:32.560698 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:40:32.560698 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 17:40:32.560698 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:40:32.560698 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:32.560698 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:32.560698 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:32.560698 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:32.560698 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:32.560698 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:32.560698 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:32.560698 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:32.560698 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:32.560698 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:32.560698 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:32.560698 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:32.561675 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:32.561675 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:32.561675 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 17:40:32.561675 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 17:40:32.561675 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 17:40:32.561675 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 17:40:32.561675 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 17:40:32.561675 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 17:40:32.561675 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 17:40:32.561675 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:40:32.567668 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 346/692] 10.222.0.67 () {56 vars in 1093 bytes} [Thu Jul 14 17:40:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:32.573306 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4862ad30-bd5d-43d2-9621-f8c86020866a None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:32.588421 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578f52c4-4147-4643-a2c9-7a13cc675052 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:32.589924 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578f52c4-4147-4643-a2c9-7a13cc675052 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:32.627679 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-578f52c4-4147-4643-a2c9-7a13cc675052 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:32.627679 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:32.627679 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:32.627679 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:32.627679 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:32.627679 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:32.627679 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:32.627679 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:32.627679 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:32.627679 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:32.627679 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:32.627679 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:32.627679 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:40:32.627679 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:40:32.627679 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:40:32.628653 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:40:32.628653 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:32.628653 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:32.628653 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:32.628653 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:32.628653 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:32.628653 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:32.628653 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:32.628653 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:32.628653 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:32.628653 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:32.628653 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:32.628653 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:32.628653 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:32.628653 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:32.628653 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:32.628653 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:32.629581 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:40:32.629581 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:40:32.629581 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:32.629581 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:40:32.631918 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 347/693] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:40:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 17:40:32.637062 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a541e0-ae22-43c0-b210-3bd1889aab16 None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:32.637330 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a541e0-ae22-43c0-b210-3bd1889aab16 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:32.637692 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a541e0-ae22-43c0-b210-3bd1889aab16 None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:32.639407 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 348/694] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:40:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:40:32.640357 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a541e0-ae22-43c0-b210-3bd1889aab16 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:32.695065 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:32.698136 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4862ad30-bd5d-43d2-9621-f8c86020866a None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:32.734653 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f998a8b-57d0-47dd-9653-840be2b56e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:32.735424 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f998a8b-57d0-47dd-9653-840be2b56e47 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:32.735708 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f998a8b-57d0-47dd-9653-840be2b56e47 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:32.735982 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f998a8b-57d0-47dd-9653-840be2b56e47 None admin] PATH_INFO: `/v3/users` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:32.736831 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f998a8b-57d0-47dd-9653-840be2b56e47 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:32.737135 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f998a8b-57d0-47dd-9653-840be2b56e47 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:32.738657 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f998a8b-57d0-47dd-9653-840be2b56e47 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:32.762091 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 347/695] 10.222.0.67 () {56 vars in 1133 bytes} [Thu Jul 14 17:40:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:40:32.763468 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81dd98c-0766-40af-ae6c-ed1df4e16331 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:32.763762 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81dd98c-0766-40af-ae6c-ed1df4e16331 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:32.764042 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81dd98c-0766-40af-ae6c-ed1df4e16331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:32.768443 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:32.778916 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a541e0-ae22-43c0-b210-3bd1889aab16 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:32.781887 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-b81dd98c-0766-40af-ae6c-ed1df4e16331 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:40:32.783092 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-b81dd98c-0766-40af-ae6c-ed1df4e16331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:40:32.826152 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8199a7-23b6-4563-b32f-225865482724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:32.827696 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8199a7-23b6-4563-b32f-225865482724 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:32.828213 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8199a7-23b6-4563-b32f-225865482724 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:32.829109 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8199a7-23b6-4563-b32f-225865482724 None admin] PATH_INFO: `/v3/domains` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:32.831951 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8199a7-23b6-4563-b32f-225865482724 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:32.832695 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8199a7-23b6-4563-b32f-225865482724 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:32.835167 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8199a7-23b6-4563-b32f-225865482724 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:32.856802 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 349/696] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 14 17:40:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:32.857710 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8199a7-23b6-4563-b32f-225865482724 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:32.860882 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 348/697] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:40:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:40:32.861916 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81dd98c-0766-40af-ae6c-ed1df4e16331 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:32.958418 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:32.965912 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8199a7-23b6-4563-b32f-225865482724 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:32.972869 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81dd98c-0766-40af-ae6c-ed1df4e16331 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:33.001748 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16148b9-38c1-4d1a-9bb3-f6c10cb0db49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:33.002478 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16148b9-38c1-4d1a-9bb3-f6c10cb0db49 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:33.002769 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16148b9-38c1-4d1a-9bb3-f6c10cb0db49 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:33.003046 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16148b9-38c1-4d1a-9bb3-f6c10cb0db49 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:33.012500 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946f36bd-eadd-4422-84c4-5ff5b59289dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:33.013545 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f36bd-eadd-4422-84c4-5ff5b59289dd None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:33.013839 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f36bd-eadd-4422-84c4-5ff5b59289dd None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:33.014111 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f36bd-eadd-4422-84c4-5ff5b59289dd None admin] PATH_INFO: `/v3/projects/service` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:33.022467 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946f36bd-eadd-4422-84c4-5ff5b59289dd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:33.024029 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946f36bd-eadd-4422-84c4-5ff5b59289dd None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:33.031535 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:33.041577 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-946f36bd-eadd-4422-84c4-5ff5b59289dd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:40:33.041577 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:33.041577 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:33.041577 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:33.041577 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:33.041577 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:33.041577 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:33.041577 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:33.041577 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:33.041577 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:33.041577 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:33.041577 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:33.041577 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 17:40:33.041577 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 17:40:33.041577 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 17:40:33.042720 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 17:40:33.042720 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:33.042720 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:33.042720 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:33.042720 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:33.042720 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:33.042720 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:33.042720 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:33.042720 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:33.042720 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:33.042720 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:33.042720 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:33.042720 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:33.042720 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:33.042720 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:33.042720 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:33.042720 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:33.043832 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 17:40:33.043832 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 17:40:33.043832 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 17:40:33.043832 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 17:40:33.043832 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 17:40:33.043832 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 17:40:33.043832 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:40:33.043832 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:40:33.046229 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 349/698] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 14 17:40:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:33.047148 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946f36bd-eadd-4422-84c4-5ff5b59289dd None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:33.086975 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16148b9-38c1-4d1a-9bb3-f6c10cb0db49 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:33.088439 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16148b9-38c1-4d1a-9bb3-f6c10cb0db49 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:33.165082 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946f36bd-eadd-4422-84c4-5ff5b59289dd None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:33.198023 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 350/699] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 14 17:40:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 17:40:33.198959 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16148b9-38c1-4d1a-9bb3-f6c10cb0db49 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:33.202877 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4bacd2-e60c-49b3-b0d5-5dc1d5c81acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:33.204029 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4bacd2-e60c-49b3-b0d5-5dc1d5c81acb None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:33.204460 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4bacd2-e60c-49b3-b0d5-5dc1d5c81acb None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:33.204881 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4bacd2-e60c-49b3-b0d5-5dc1d5c81acb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:33.218442 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4bacd2-e60c-49b3-b0d5-5dc1d5c81acb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:33.220454 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4bacd2-e60c-49b3-b0d5-5dc1d5c81acb None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:33.231017 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:33.243817 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-4a4bacd2-e60c-49b3-b0d5-5dc1d5c81acb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:33.243817 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:33.243817 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:33.243817 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:33.243817 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:33.243817 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:33.243817 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:33.243817 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:33.243817 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:33.243817 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:33.243817 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:33.243817 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:33.243817 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:40:33.243817 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:40:33.243817 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:40:33.244991 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:40:33.244991 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:33.244991 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:33.244991 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:33.244991 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:33.244991 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:33.244991 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:33.244991 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:33.244991 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:33.244991 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:33.244991 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:33.244991 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:33.244991 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:33.244991 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:33.244991 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:33.244991 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:33.244991 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:33.246042 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:40:33.246042 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:40:33.246042 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:33.246042 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:40:33.248099 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 350/700] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:40:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:33.249057 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4bacd2-e60c-49b3-b0d5-5dc1d5c81acb None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:33.263931 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:33.315982 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16148b9-38c1-4d1a-9bb3-f6c10cb0db49 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:33.352202 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6774952a-a85e-4df7-9cd1-ee30ecc642f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:33.352931 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6774952a-a85e-4df7-9cd1-ee30ecc642f8 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:33.353224 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6774952a-a85e-4df7-9cd1-ee30ecc642f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:33.353504 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6774952a-a85e-4df7-9cd1-ee30ecc642f8 None admin] PATH_INFO: `/v3/projects` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:33.354352 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6774952a-a85e-4df7-9cd1-ee30ecc642f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:33.354666 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6774952a-a85e-4df7-9cd1-ee30ecc642f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:33.356383 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6774952a-a85e-4df7-9cd1-ee30ecc642f8 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:33.365862 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4bacd2-e60c-49b3-b0d5-5dc1d5c81acb None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:33.374003 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 351/701] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 14 17:40:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:33.375118 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6774952a-a85e-4df7-9cd1-ee30ecc642f8 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:33.416648 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d25231-685a-4b4a-932e-c9bd5b26b93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:33.417471 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d25231-685a-4b4a-932e-c9bd5b26b93e None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:33.417797 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d25231-685a-4b4a-932e-c9bd5b26b93e None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:33.418072 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d25231-685a-4b4a-932e-c9bd5b26b93e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:33.432788 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d25231-685a-4b4a-932e-c9bd5b26b93e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:33.434880 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d25231-685a-4b4a-932e-c9bd5b26b93e None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:33.461850 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-48d25231-685a-4b4a-932e-c9bd5b26b93e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:33.461850 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:33.461850 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:33.461850 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:33.461850 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:33.461850 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:33.461850 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:33.461850 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:33.461850 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:33.461850 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:33.461850 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:33.461850 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:33.461850 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:40:33.461850 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:40:33.461850 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:40:33.463330 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:40:33.463330 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:33.463330 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:33.463330 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:33.463330 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:33.463330 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:33.463330 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:33.463330 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:33.463330 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:33.463330 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:33.463330 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:33.463330 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:33.463330 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:33.463330 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:33.463330 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:33.463330 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:33.463330 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:33.464685 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:40:33.464685 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:40:33.464685 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:33.464685 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:40:33.470374 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 351/702] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:40:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:33.471222 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d25231-685a-4b4a-932e-c9bd5b26b93e None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:33.512835 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6774952a-a85e-4df7-9cd1-ee30ecc642f8 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:33.530135 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:33.531625 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:33.550607 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e99106-fe0f-4468-98d5-5136758135e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:33.551419 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e99106-fe0f-4468-98d5-5136758135e2 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:33.551857 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e99106-fe0f-4468-98d5-5136758135e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:33.552241 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e99106-fe0f-4468-98d5-5136758135e2 None admin] PATH_INFO: `/v3/domains` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:33.553062 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e99106-fe0f-4468-98d5-5136758135e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:33.554327 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e99106-fe0f-4468-98d5-5136758135e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:33.555739 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e99106-fe0f-4468-98d5-5136758135e2 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:33.569657 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 352/703] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 14 17:40:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:33.570640 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e99106-fe0f-4468-98d5-5136758135e2 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:33.591644 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d25231-685a-4b4a-932e-c9bd5b26b93e None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:33.630575 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c08922e-4eda-46f5-88ef-d67bcf19d4bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:33.631522 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c08922e-4eda-46f5-88ef-d67bcf19d4bc None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:33.632052 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c08922e-4eda-46f5-88ef-d67bcf19d4bc None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:33.632472 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c08922e-4eda-46f5-88ef-d67bcf19d4bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:33.633636 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c08922e-4eda-46f5-88ef-d67bcf19d4bc None admin] RBAC: Adding query filter params (role.id=edc349453a61464087c153399e397247, scope.project.id=39a570421bb64fac8b1a0129f1bcc7d9, user.id=c65607a396474192a43c374d306ef5ba) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:33.634098 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c08922e-4eda-46f5-88ef-d67bcf19d4bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:33.635808 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c08922e-4eda-46f5-88ef-d67bcf19d4bc None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:33.648344 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 352/704] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 14 17:40:33 2022] GET /identity/v3/role_assignments?user.id=c65607a396474192a43c374d306ef5ba&scope.project.id=39a570421bb64fac8b1a0129f1bcc7d9&role.id=edc349453a61464087c153399e397247 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:33.649559 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c08922e-4eda-46f5-88ef-d67bcf19d4bc None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:33.677237 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e99106-fe0f-4468-98d5-5136758135e2 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:33.725693 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd23ce8-3a55-48e6-8593-d635809f6025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:33.729758 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd23ce8-3a55-48e6-8593-d635809f6025 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:33.730083 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd23ce8-3a55-48e6-8593-d635809f6025 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:33.730363 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd23ce8-3a55-48e6-8593-d635809f6025 None admin] PATH_INFO: `/v3/domains` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:33.731181 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd23ce8-3a55-48e6-8593-d635809f6025 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:33.731489 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd23ce8-3a55-48e6-8593-d635809f6025 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:33.733049 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd23ce8-3a55-48e6-8593-d635809f6025 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:33.748483 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 353/705] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 14 17:40:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:33.758734 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd23ce8-3a55-48e6-8593-d635809f6025 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:33.823481 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c08922e-4eda-46f5-88ef-d67bcf19d4bc None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:33.835222 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:33.844532 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:33.871350 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeb7a48-402d-4a76-9892-2d9552d6134e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:33.872454 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeb7a48-402d-4a76-9892-2d9552d6134e None admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:33.873791 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeb7a48-402d-4a76-9892-2d9552d6134e None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:33.874285 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeb7a48-402d-4a76-9892-2d9552d6134e None admin] PATH_INFO: `/v3/users` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:33.875318 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeb7a48-402d-4a76-9892-2d9552d6134e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:33.877187 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeb7a48-402d-4a76-9892-2d9552d6134e None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:33.920034 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 353/706] 10.222.0.67 () {60 vars in 1132 bytes} [Thu Jul 14 17:40:33 2022] POST /identity/v3/users => generated 254 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:40:33.954464 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd23ce8-3a55-48e6-8593-d635809f6025 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:33.981457 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beba7a74-179e-4a2b-b276-21804737f676 None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:33.982160 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beba7a74-179e-4a2b-b276-21804737f676 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:33.982644 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beba7a74-179e-4a2b-b276-21804737f676 None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:33.987913 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 354/707] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:40:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:40:33.991893 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa0574c-7393-4bd9-8395-1ea31b4364b8 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:33.992266 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa0574c-7393-4bd9-8395-1ea31b4364b8 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:33.992619 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa0574c-7393-4bd9-8395-1ea31b4364b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:34.003746 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1ae37a-e9d6-402f-8b75-7cb53b0539cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:34.005226 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ae37a-e9d6-402f-8b75-7cb53b0539cb None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:34.005766 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ae37a-e9d6-402f-8b75-7cb53b0539cb None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:34.006218 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ae37a-e9d6-402f-8b75-7cb53b0539cb None admin] PATH_INFO: `/v3/projects/service` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:34.013852 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-7fa0574c-7393-4bd9-8395-1ea31b4364b8 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:40:34.015155 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-7fa0574c-7393-4bd9-8395-1ea31b4364b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:40:34.016153 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1ae37a-e9d6-402f-8b75-7cb53b0539cb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:34.017990 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1ae37a-e9d6-402f-8b75-7cb53b0539cb None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:34.035031 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-5d1ae37a-e9d6-402f-8b75-7cb53b0539cb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:40:34.035031 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:34.035031 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:34.035031 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:34.035031 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:34.035031 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:34.035031 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:34.035031 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:34.035031 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:34.035031 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:34.035031 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:34.035031 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:34.035031 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 17:40:34.035031 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 17:40:34.035031 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 17:40:34.036027 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 17:40:34.036027 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:34.036027 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:34.036027 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:34.036027 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:34.036027 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:34.036027 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:34.036027 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:34.036027 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:34.036027 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:34.036027 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:34.036027 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:34.036027 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:34.036027 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:34.036027 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:34.036027 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:34.036027 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:34.036956 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 17:40:34.036956 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 17:40:34.036956 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 17:40:34.036956 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 17:40:34.036956 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 17:40:34.036956 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 17:40:34.036956 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:40:34.036956 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:40:34.040469 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 354/708] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 14 17:40:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:34.049261 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1ae37a-e9d6-402f-8b75-7cb53b0539cb None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:34.118526 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 355/709] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:40:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 17:40:34.120085 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e7bc1a-2e41-4654-82fd-90c4d9dc2b42 None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:34.120641 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e7bc1a-2e41-4654-82fd-90c4d9dc2b42 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:34.120994 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e7bc1a-2e41-4654-82fd-90c4d9dc2b42 None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:34.124217 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 356/710] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:40:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:40:34.129674 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd9d4e-b964-45d7-a523-b3ae37b90e26 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:34.129963 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd9d4e-b964-45d7-a523-b3ae37b90e26 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:34.130242 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd9d4e-b964-45d7-a523-b3ae37b90e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:34.151759 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-15cd9d4e-b964-45d7-a523-b3ae37b90e26 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:40:34.152969 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-15cd9d4e-b964-45d7-a523-b3ae37b90e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:40:34.172287 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:34.180945 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1ae37a-e9d6-402f-8b75-7cb53b0539cb None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:34.217827 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54d1191-3135-4d56-95c9-73f7df58dfb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:34.218528 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d1191-3135-4d56-95c9-73f7df58dfb4 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:34.218812 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d1191-3135-4d56-95c9-73f7df58dfb4 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:34.219087 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d1191-3135-4d56-95c9-73f7df58dfb4 None admin] PATH_INFO: `/v3/projects` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:34.219873 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54d1191-3135-4d56-95c9-73f7df58dfb4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:34.220180 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54d1191-3135-4d56-95c9-73f7df58dfb4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:34.222420 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54d1191-3135-4d56-95c9-73f7df58dfb4 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:34.237149 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 355/711] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 14 17:40:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:40:34.237954 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54d1191-3135-4d56-95c9-73f7df58dfb4 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:34.241462 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 357/712] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:40:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 17:40:34.246708 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cd9d4e-b964-45d7-a523-b3ae37b90e26 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:34.288369 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:34.357176 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54d1191-3135-4d56-95c9-73f7df58dfb4 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:34.388791 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cd9d4e-b964-45d7-a523-b3ae37b90e26 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:34.400876 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0285e14c-66e9-4946-aed2-c3a9b8e8223b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:34.401757 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0285e14c-66e9-4946-aed2-c3a9b8e8223b None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:34.402042 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0285e14c-66e9-4946-aed2-c3a9b8e8223b None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:34.402319 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0285e14c-66e9-4946-aed2-c3a9b8e8223b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:34.402981 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0285e14c-66e9-4946-aed2-c3a9b8e8223b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:34.404351 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0285e14c-66e9-4946-aed2-c3a9b8e8223b None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:34.419764 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-0285e14c-66e9-4946-aed2-c3a9b8e8223b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 17:40:34.419764 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:34.419764 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 17:40:34.419764 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 17:40:34.419764 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 17:40:34.419764 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 17:40:34.419764 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 17:40:34.419764 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 17:40:34.419764 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 17:40:34.419764 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:40:34.419764 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 17:40:34.419764 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:40:34.419764 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:34.419764 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:34.419764 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:34.419764 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:34.420829 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:34.420829 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:34.420829 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:34.420829 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:34.420829 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:34.420829 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:34.420829 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:34.420829 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 17:40:34.420829 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 17:40:34.420829 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 17:40:34.420829 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 17:40:34.420829 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:34.420829 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:34.420829 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:34.420829 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:34.420829 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:34.421723 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:34.421723 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:34.421723 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:34.421723 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:34.421723 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:34.421723 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:34.421723 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:34.421723 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:34.421723 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:34.421723 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:34.421723 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:34.421723 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 17:40:34.421723 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 17:40:34.421723 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 17:40:34.421723 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:40:34.421723 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 356/713] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Jul 14 17:40:34 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:34.422615 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0285e14c-66e9-4946-aed2-c3a9b8e8223b None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:34.439357 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fdef42-c41d-4826-a32e-4e70ed35ab16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:34.440340 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fdef42-c41d-4826-a32e-4e70ed35ab16 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:34.440624 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fdef42-c41d-4826-a32e-4e70ed35ab16 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:34.440899 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fdef42-c41d-4826-a32e-4e70ed35ab16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:34.442186 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fdef42-c41d-4826-a32e-4e70ed35ab16 None admin] RBAC: Adding query filter params (role.id=4651a1cc7b4d4ab7a7a9ca1e77e58e71, scope.project.id=39a570421bb64fac8b1a0129f1bcc7d9, user.id=41b893bdf4ec474dbfa819c22fc29ce9) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:34.443150 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fdef42-c41d-4826-a32e-4e70ed35ab16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:34.445108 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fdef42-c41d-4826-a32e-4e70ed35ab16 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:34.450546 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:34.461905 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 358/714] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 14 17:40:34 2022] GET /identity/v3/role_assignments?user.id=41b893bdf4ec474dbfa819c22fc29ce9&scope.project.id=39a570421bb64fac8b1a0129f1bcc7d9&role.id=4651a1cc7b4d4ab7a7a9ca1e77e58e71 => generated 259 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:34.462937 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fdef42-c41d-4826-a32e-4e70ed35ab16 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:34.609028 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0285e14c-66e9-4946-aed2-c3a9b8e8223b None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:34.651726 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf231b6-879f-4e27-9514-fb6f6356e1ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:34.651726 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf231b6-879f-4e27-9514-fb6f6356e1ce None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:34.651726 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf231b6-879f-4e27-9514-fb6f6356e1ce None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:34.651726 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf231b6-879f-4e27-9514-fb6f6356e1ce None admin] PATH_INFO: `/v3/services/network` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:34.654370 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf231b6-879f-4e27-9514-fb6f6356e1ce None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:34.654370 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf231b6-879f-4e27-9514-fb6f6356e1ce None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:34.670488 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-adf231b6-879f-4e27-9514-fb6f6356e1ce None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 17:40:34.670488 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:34.670488 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 17:40:34.670488 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 17:40:34.670488 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 17:40:34.670488 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 17:40:34.670488 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 17:40:34.670488 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 17:40:34.670488 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 17:40:34.670488 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:40:34.670488 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 17:40:34.670488 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:40:34.670488 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:34.670488 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:34.670488 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:34.670488 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:34.670488 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:34.671578 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:34.671578 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:34.671578 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:34.671578 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:34.671578 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:34.671578 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:34.671578 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 17:40:34.671578 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 17:40:34.671578 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 17:40:34.671578 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 17:40:34.671578 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:34.671578 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:34.671578 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:34.671578 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:34.671578 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:34.671578 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:34.673676 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:34.673676 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:34.673676 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:34.673676 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:34.673676 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:34.673676 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:34.673676 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:34.673676 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:34.673676 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:34.673676 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:34.673676 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 17:40:34.673676 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 17:40:34.673676 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 17:40:34.673676 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:40:34.673676 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 357/715] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 14 17:40:34 2022] GET /identity/v3/services/network => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:34.679494 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf231b6-879f-4e27-9514-fb6f6356e1ce None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:34.694970 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:34.702585 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fdef42-c41d-4826-a32e-4e70ed35ab16 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:34.775514 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9a03a5-0039-43bb-b537-e8f211da0453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:34.776562 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9a03a5-0039-43bb-b537-e8f211da0453 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:34.777048 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9a03a5-0039-43bb-b537-e8f211da0453 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:34.777509 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9a03a5-0039-43bb-b537-e8f211da0453 None admin] PATH_INFO: `/v3/services` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:34.778441 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9a03a5-0039-43bb-b537-e8f211da0453 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:34.778929 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9a03a5-0039-43bb-b537-e8f211da0453 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:34.780530 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9a03a5-0039-43bb-b537-e8f211da0453 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:34.791266 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 359/716] 10.222.0.67 () {56 vars in 1124 bytes} [Thu Jul 14 17:40:34 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:34.797522 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9a03a5-0039-43bb-b537-e8f211da0453 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:34.867415 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:34.902885 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf231b6-879f-4e27-9514-fb6f6356e1ce None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:34.970559 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b360b6-e87a-436c-a1be-481efae8bce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:34.971229 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b360b6-e87a-436c-a1be-481efae8bce9 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:34.971508 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b360b6-e87a-436c-a1be-481efae8bce9 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:34.971801 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b360b6-e87a-436c-a1be-481efae8bce9 None admin] PATH_INFO: `/v3/services` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:34.972621 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b360b6-e87a-436c-a1be-481efae8bce9 None admin] RBAC: Adding query filter params (name=network) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:34.972929 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b360b6-e87a-436c-a1be-481efae8bce9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:34.974323 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b360b6-e87a-436c-a1be-481efae8bce9 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:34.982270 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 358/717] 10.222.0.67 () {56 vars in 1112 bytes} [Thu Jul 14 17:40:34 2022] GET /identity/v3/services?name=network => generated 124 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:34.985751 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9a03a5-0039-43bb-b537-e8f211da0453 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:34.989004 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b360b6-e87a-436c-a1be-481efae8bce9 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:35.055616 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d77f455-6bf9-46d4-b1c0-dd017e53f7e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:35.056295 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d77f455-6bf9-46d4-b1c0-dd017e53f7e8 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:35.056582 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d77f455-6bf9-46d4-b1c0-dd017e53f7e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:35.056860 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d77f455-6bf9-46d4-b1c0-dd017e53f7e8 None admin] PATH_INFO: `/v3/services` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:35.057721 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d77f455-6bf9-46d4-b1c0-dd017e53f7e8 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:35.058167 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d77f455-6bf9-46d4-b1c0-dd017e53f7e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:35.059545 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d77f455-6bf9-46d4-b1c0-dd017e53f7e8 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:35.075562 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 360/718] 10.222.0.67 () {56 vars in 1124 bytes} [Thu Jul 14 17:40:34 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:35.100075 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b360b6-e87a-436c-a1be-481efae8bce9 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:35.156598 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348a1839-1931-4468-a718-e99ed7a0a6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:35.157735 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348a1839-1931-4468-a718-e99ed7a0a6bb None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:35.158271 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348a1839-1931-4468-a718-e99ed7a0a6bb None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:35.158812 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348a1839-1931-4468-a718-e99ed7a0a6bb None admin] PATH_INFO: `/v3/services` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:35.159772 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348a1839-1931-4468-a718-e99ed7a0a6bb None admin] RBAC: Adding query filter params (type=network) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:35.160336 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348a1839-1931-4468-a718-e99ed7a0a6bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:35.162077 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348a1839-1931-4468-a718-e99ed7a0a6bb None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:35.169782 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 359/719] 10.222.0.67 () {56 vars in 1112 bytes} [Thu Jul 14 17:40:34 2022] GET /identity/v3/services?type=network => generated 124 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:40:36.294012 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b05f3eb-e0ff-4c23-947a-d386f618fd18 None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:36.295044 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b05f3eb-e0ff-4c23-947a-d386f618fd18 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:36.295533 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b05f3eb-e0ff-4c23-947a-d386f618fd18 None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:36.297372 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 361/720] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:40:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:40:36.303058 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269fd979-660a-4d1b-b2ce-7b52d0312d2e None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:36.303581 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269fd979-660a-4d1b-b2ce-7b52d0312d2e None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:36.303678 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269fd979-660a-4d1b-b2ce-7b52d0312d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:36.326525 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-269fd979-660a-4d1b-b2ce-7b52d0312d2e None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:40:36.327733 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-269fd979-660a-4d1b-b2ce-7b52d0312d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:40:36.335979 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:36.415360 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 360/721] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:40:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:40:36.457712 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b05f3eb-e0ff-4c23-947a-d386f618fd18 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:36.503450 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:36.547122 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b525b085-54c6-4322-b099-755ea28f7923 None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:36.547456 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b525b085-54c6-4322-b099-755ea28f7923 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:36.547794 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b525b085-54c6-4322-b099-755ea28f7923 None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:36.549727 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 361/722] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:40:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:40:36.578166 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a1a3d-8e82-44cb-92ee-b937665b9b29 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:36.582151 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a1a3d-8e82-44cb-92ee-b937665b9b29 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:36.582439 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a1a3d-8e82-44cb-92ee-b937665b9b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:36.602991 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b05f3eb-e0ff-4c23-947a-d386f618fd18 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:36.616769 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-d95a1a3d-8e82-44cb-92ee-b937665b9b29 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:40:36.618259 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-d95a1a3d-8e82-44cb-92ee-b937665b9b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:40:36.679894 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c2ded0-ea26-4c79-9fc7-1b108f1d6b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:36.680732 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c2ded0-ea26-4c79-9fc7-1b108f1d6b51 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:36.681012 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c2ded0-ea26-4c79-9fc7-1b108f1d6b51 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:36.681280 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c2ded0-ea26-4c79-9fc7-1b108f1d6b51 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:36.704958 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c2ded0-ea26-4c79-9fc7-1b108f1d6b51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:40:36.715576 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-73c2ded0-ea26-4c79-9fc7-1b108f1d6b51 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 17:40:36.715576 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:36.715576 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:36.715576 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:36.715576 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:36.715576 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:36.715576 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:36.715576 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:36.715576 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:36.715576 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:36.715576 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:36.715576 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:36.715576 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:40:36.715576 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:40:36.715576 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:40:36.715576 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:40:36.716554 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:40:36.716554 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:40:36.716554 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:40:36.716554 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:40:36.716554 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:36.716554 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:36.716554 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:36.716554 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:36.716554 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:36.716554 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:36.716554 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:36.716554 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:36.716554 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:36.716554 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:36.716554 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:36.716554 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:36.718076 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:36.718076 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:36.718076 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:36.718076 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:36.718076 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:40:36.718076 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:40:36.718076 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:40:36.718076 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:40:36.718076 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:40:36.718076 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:40:36.718076 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 17:40:36.718076 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:40:36.718076 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 362/723] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 14 17:40:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:36.725009 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c2ded0-ea26-4c79-9fc7-1b108f1d6b51 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:36.752202 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 362/724] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:40:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:40:36.817458 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95a1a3d-8e82-44cb-92ee-b937665b9b29 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:36.868556 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:36.896491 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c2ded0-ea26-4c79-9fc7-1b108f1d6b51 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:36.905713 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:36.937097 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95a1a3d-8e82-44cb-92ee-b937665b9b29 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:36.976167 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbfbf79-f1d1-49b4-bb0b-7ff8b1a3ee42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:36.977017 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbfbf79-f1d1-49b4-bb0b-7ff8b1a3ee42 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:36.977305 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbfbf79-f1d1-49b4-bb0b-7ff8b1a3ee42 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:36.977606 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbfbf79-f1d1-49b4-bb0b-7ff8b1a3ee42 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:36.978749 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a80bb67-e775-497b-ae95-4cbbaf47d652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:36.979420 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a80bb67-e775-497b-ae95-4cbbaf47d652 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:36.979697 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a80bb67-e775-497b-ae95-4cbbaf47d652 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:36.979969 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a80bb67-e775-497b-ae95-4cbbaf47d652 None admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:36.980726 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a80bb67-e775-497b-ae95-4cbbaf47d652 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:36.981030 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a80bb67-e775-497b-ae95-4cbbaf47d652 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:36.986836 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a80bb67-e775-497b-ae95-4cbbaf47d652 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:36.998633 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbfbf79-f1d1-49b4-bb0b-7ff8b1a3ee42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:40:37.007707 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 363/725] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 14 17:40:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:37.014374 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-2bbfbf79-f1d1-49b4-bb0b-7ff8b1a3ee42 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 17:40:37.014374 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:37.014374 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:37.014374 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:37.014374 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:37.014374 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:37.014374 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:37.014374 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:37.014374 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:37.014374 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:37.014374 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:37.014374 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:37.014374 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:40:37.014374 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:40:37.014374 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:40:37.014374 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:40:37.015321 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:40:37.015321 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:40:37.015321 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:40:37.015321 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:40:37.015321 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:37.015321 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:37.015321 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:37.015321 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:37.015321 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:37.015321 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:37.015321 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:37.015321 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:37.015321 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:37.015321 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:37.015321 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:37.015321 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:37.016783 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:37.016783 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:37.016783 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:37.016783 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:37.016783 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:40:37.016783 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:40:37.016783 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:40:37.016783 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:40:37.016783 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:40:37.016783 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:40:37.016783 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 17:40:37.016783 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:40:37.016783 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 363/726] 10.222.0.67 () {56 vars in 1102 bytes} [Thu Jul 14 17:40:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 17:40:37.022911 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a80bb67-e775-497b-ae95-4cbbaf47d652 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:37.033516 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbfbf79-f1d1-49b4-bb0b-7ff8b1a3ee42 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:37.165844 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbfbf79-f1d1-49b4-bb0b-7ff8b1a3ee42 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:37.169126 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a80bb67-e775-497b-ae95-4cbbaf47d652 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:37.199255 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:37.205004 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fefc509-e541-45bc-b00f-90f39beaa16f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:37.205704 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fefc509-e541-45bc-b00f-90f39beaa16f None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:37.206362 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fefc509-e541-45bc-b00f-90f39beaa16f None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:37.206950 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fefc509-e541-45bc-b00f-90f39beaa16f None admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:37.208029 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fefc509-e541-45bc-b00f-90f39beaa16f None admin] RBAC: Adding query filter params (name=service) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:37.208408 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fefc509-e541-45bc-b00f-90f39beaa16f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:37.210492 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fefc509-e541-45bc-b00f-90f39beaa16f None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:37.210912 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbfd9c6-5b2d-4c35-afa4-5baf06f758ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:37.211922 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbfd9c6-5b2d-4c35-afa4-5baf06f758ec None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:37.212446 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbfd9c6-5b2d-4c35-afa4-5baf06f758ec None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:37.212988 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbfd9c6-5b2d-4c35-afa4-5baf06f758ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:37.221573 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 364/727] 10.222.0.67 () {56 vars in 1103 bytes} [Thu Jul 14 17:40:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:37.221573 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe3b36a-8174-4686-8977-871475b78d2b None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:37.221573 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe3b36a-8174-4686-8977-871475b78d2b None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:37.221573 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe3b36a-8174-4686-8977-871475b78d2b None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:37.222876 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 365/728] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:40:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:40:37.227808 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe3b36a-8174-4686-8977-871475b78d2b None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:37.230154 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbfd9c6-5b2d-4c35-afa4-5baf06f758ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:37.231952 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbfd9c6-5b2d-4c35-afa4-5baf06f758ec None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:37.238897 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:37.252265 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-cfbfd9c6-5b2d-4c35-afa4-5baf06f758ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:37.252265 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:37.252265 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:37.252265 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:37.252265 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:37.252265 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:37.252265 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:37.252265 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:37.252265 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:37.252265 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:37.252265 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:37.252265 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:37.252265 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:40:37.252265 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:40:37.252265 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:40:37.253348 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:40:37.253348 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:37.253348 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:37.253348 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:37.253348 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:37.253348 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:37.253348 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:37.253348 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:37.253348 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:37.253348 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:37.253348 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:37.253348 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:37.253348 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:37.253348 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:37.253348 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:37.253348 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:37.253348 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:37.254287 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:40:37.254287 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:40:37.254287 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:37.254287 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:40:37.259578 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 364/729] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:40:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:37.261077 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25af6bfb-3e33-453f-a3f0-b8f8732d3935 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:37.261429 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25af6bfb-3e33-453f-a3f0-b8f8732d3935 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:37.261797 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25af6bfb-3e33-453f-a3f0-b8f8732d3935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:37.280375 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-25af6bfb-3e33-453f-a3f0-b8f8732d3935 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:40:37.281813 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-25af6bfb-3e33-453f-a3f0-b8f8732d3935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:40:37.344608 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe3b36a-8174-4686-8977-871475b78d2b None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:37.361845 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 365/730] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:40:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:40:37.363330 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25af6bfb-3e33-453f-a3f0-b8f8732d3935 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:37.385290 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50665475-644d-4bc5-a1a6-1d8e7caf0479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:37.386509 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50665475-644d-4bc5-a1a6-1d8e7caf0479 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:37.386939 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50665475-644d-4bc5-a1a6-1d8e7caf0479 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:37.387361 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50665475-644d-4bc5-a1a6-1d8e7caf0479 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:37.399526 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50665475-644d-4bc5-a1a6-1d8e7caf0479 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:37.401340 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50665475-644d-4bc5-a1a6-1d8e7caf0479 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:37.425831 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-50665475-644d-4bc5-a1a6-1d8e7caf0479 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:37.425831 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:37.425831 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:37.425831 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:37.425831 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:37.425831 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:37.425831 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:37.425831 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:37.425831 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:37.425831 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:37.425831 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:37.425831 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:37.425831 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:40:37.425831 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:40:37.425831 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:40:37.426956 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:40:37.426956 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:37.426956 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:37.426956 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:37.426956 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:37.426956 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:37.426956 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:37.426956 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:37.426956 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:37.426956 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:37.426956 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:37.426956 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:37.426956 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:37.426956 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:37.426956 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:37.426956 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:37.426956 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:37.428068 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:40:37.428068 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:40:37.428068 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:37.428068 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:40:37.431016 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 366/731] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:40:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:37.432156 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50665475-644d-4bc5-a1a6-1d8e7caf0479 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:37.494345 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25af6bfb-3e33-453f-a3f0-b8f8732d3935 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:37.505151 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:37.525351 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:37.535408 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6884e3de-a0d4-4816-8207-aa1cc2e4989b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:37.536014 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6884e3de-a0d4-4816-8207-aa1cc2e4989b None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:37.536391 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6884e3de-a0d4-4816-8207-aa1cc2e4989b None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:37.536761 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6884e3de-a0d4-4816-8207-aa1cc2e4989b None admin] PATH_INFO: `/v3/domains` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:37.537630 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6884e3de-a0d4-4816-8207-aa1cc2e4989b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:37.538704 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6884e3de-a0d4-4816-8207-aa1cc2e4989b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:37.540308 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6884e3de-a0d4-4816-8207-aa1cc2e4989b None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:37.553305 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 366/732] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 14 17:40:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:37.554388 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6884e3de-a0d4-4816-8207-aa1cc2e4989b None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:37.580551 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50665475-644d-4bc5-a1a6-1d8e7caf0479 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:37.633309 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd94a7bc-a664-4227-b304-bbce04f6ea1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:37.634150 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94a7bc-a664-4227-b304-bbce04f6ea1f None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:37.634434 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94a7bc-a664-4227-b304-bbce04f6ea1f None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:37.634711 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94a7bc-a664-4227-b304-bbce04f6ea1f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:37.646894 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd94a7bc-a664-4227-b304-bbce04f6ea1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:40:37.655162 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-cd94a7bc-a664-4227-b304-bbce04f6ea1f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 17:40:37.655162 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:37.655162 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:37.655162 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:37.655162 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:37.655162 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:37.655162 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:37.655162 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:37.655162 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:37.655162 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:37.655162 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:37.655162 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:37.655162 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:40:37.655162 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:40:37.655162 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:40:37.655162 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:40:37.656152 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:40:37.656152 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:40:37.656152 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:40:37.656152 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:40:37.656152 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:37.656152 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:37.656152 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:37.656152 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:37.656152 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:37.656152 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:37.656152 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:37.656152 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:37.656152 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:37.656152 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:37.656152 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:37.656152 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:37.657010 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:37.657010 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:37.657010 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:37.657010 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:37.657010 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:40:37.657010 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:40:37.657010 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:40:37.657010 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:40:37.657010 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:40:37.657010 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:40:37.657010 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 17:40:37.657010 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:40:37.657010 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 367/733] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 14 17:40:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:37.657794 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd94a7bc-a664-4227-b304-bbce04f6ea1f None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:37.668818 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6884e3de-a0d4-4816-8207-aa1cc2e4989b None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:37.703925 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d86090-c802-4be5-b7df-303d89f18c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:37.704506 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d86090-c802-4be5-b7df-303d89f18c2c None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:37.704789 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d86090-c802-4be5-b7df-303d89f18c2c None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:37.705073 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d86090-c802-4be5-b7df-303d89f18c2c None admin] PATH_INFO: `/v3/domains` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:37.705860 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d86090-c802-4be5-b7df-303d89f18c2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:37.706169 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d86090-c802-4be5-b7df-303d89f18c2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:37.707540 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d86090-c802-4be5-b7df-303d89f18c2c None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:37.720017 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 367/734] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 14 17:40:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:37.721059 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de9cc9-f2a2-4b02-8128-75c3c4573beb None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:37.721344 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de9cc9-f2a2-4b02-8128-75c3c4573beb None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:37.721651 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de9cc9-f2a2-4b02-8128-75c3c4573beb None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:37.725903 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 368/735] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:40:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:40:37.725903 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9de9cc9-f2a2-4b02-8128-75c3c4573beb None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:37.765700 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd94a7bc-a664-4227-b304-bbce04f6ea1f None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:37.773297 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:37.776157 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:37.800155 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e0964a-aef8-4178-9e90-f838108d0b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:37.801062 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e0964a-aef8-4178-9e90-f838108d0b8c None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:37.801345 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e0964a-aef8-4178-9e90-f838108d0b8c None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:37.801650 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e0964a-aef8-4178-9e90-f838108d0b8c None admin] PATH_INFO: `/v3/users/swift` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:37.808643 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e0964a-aef8-4178-9e90-f838108d0b8c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:37.810125 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e0964a-aef8-4178-9e90-f838108d0b8c None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:37.825403 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-94e0964a-aef8-4178-9e90-f838108d0b8c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 14 17:40:37.825403 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:37.825403 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:37.825403 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:37.825403 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:37.825403 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:37.825403 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:37.825403 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:37.825403 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:37.825403 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:37.825403 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:37.825403 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:37.825403 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 17:40:37.825403 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 17:40:37.825403 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 17:40:37.825403 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 17:40:37.826651 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:37.826651 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:37.826651 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 17:40:37.826651 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:40:37.826651 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 17:40:37.826651 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:40:37.826651 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:37.826651 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:37.826651 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:37.826651 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:37.826651 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:37.826651 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:37.826651 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:37.826651 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:37.826651 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:37.826651 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:37.826651 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:37.826651 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:37.827645 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:37.827645 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:37.827645 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 17:40:37.827645 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 17:40:37.827645 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 17:40:37.827645 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 17:40:37.827645 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 17:40:37.827645 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 17:40:37.827645 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 14 17:40:37.827645 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:40:37.827645 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 368/736] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 14 17:40:37 2022] GET /identity/v3/users/swift => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:37.828244 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38712898-9be8-432a-9e48-93364fb38f41 None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:37.828244 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38712898-9be8-432a-9e48-93364fb38f41 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:37.828366 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38712898-9be8-432a-9e48-93364fb38f41 None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:37.829687 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 369/737] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:40:37 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:40:37.830172 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38712898-9be8-432a-9e48-93364fb38f41 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:37.831012 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9de9cc9-f2a2-4b02-8128-75c3c4573beb None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:37.868614 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd48f91-e7dd-4b1c-8e3f-a479fe7e8043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:37.869281 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd48f91-e7dd-4b1c-8e3f-a479fe7e8043 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:37.869590 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd48f91-e7dd-4b1c-8e3f-a479fe7e8043 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:37.869864 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd48f91-e7dd-4b1c-8e3f-a479fe7e8043 None admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:37.870607 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd48f91-e7dd-4b1c-8e3f-a479fe7e8043 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:37.870909 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd48f91-e7dd-4b1c-8e3f-a479fe7e8043 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:37.872268 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd48f91-e7dd-4b1c-8e3f-a479fe7e8043 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:37.880245 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 369/738] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 14 17:40:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:37.881415 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931c6b2b-8296-4d02-ae26-836176d9ed61 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:37.881755 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931c6b2b-8296-4d02-ae26-836176d9ed61 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:37.882032 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931c6b2b-8296-4d02-ae26-836176d9ed61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:37.897676 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-931c6b2b-8296-4d02-ae26-836176d9ed61 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:40:37.898842 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-931c6b2b-8296-4d02-ae26-836176d9ed61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:40:37.931470 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38712898-9be8-432a-9e48-93364fb38f41 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:37.963244 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 370/739] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:40:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:40:37.963996 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931c6b2b-8296-4d02-ae26-836176d9ed61 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:37.978299 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adb85bf-4b82-4d29-8e3f-d8e430ba33f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:37.979173 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adb85bf-4b82-4d29-8e3f-d8e430ba33f1 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:37.979449 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adb85bf-4b82-4d29-8e3f-d8e430ba33f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:37.979718 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adb85bf-4b82-4d29-8e3f-d8e430ba33f1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:37.987554 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adb85bf-4b82-4d29-8e3f-d8e430ba33f1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:37.988978 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adb85bf-4b82-4d29-8e3f-d8e430ba33f1 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:38.004989 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-3adb85bf-4b82-4d29-8e3f-d8e430ba33f1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 17:40:38.004989 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:38.004989 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:38.004989 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:38.004989 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:38.004989 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:38.004989 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:38.004989 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:38.004989 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:38.004989 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:38.004989 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:38.004989 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:38.004989 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 17:40:38.004989 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 17:40:38.004989 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 17:40:38.004989 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 17:40:38.006021 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:38.006021 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:38.006021 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 17:40:38.006021 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:40:38.006021 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 17:40:38.006021 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:40:38.006021 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:38.006021 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:38.006021 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:38.006021 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:38.006021 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:38.006021 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:38.006021 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:38.006021 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:38.006021 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:38.006021 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:38.006021 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:38.006021 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:38.007586 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:38.007586 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:38.007586 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 17:40:38.007586 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 17:40:38.007586 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 17:40:38.007586 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 17:40:38.007586 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 17:40:38.007586 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 17:40:38.007586 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 17:40:38.007586 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:40:38.008261 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:38.008347 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 370/740] 10.222.0.67 () {56 vars in 1117 bytes} [Thu Jul 14 17:40:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:38.008347 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06351be6-aca6-4d14-843d-9678fe929b56 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:38.008347 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06351be6-aca6-4d14-843d-9678fe929b56 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:38.008347 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06351be6-aca6-4d14-843d-9678fe929b56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:38.024737 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-06351be6-aca6-4d14-843d-9678fe929b56 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:40:38.025975 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-06351be6-aca6-4d14-843d-9678fe929b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:40:38.046631 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:38.065981 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931c6b2b-8296-4d02-ae26-836176d9ed61 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:38.094783 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 371/741] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:40:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 17:40:38.094783 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06351be6-aca6-4d14-843d-9678fe929b56 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:38.118295 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e6135c-5132-4a9a-ad27-4bb2341c2a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:38.118987 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e6135c-5132-4a9a-ad27-4bb2341c2a81 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:38.119269 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e6135c-5132-4a9a-ad27-4bb2341c2a81 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:38.119554 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e6135c-5132-4a9a-ad27-4bb2341c2a81 None admin] PATH_INFO: `/v3/users` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:38.120389 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e6135c-5132-4a9a-ad27-4bb2341c2a81 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:38.120692 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e6135c-5132-4a9a-ad27-4bb2341c2a81 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:38.122193 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e6135c-5132-4a9a-ad27-4bb2341c2a81 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:38.140899 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 371/742] 10.222.0.67 () {56 vars in 1135 bytes} [Thu Jul 14 17:40:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:38.141780 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e6135c-5132-4a9a-ad27-4bb2341c2a81 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:38.201847 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06351be6-aca6-4d14-843d-9678fe929b56 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:38.236427 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e7db9f-ae70-4e7a-9260-d3659922d51e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:38.237120 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e7db9f-ae70-4e7a-9260-d3659922d51e None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:38.237403 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e7db9f-ae70-4e7a-9260-d3659922d51e None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:38.237711 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e7db9f-ae70-4e7a-9260-d3659922d51e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:38.243537 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:38.247525 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e6135c-5132-4a9a-ad27-4bb2341c2a81 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:38.248187 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e7db9f-ae70-4e7a-9260-d3659922d51e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:38.249677 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e7db9f-ae70-4e7a-9260-d3659922d51e None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:38.268559 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-09e7db9f-ae70-4e7a-9260-d3659922d51e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:38.268559 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:38.268559 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:38.268559 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:38.268559 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:38.268559 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:38.268559 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:38.268559 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:38.268559 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:38.268559 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:38.268559 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:38.268559 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:38.268559 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:40:38.268559 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:40:38.268559 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:40:38.269742 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:40:38.269742 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:38.269742 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:38.269742 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:38.269742 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:38.269742 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:38.269742 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:38.269742 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:38.269742 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:38.269742 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:38.269742 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:38.269742 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:38.269742 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:38.269742 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:38.269742 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:38.269742 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:38.269742 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:38.270849 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:40:38.270849 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:40:38.270849 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:38.270849 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:40:38.270849 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 372/743] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:40:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:38.271175 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e7db9f-ae70-4e7a-9260-d3659922d51e None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:38.282620 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:38.286103 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408fe09b-0c36-40ba-aa69-145fff80c8e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:38.286776 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408fe09b-0c36-40ba-aa69-145fff80c8e2 None admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:38.287055 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408fe09b-0c36-40ba-aa69-145fff80c8e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:38.287326 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408fe09b-0c36-40ba-aa69-145fff80c8e2 None admin] PATH_INFO: `/v3/services` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:38.288683 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408fe09b-0c36-40ba-aa69-145fff80c8e2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:38.290067 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408fe09b-0c36-40ba-aa69-145fff80c8e2 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:38.304614 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 372/744] 10.222.0.67 () {60 vars in 1141 bytes} [Thu Jul 14 17:40:38 2022] POST /identity/v3/services => generated 240 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:40:38.305405 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408fe09b-0c36-40ba-aa69-145fff80c8e2 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:38.393331 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e7db9f-ae70-4e7a-9260-d3659922d51e None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:38.434404 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408fe09b-0c36-40ba-aa69-145fff80c8e2 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:38.439902 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52b0ffc-c56c-4225-ab68-ce3cdfdb452b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:38.440596 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52b0ffc-c56c-4225-ab68-ce3cdfdb452b None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:38.440881 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52b0ffc-c56c-4225-ab68-ce3cdfdb452b None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:38.441159 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52b0ffc-c56c-4225-ab68-ce3cdfdb452b None admin] PATH_INFO: `/v3/users` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:38.442043 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52b0ffc-c56c-4225-ab68-ce3cdfdb452b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:38.442359 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52b0ffc-c56c-4225-ab68-ce3cdfdb452b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:38.443856 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52b0ffc-c56c-4225-ab68-ce3cdfdb452b None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:38.469115 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 373/745] 10.222.0.67 () {56 vars in 1149 bytes} [Thu Jul 14 17:40:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:38.469115 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52b0ffc-c56c-4225-ab68-ce3cdfdb452b None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:38.483423 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8dac10-cfda-45de-9dc3-242e36760ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:38.484164 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8dac10-cfda-45de-9dc3-242e36760ac1 None admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:38.484711 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8dac10-cfda-45de-9dc3-242e36760ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:38.484711 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8dac10-cfda-45de-9dc3-242e36760ac1 None admin] PATH_INFO: `/v3/services` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:38.485648 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8dac10-cfda-45de-9dc3-242e36760ac1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:38.487149 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8dac10-cfda-45de-9dc3-242e36760ac1 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:38.502366 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 373/746] 10.222.0.67 () {60 vars in 1141 bytes} [Thu Jul 14 17:40:38 2022] POST /identity/v3/services => generated 251 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:40:38.503133 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8dac10-cfda-45de-9dc3-242e36760ac1 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:38.522141 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:38.543457 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:38.598882 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52b0ffc-c56c-4225-ab68-ce3cdfdb452b None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:38.658936 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8dac10-cfda-45de-9dc3-242e36760ac1 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:38.699334 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919f08f3-9f07-417d-9502-2ff6d1aac1f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:38.700291 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f08f3-9f07-417d-9502-2ff6d1aac1f7 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:38.700720 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f08f3-9f07-417d-9502-2ff6d1aac1f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:38.701163 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f08f3-9f07-417d-9502-2ff6d1aac1f7 None admin] PATH_INFO: `/v3/domains` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:38.702257 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919f08f3-9f07-417d-9502-2ff6d1aac1f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:38.702729 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919f08f3-9f07-417d-9502-2ff6d1aac1f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:38.704354 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919f08f3-9f07-417d-9502-2ff6d1aac1f7 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:38.718788 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 374/747] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 14 17:40:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:38.720002 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919f08f3-9f07-417d-9502-2ff6d1aac1f7 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:38.767307 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f97c092-d7b1-4d4c-9335-70aa67073a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:38.767902 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f97c092-d7b1-4d4c-9335-70aa67073a5c None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:38.768188 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f97c092-d7b1-4d4c-9335-70aa67073a5c None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:38.768471 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f97c092-d7b1-4d4c-9335-70aa67073a5c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:38.801853 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:38.839028 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919f08f3-9f07-417d-9502-2ff6d1aac1f7 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:38.856772 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f97c092-d7b1-4d4c-9335-70aa67073a5c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:38.859476 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f97c092-d7b1-4d4c-9335-70aa67073a5c None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:38.885871 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e0ab40-17ec-4f1d-ac87-000f6ad01b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:38.886865 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e0ab40-17ec-4f1d-ac87-000f6ad01b8d None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:38.887360 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e0ab40-17ec-4f1d-ac87-000f6ad01b8d None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:38.887811 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e0ab40-17ec-4f1d-ac87-000f6ad01b8d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:38.947801 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:38.977422 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e0ab40-17ec-4f1d-ac87-000f6ad01b8d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:38.979075 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e0ab40-17ec-4f1d-ac87-000f6ad01b8d None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:38.997747 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 374/748] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 14 17:40:38 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 17:40:38.998672 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f97c092-d7b1-4d4c-9335-70aa67073a5c None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:39.063449 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:39.106788 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 375/749] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 14 17:40:38 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 17:40:39.107654 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e0ab40-17ec-4f1d-ac87-000f6ad01b8d None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:39.121059 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f97c092-d7b1-4d4c-9335-70aa67073a5c None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:39.166907 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0931c954-98aa-4594-9275-9e977288285f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:39.168218 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0931c954-98aa-4594-9275-9e977288285f None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:39.169114 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0931c954-98aa-4594-9275-9e977288285f None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:39.169687 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0931c954-98aa-4594-9275-9e977288285f None admin] PATH_INFO: `/v3/users/nova` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:39.180692 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0931c954-98aa-4594-9275-9e977288285f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:39.182698 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0931c954-98aa-4594-9275-9e977288285f None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:39.202652 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-0931c954-98aa-4594-9275-9e977288285f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 17:40:39.202652 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:39.202652 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:39.202652 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:39.202652 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:39.202652 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:39.202652 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:39.202652 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:39.202652 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:39.202652 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:39.202652 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:39.202652 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:39.202652 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 17:40:39.202652 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 17:40:39.202652 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 17:40:39.202652 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 17:40:39.203694 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:39.203694 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:39.203694 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 17:40:39.203694 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:40:39.203694 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 17:40:39.203694 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:40:39.203694 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:39.203694 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:39.203694 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:39.203694 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:39.203694 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:39.203694 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:39.203694 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:39.203694 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:39.203694 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:39.203694 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:39.203694 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:39.203694 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:39.204676 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:39.204676 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:39.204676 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 17:40:39.204676 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 17:40:39.204676 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 17:40:39.204676 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 17:40:39.204676 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 17:40:39.204676 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 17:40:39.204676 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 17:40:39.204676 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:40:39.208760 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 375/750] 10.222.0.67 () {56 vars in 1093 bytes} [Thu Jul 14 17:40:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:39.209725 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0931c954-98aa-4594-9275-9e977288285f None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:39.220469 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e0ab40-17ec-4f1d-ac87-000f6ad01b8d None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:39.239816 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:39.257744 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafd0e7f-d618-460f-871b-46426f8fa75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:39.258577 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd0e7f-d618-460f-871b-46426f8fa75f None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:39.258841 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd0e7f-d618-460f-871b-46426f8fa75f None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:39.259118 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd0e7f-d618-460f-871b-46426f8fa75f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:39.270121 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafd0e7f-d618-460f-871b-46426f8fa75f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:39.271581 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafd0e7f-d618-460f-871b-46426f8fa75f None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:39.290312 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-cafd0e7f-d618-460f-871b-46426f8fa75f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:39.290312 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:39.290312 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:39.290312 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:39.290312 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:39.290312 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:39.290312 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:39.290312 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:39.290312 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:39.290312 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:39.290312 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:39.290312 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:39.290312 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:40:39.290312 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:40:39.290312 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:40:39.291301 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:40:39.291301 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:39.291301 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:39.291301 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:39.291301 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:39.291301 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:39.291301 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:39.291301 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:39.291301 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:39.291301 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:39.291301 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:39.291301 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:39.291301 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:39.291301 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:39.291301 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:39.291301 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:39.291301 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:39.292234 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:40:39.292234 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:40:39.292234 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:39.292234 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:40:39.292234 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 376/751] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:40:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:39.292950 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafd0e7f-d618-460f-871b-46426f8fa75f None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:39.318277 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:39.321210 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0931c954-98aa-4594-9275-9e977288285f None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:39.357829 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0f8393-8376-4449-8dd5-c95d4de78ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:39.358642 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0f8393-8376-4449-8dd5-c95d4de78ce3 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:39.358930 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0f8393-8376-4449-8dd5-c95d4de78ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:39.359209 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0f8393-8376-4449-8dd5-c95d4de78ce3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:39.376203 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0f8393-8376-4449-8dd5-c95d4de78ce3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:39.378027 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0f8393-8376-4449-8dd5-c95d4de78ce3 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:39.401765 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafd0e7f-d618-460f-871b-46426f8fa75f None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:39.401960 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-3f0f8393-8376-4449-8dd5-c95d4de78ce3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:39.401960 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:39.401960 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:39.401960 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:39.401960 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:39.401960 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:39.401960 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:39.401960 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:39.401960 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:39.401960 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:39.401960 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:39.401960 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:39.401960 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:40:39.401960 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:40:39.401960 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:40:39.403139 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:40:39.403139 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:39.403139 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:39.403139 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:39.403139 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:39.403139 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:39.403139 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:39.403139 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:39.403139 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:39.403139 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:39.403139 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:39.403139 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:39.403139 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:39.403139 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:39.403139 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:39.403139 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:39.403139 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:39.404055 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:40:39.404055 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:40:39.404055 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:39.404055 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:40:39.407884 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 376/752] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:40:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:39.409794 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0f8393-8376-4449-8dd5-c95d4de78ce3 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:39.443510 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f976ad-aaf7-4d47-83b2-d5a35872416b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:39.444907 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f976ad-aaf7-4d47-83b2-d5a35872416b None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:39.445394 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f976ad-aaf7-4d47-83b2-d5a35872416b None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:39.445931 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f976ad-aaf7-4d47-83b2-d5a35872416b None admin] PATH_INFO: `/v3/users` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:39.447060 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f976ad-aaf7-4d47-83b2-d5a35872416b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:39.447573 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f976ad-aaf7-4d47-83b2-d5a35872416b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:39.449224 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f976ad-aaf7-4d47-83b2-d5a35872416b None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:39.475028 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 377/753] 10.222.0.67 () {56 vars in 1133 bytes} [Thu Jul 14 17:40:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:39.476851 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f976ad-aaf7-4d47-83b2-d5a35872416b None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:39.514731 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:39.549785 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0f8393-8376-4449-8dd5-c95d4de78ce3 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:39.574104 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:39.593739 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a867f2-cc25-4b91-b1fc-6cea85818196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:39.595327 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a867f2-cc25-4b91-b1fc-6cea85818196 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:39.595793 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a867f2-cc25-4b91-b1fc-6cea85818196 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:39.596228 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a867f2-cc25-4b91-b1fc-6cea85818196 None admin] PATH_INFO: `/v3/domains` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:39.596914 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f976ad-aaf7-4d47-83b2-d5a35872416b None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:39.597318 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a867f2-cc25-4b91-b1fc-6cea85818196 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:39.597798 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a867f2-cc25-4b91-b1fc-6cea85818196 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:39.601158 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a867f2-cc25-4b91-b1fc-6cea85818196 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:39.621623 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 377/754] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 14 17:40:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:39.622836 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a867f2-cc25-4b91-b1fc-6cea85818196 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:39.641709 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62d9d62-1c9c-49f3-892f-a6d4ce53fc4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:39.642381 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62d9d62-1c9c-49f3-892f-a6d4ce53fc4e None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:39.642662 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62d9d62-1c9c-49f3-892f-a6d4ce53fc4e None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:39.643190 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62d9d62-1c9c-49f3-892f-a6d4ce53fc4e None admin] PATH_INFO: `/v3/domains` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:39.643939 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62d9d62-1c9c-49f3-892f-a6d4ce53fc4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:39.644243 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62d9d62-1c9c-49f3-892f-a6d4ce53fc4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:39.645636 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62d9d62-1c9c-49f3-892f-a6d4ce53fc4e None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:39.665777 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 378/755] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 14 17:40:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:39.666729 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62d9d62-1c9c-49f3-892f-a6d4ce53fc4e None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:39.732823 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a867f2-cc25-4b91-b1fc-6cea85818196 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:39.769889 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1891b2-4dbb-4d4c-9795-1e7e73e84477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:39.771081 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1891b2-4dbb-4d4c-9795-1e7e73e84477 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:39.771633 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1891b2-4dbb-4d4c-9795-1e7e73e84477 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:39.772689 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1891b2-4dbb-4d4c-9795-1e7e73e84477 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:39.778556 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62d9d62-1c9c-49f3-892f-a6d4ce53fc4e None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:39.780679 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:39.786553 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1891b2-4dbb-4d4c-9795-1e7e73e84477 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:39.788981 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1891b2-4dbb-4d4c-9795-1e7e73e84477 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:39.810393 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-3c1891b2-4dbb-4d4c-9795-1e7e73e84477 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:39.810393 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:39.810393 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:39.810393 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:39.810393 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:39.810393 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:39.810393 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:39.810393 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:39.810393 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:39.810393 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:39.810393 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:39.810393 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:39.810393 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:40:39.810393 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:40:39.810393 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:40:39.811400 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:40:39.811400 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:39.811400 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:39.811400 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:39.811400 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:39.811400 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:39.811400 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:39.811400 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:39.811400 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:39.811400 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:39.811400 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:39.811400 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:39.811400 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:39.811400 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:39.811400 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:39.811400 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:39.811400 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:39.812317 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:40:39.812317 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:40:39.812317 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:39.812317 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:40:39.812317 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 378/756] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:40:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:39.812605 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1891b2-4dbb-4d4c-9795-1e7e73e84477 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:39.821111 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beba92b3-24f5-45eb-bd46-2c894ccd54ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:39.821954 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beba92b3-24f5-45eb-bd46-2c894ccd54ef None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:39.822236 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beba92b3-24f5-45eb-bd46-2c894ccd54ef None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:39.822488 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beba92b3-24f5-45eb-bd46-2c894ccd54ef None admin] PATH_INFO: `/v3/projects/service` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:39.829862 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beba92b3-24f5-45eb-bd46-2c894ccd54ef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:39.831249 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beba92b3-24f5-45eb-bd46-2c894ccd54ef None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:39.834230 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:39.848122 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-beba92b3-24f5-45eb-bd46-2c894ccd54ef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:40:39.848122 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:39.848122 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:39.848122 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:39.848122 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:39.848122 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:39.848122 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:39.848122 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:39.848122 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:39.848122 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:39.848122 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:39.848122 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:39.848122 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 17:40:39.848122 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 17:40:39.848122 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 17:40:39.849269 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 17:40:39.849269 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:39.849269 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:39.849269 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:39.849269 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:39.849269 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:39.849269 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:39.849269 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:39.849269 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:39.849269 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:39.849269 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:39.849269 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:39.849269 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:39.849269 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:39.849269 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:39.849269 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:39.849269 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:39.850468 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 17:40:39.850468 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 17:40:39.850468 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 17:40:39.850468 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 17:40:39.850468 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 17:40:39.850468 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 17:40:39.850468 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:40:39.850468 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:40:39.854127 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 379/757] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 14 17:40:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:39.854975 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beba92b3-24f5-45eb-bd46-2c894ccd54ef None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:39.931795 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1891b2-4dbb-4d4c-9795-1e7e73e84477 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:39.960400 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beba92b3-24f5-45eb-bd46-2c894ccd54ef None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:39.971386 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c451edae-0ce4-41e2-adb7-3ead35e1e9ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:39.972391 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c451edae-0ce4-41e2-adb7-3ead35e1e9ef None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:39.972845 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c451edae-0ce4-41e2-adb7-3ead35e1e9ef None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:39.973271 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c451edae-0ce4-41e2-adb7-3ead35e1e9ef None admin] PATH_INFO: `/v3/projects/service` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:39.981855 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c451edae-0ce4-41e2-adb7-3ead35e1e9ef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:39.983508 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c451edae-0ce4-41e2-adb7-3ead35e1e9ef None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:39.995626 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd78901d-6508-4283-9f2f-80e69795fa78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:39.996297 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd78901d-6508-4283-9f2f-80e69795fa78 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:39.996576 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd78901d-6508-4283-9f2f-80e69795fa78 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:39.996848 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd78901d-6508-4283-9f2f-80e69795fa78 None admin] PATH_INFO: `/v3/domains` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:39.997618 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd78901d-6508-4283-9f2f-80e69795fa78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:39.997618 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd78901d-6508-4283-9f2f-80e69795fa78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:39.997618 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd78901d-6508-4283-9f2f-80e69795fa78 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:40.008580 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-c451edae-0ce4-41e2-adb7-3ead35e1e9ef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:40:40.008580 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:40.008580 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:40.008580 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:40.008580 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:40.008580 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:40.008580 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:40.008580 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:40.008580 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:40.008580 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:40.008580 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:40.008580 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:40.008580 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 17:40:40.008580 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 17:40:40.008580 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 17:40:40.009648 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 17:40:40.009648 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:40.009648 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:40.009648 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:40.009648 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:40.009648 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:40.009648 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:40.009648 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:40.009648 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:40.009648 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:40.009648 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:40.009648 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:40.009648 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:40.009648 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:40.009648 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:40.009648 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:40.009648 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:40.010563 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 17:40:40.010563 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 17:40:40.010563 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 17:40:40.010563 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 17:40:40.010563 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 17:40:40.010563 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 17:40:40.010563 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:40:40.010563 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:40:40.012962 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 379/758] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 14 17:40:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:40.013987 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c451edae-0ce4-41e2-adb7-3ead35e1e9ef None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:40.017753 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 380/759] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 14 17:40:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:40.022200 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd78901d-6508-4283-9f2f-80e69795fa78 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:40.067361 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:40.083106 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:40.131119 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c451edae-0ce4-41e2-adb7-3ead35e1e9ef None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:40.136210 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd78901d-6508-4283-9f2f-80e69795fa78 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:40.169308 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a0d33a-fa57-4120-8939-c8a3077cc81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:40.170008 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a0d33a-fa57-4120-8939-c8a3077cc81a None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:40.170291 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a0d33a-fa57-4120-8939-c8a3077cc81a None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:40.170565 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a0d33a-fa57-4120-8939-c8a3077cc81a None admin] PATH_INFO: `/v3/projects` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:40.171458 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a0d33a-fa57-4120-8939-c8a3077cc81a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:40.171769 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a0d33a-fa57-4120-8939-c8a3077cc81a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:40.173303 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a0d33a-fa57-4120-8939-c8a3077cc81a None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:40.181082 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433f6d41-1123-43ef-baa0-329d22df392d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:40.182632 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433f6d41-1123-43ef-baa0-329d22df392d None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:40.183118 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433f6d41-1123-43ef-baa0-329d22df392d None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:40.184103 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433f6d41-1123-43ef-baa0-329d22df392d None admin] PATH_INFO: `/v3/projects` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:40.185396 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433f6d41-1123-43ef-baa0-329d22df392d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:40.185928 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433f6d41-1123-43ef-baa0-329d22df392d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:40.186860 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 380/760] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 14 17:40:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:40.187682 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a0d33a-fa57-4120-8939-c8a3077cc81a None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:40.187994 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433f6d41-1123-43ef-baa0-329d22df392d None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:40.205008 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 381/761] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 14 17:40:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:40.206368 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433f6d41-1123-43ef-baa0-329d22df392d None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:40.302988 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a0d33a-fa57-4120-8939-c8a3077cc81a None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:40.310906 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:40.341497 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433f6d41-1123-43ef-baa0-329d22df392d None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:40.341701 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831640cc-fd8b-4091-893c-a5b10cd3cc4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:40.342298 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831640cc-fd8b-4091-893c-a5b10cd3cc4a None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:40.342579 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831640cc-fd8b-4091-893c-a5b10cd3cc4a None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:40.342852 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831640cc-fd8b-4091-893c-a5b10cd3cc4a None admin] PATH_INFO: `/v3/projects/service` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:40.351131 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831640cc-fd8b-4091-893c-a5b10cd3cc4a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:40.352696 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831640cc-fd8b-4091-893c-a5b10cd3cc4a None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:40.367185 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:40.369611 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-831640cc-fd8b-4091-893c-a5b10cd3cc4a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:40:40.369611 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:40.369611 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:40.369611 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:40.369611 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:40.369611 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:40.369611 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:40.369611 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:40.369611 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:40.369611 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:40.369611 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:40.369611 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:40.369611 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 17:40:40.369611 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 17:40:40.369611 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 17:40:40.370659 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 17:40:40.370659 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:40.370659 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:40.370659 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:40.370659 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:40.370659 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:40.370659 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:40.370659 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:40.370659 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:40.370659 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:40.370659 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:40.370659 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:40.370659 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:40.370659 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:40.370659 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:40.370659 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:40.370659 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:40.371573 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 17:40:40.371573 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 17:40:40.371573 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 17:40:40.371573 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 17:40:40.371573 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 17:40:40.371573 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 17:40:40.371573 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:40:40.371573 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:40:40.374198 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 381/762] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 14 17:40:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:40.376005 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831640cc-fd8b-4091-893c-a5b10cd3cc4a None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:40.384570 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7d0e6c-4de0-40b5-a740-397cee0b0484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:40.385395 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d0e6c-4de0-40b5-a740-397cee0b0484 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:40.385784 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d0e6c-4de0-40b5-a740-397cee0b0484 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:40.386173 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d0e6c-4de0-40b5-a740-397cee0b0484 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:40.387093 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7d0e6c-4de0-40b5-a740-397cee0b0484 None admin] RBAC: Adding query filter params (role.id=4651a1cc7b4d4ab7a7a9ca1e77e58e71, scope.project.id=39a570421bb64fac8b1a0129f1bcc7d9, user.id=c65607a396474192a43c374d306ef5ba) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:40.387811 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7d0e6c-4de0-40b5-a740-397cee0b0484 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:40.389141 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7d0e6c-4de0-40b5-a740-397cee0b0484 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:40.396093 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 382/763] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 14 17:40:40 2022] GET /identity/v3/role_assignments?user.id=c65607a396474192a43c374d306ef5ba&scope.project.id=39a570421bb64fac8b1a0129f1bcc7d9&role.id=4651a1cc7b4d4ab7a7a9ca1e77e58e71 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:40.396966 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7d0e6c-4de0-40b5-a740-397cee0b0484 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:40.516728 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831640cc-fd8b-4091-893c-a5b10cd3cc4a None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:40.551425 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7d0e6c-4de0-40b5-a740-397cee0b0484 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:40.559145 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968c5b5f-b712-444b-96e6-51ef8da7323c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:40.560283 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c5b5f-b712-444b-96e6-51ef8da7323c None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:40.560799 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c5b5f-b712-444b-96e6-51ef8da7323c None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:40.561275 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c5b5f-b712-444b-96e6-51ef8da7323c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:40.562472 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968c5b5f-b712-444b-96e6-51ef8da7323c None admin] RBAC: Adding query filter params (role.id=edc349453a61464087c153399e397247, scope.project.id=39a570421bb64fac8b1a0129f1bcc7d9, user.id=45542602225b452fa323f5499c1843ec) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:40.562997 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968c5b5f-b712-444b-96e6-51ef8da7323c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:40.564865 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968c5b5f-b712-444b-96e6-51ef8da7323c None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:40.571465 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 382/764] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 14 17:40:40 2022] GET /identity/v3/role_assignments?user.id=45542602225b452fa323f5499c1843ec&scope.project.id=39a570421bb64fac8b1a0129f1bcc7d9&role.id=edc349453a61464087c153399e397247 => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:40.573089 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202bd424-e9f5-4d42-aea2-767bd4b0426a None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:40.573633 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202bd424-e9f5-4d42-aea2-767bd4b0426a None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:40.574131 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202bd424-e9f5-4d42-aea2-767bd4b0426a None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:40.580082 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 383/765] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:40:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:40:40.581824 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111010e1-c2fa-41b9-a0ff-e8bb4519f7f2 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:40.582227 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111010e1-c2fa-41b9-a0ff-e8bb4519f7f2 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:40.582608 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111010e1-c2fa-41b9-a0ff-e8bb4519f7f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:40.601024 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1789d5b7-cbae-407a-83fb-da9b951a26a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:40.601677 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1789d5b7-cbae-407a-83fb-da9b951a26a9 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:40.601967 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1789d5b7-cbae-407a-83fb-da9b951a26a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:40.602250 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1789d5b7-cbae-407a-83fb-da9b951a26a9 None admin] PATH_INFO: `/v3/projects` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:40.603079 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1789d5b7-cbae-407a-83fb-da9b951a26a9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:40.603392 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1789d5b7-cbae-407a-83fb-da9b951a26a9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:40.604915 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1789d5b7-cbae-407a-83fb-da9b951a26a9 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:40.614241 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-111010e1-c2fa-41b9-a0ff-e8bb4519f7f2 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:40:40.615817 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-111010e1-c2fa-41b9-a0ff-e8bb4519f7f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:40:40.621931 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 383/766] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 14 17:40:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:40.625871 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1789d5b7-cbae-407a-83fb-da9b951a26a9 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:40.643904 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:40.681934 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:40.696385 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 384/767] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:40:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 17:40:40.720596 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111010e1-c2fa-41b9-a0ff-e8bb4519f7f2 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:40.740257 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1789d5b7-cbae-407a-83fb-da9b951a26a9 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:40.783625 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6455cceb-8e96-4d4a-9eea-886f8b1c34e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:40.784558 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6455cceb-8e96-4d4a-9eea-886f8b1c34e6 None admin] REQUEST_METHOD: `PUT` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:40.784842 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6455cceb-8e96-4d4a-9eea-886f8b1c34e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:40.785123 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6455cceb-8e96-4d4a-9eea-886f8b1c34e6 None admin] PATH_INFO: `/v3/projects/39a570421bb64fac8b1a0129f1bcc7d9/users/41b893bdf4ec474dbfa819c22fc29ce9/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:40.791948 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6455cceb-8e96-4d4a-9eea-886f8b1c34e6 None admin] RBAC: Authorizing `identity:create_grant(project_id=39a570421bb64fac8b1a0129f1bcc7d9, user_id=41b893bdf4ec474dbfa819c22fc29ce9, role_id=4651a1cc7b4d4ab7a7a9ca1e77e58e71)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:40.793422 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6455cceb-8e96-4d4a-9eea-886f8b1c34e6 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:40.816188 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 384/768] 10.222.0.67 () {58 vars in 1439 bytes} [Thu Jul 14 17:40:40 2022] PUT /identity/v3/projects/39a570421bb64fac8b1a0129f1bcc7d9/users/41b893bdf4ec474dbfa819c22fc29ce9/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:40:40.823277 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eae9294-f708-40f2-b6e7-30cf82bda771 None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:40.823599 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eae9294-f708-40f2-b6e7-30cf82bda771 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:40.823852 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eae9294-f708-40f2-b6e7-30cf82bda771 None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:40.825283 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 385/769] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:40:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:40:40.832574 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87fc9cf-ba99-4cca-8662-569806eb4121 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:40.832863 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87fc9cf-ba99-4cca-8662-569806eb4121 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:40.833146 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87fc9cf-ba99-4cca-8662-569806eb4121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:40.872179 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-b87fc9cf-ba99-4cca-8662-569806eb4121 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:40:40.878746 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-b87fc9cf-ba99-4cca-8662-569806eb4121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:40:40.890813 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111010e1-c2fa-41b9-a0ff-e8bb4519f7f2 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:40.941859 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c421742-b055-45c5-9123-c71bb8011150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:40.942697 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c421742-b055-45c5-9123-c71bb8011150 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:40.942980 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c421742-b055-45c5-9123-c71bb8011150 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:40.943251 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c421742-b055-45c5-9123-c71bb8011150 None admin] PATH_INFO: `/v3/services/network` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:40.943967 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c421742-b055-45c5-9123-c71bb8011150 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:40.945456 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c421742-b055-45c5-9123-c71bb8011150 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:40.970414 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-3c421742-b055-45c5-9123-c71bb8011150 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 17:40:40.970414 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:40.970414 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 17:40:40.970414 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 17:40:40.970414 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 17:40:40.970414 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 17:40:40.970414 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 17:40:40.970414 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 17:40:40.970414 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 17:40:40.970414 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:40:40.970414 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 17:40:40.970414 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:40:40.970414 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:40.970414 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:40.970414 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:40.970414 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:40.970414 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:40.971504 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:40.971504 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:40.971504 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:40.971504 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:40.971504 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:40.971504 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:40.971504 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 17:40:40.971504 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 17:40:40.971504 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 17:40:40.971504 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 17:40:40.971504 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:40.971504 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:40.971504 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:40.971504 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:40.971504 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:40.971504 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:40.972355 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:40.972355 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:40.972355 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:40.972355 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:40.972355 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:40.972355 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:40.972355 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:40.972355 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:40.972355 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:40.972355 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:40.972355 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 17:40:40.972355 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 17:40:40.972355 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 17:40:40.972355 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:40:40.972355 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 385/770] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 14 17:40:40 2022] GET /identity/v3/services/network => generated 88 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 17:40:40.980126 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c421742-b055-45c5-9123-c71bb8011150 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:41.014886 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:41.044146 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 386/771] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:40:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 17:40:41.070381 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87fc9cf-ba99-4cca-8662-569806eb4121 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:41.120248 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c421742-b055-45c5-9123-c71bb8011150 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:41.123076 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:41.173629 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a51b7a4-fdf4-4e6b-946b-444dcd502196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:41.175855 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51b7a4-fdf4-4e6b-946b-444dcd502196 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:41.176137 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51b7a4-fdf4-4e6b-946b-444dcd502196 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:41.176410 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51b7a4-fdf4-4e6b-946b-444dcd502196 None admin] PATH_INFO: `/v3/services` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:41.177132 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a51b7a4-fdf4-4e6b-946b-444dcd502196 None admin] RBAC: Adding query filter params (name=network) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:41.177434 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a51b7a4-fdf4-4e6b-946b-444dcd502196 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:41.179382 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a51b7a4-fdf4-4e6b-946b-444dcd502196 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:41.188235 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 386/772] 10.222.0.67 () {56 vars in 1112 bytes} [Thu Jul 14 17:40:40 2022] GET /identity/v3/services?name=network => generated 124 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:40:41.193789 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a51b7a4-fdf4-4e6b-946b-444dcd502196 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:41.205285 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87fc9cf-ba99-4cca-8662-569806eb4121 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:41.240275 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc528f5f-944c-4620-bb0b-4ab627b84d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:41.241707 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc528f5f-944c-4620-bb0b-4ab627b84d54 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:41.241994 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc528f5f-944c-4620-bb0b-4ab627b84d54 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:41.242267 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc528f5f-944c-4620-bb0b-4ab627b84d54 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:41.242931 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc528f5f-944c-4620-bb0b-4ab627b84d54 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:41.244587 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc528f5f-944c-4620-bb0b-4ab627b84d54 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:41.259852 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-bc528f5f-944c-4620-bb0b-4ab627b84d54 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 17:40:41.259852 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:41.259852 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 17:40:41.259852 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 17:40:41.259852 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 17:40:41.259852 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 17:40:41.259852 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 17:40:41.259852 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 17:40:41.259852 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 17:40:41.259852 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:40:41.259852 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 17:40:41.259852 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:40:41.259852 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:41.259852 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:41.259852 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:41.259852 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:41.260894 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:41.260894 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:41.260894 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:41.260894 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:41.260894 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:41.260894 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:41.260894 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:41.260894 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 17:40:41.260894 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 17:40:41.260894 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 17:40:41.260894 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 17:40:41.260894 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:41.260894 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:41.260894 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:41.260894 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:41.260894 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:41.261804 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:41.261804 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:41.261804 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:41.261804 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:41.261804 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:41.261804 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:41.261804 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:41.261804 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:41.261804 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:41.261804 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:41.261804 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:41.261804 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 17:40:41.261804 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 17:40:41.261804 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 17:40:41.261804 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:40:41.261804 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 387/773] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Jul 14 17:40:41 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 17:40:41.267978 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc528f5f-944c-4620-bb0b-4ab627b84d54 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:41.364238 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:41.369656 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:41.374668 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc528f5f-944c-4620-bb0b-4ab627b84d54 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:41.403474 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a51b7a4-fdf4-4e6b-946b-444dcd502196 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:41.411074 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb177dad-7445-465c-99cd-730b4e2667e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:41.411794 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb177dad-7445-465c-99cd-730b4e2667e5 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:41.412080 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb177dad-7445-465c-99cd-730b4e2667e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:41.412358 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb177dad-7445-465c-99cd-730b4e2667e5 None admin] PATH_INFO: `/v3/services` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:41.413226 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb177dad-7445-465c-99cd-730b4e2667e5 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:41.413548 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb177dad-7445-465c-99cd-730b4e2667e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:41.415006 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb177dad-7445-465c-99cd-730b4e2667e5 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:41.420530 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 388/774] 10.222.0.67 () {56 vars in 1124 bytes} [Thu Jul 14 17:40:41 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:40:41.425946 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb177dad-7445-465c-99cd-730b4e2667e5 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:41.513646 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5260deea-95c8-457e-9e6b-4edc7da698f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:41.514336 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5260deea-95c8-457e-9e6b-4edc7da698f0 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:41.514617 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5260deea-95c8-457e-9e6b-4edc7da698f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:41.514892 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5260deea-95c8-457e-9e6b-4edc7da698f0 None admin] PATH_INFO: `/v3/services` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:41.515616 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5260deea-95c8-457e-9e6b-4edc7da698f0 None admin] RBAC: Adding query filter params (type=network) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:41.515919 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5260deea-95c8-457e-9e6b-4edc7da698f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:41.517291 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5260deea-95c8-457e-9e6b-4edc7da698f0 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:41.536040 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb177dad-7445-465c-99cd-730b4e2667e5 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:41.539561 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 387/775] 10.222.0.67 () {56 vars in 1112 bytes} [Thu Jul 14 17:40:41 2022] GET /identity/v3/services?type=network => generated 350 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:41.554566 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5260deea-95c8-457e-9e6b-4edc7da698f0 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:41.576812 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21362de-150a-47b9-b2c6-8d79d48df677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:41.577483 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21362de-150a-47b9-b2c6-8d79d48df677 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:41.577842 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21362de-150a-47b9-b2c6-8d79d48df677 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:41.578117 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21362de-150a-47b9-b2c6-8d79d48df677 None admin] PATH_INFO: `/v3/services` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:41.578832 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21362de-150a-47b9-b2c6-8d79d48df677 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:41.579136 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21362de-150a-47b9-b2c6-8d79d48df677 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:41.580643 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21362de-150a-47b9-b2c6-8d79d48df677 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:41.587336 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 389/776] 10.222.0.67 () {56 vars in 1124 bytes} [Thu Jul 14 17:40:41 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:40:41.593108 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21362de-150a-47b9-b2c6-8d79d48df677 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:41.638094 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:41.708161 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5260deea-95c8-457e-9e6b-4edc7da698f0 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:41.745399 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca67df75-69a0-46bf-a3e4-3deaf23a5d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:41.746101 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca67df75-69a0-46bf-a3e4-3deaf23a5d96 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:41.746381 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca67df75-69a0-46bf-a3e4-3deaf23a5d96 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:41.746654 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca67df75-69a0-46bf-a3e4-3deaf23a5d96 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:41.747509 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca67df75-69a0-46bf-a3e4-3deaf23a5d96 None admin] RBAC: Adding query filter params (interface=public, service_id=77b7f2844d854245ac4b18b45b0d975c, region_id=RegionOne) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:41.747827 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca67df75-69a0-46bf-a3e4-3deaf23a5d96 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:41.753552 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca67df75-69a0-46bf-a3e4-3deaf23a5d96 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:41.757784 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 388/777] 10.222.0.67 () {56 vars in 1251 bytes} [Thu Jul 14 17:40:41 2022] GET /identity/v3/endpoints?service_id=77b7f2844d854245ac4b18b45b0d975c&interface=public®ion_id=RegionOne => generated 194 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:41.763204 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca67df75-69a0-46bf-a3e4-3deaf23a5d96 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:41.797891 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:41.830891 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21362de-150a-47b9-b2c6-8d79d48df677 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:41.896014 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d730d4c1-bfb1-48c6-9e02-8e24b823eac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:41.896610 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d730d4c1-bfb1-48c6-9e02-8e24b823eac7 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:41.896886 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d730d4c1-bfb1-48c6-9e02-8e24b823eac7 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:41.897725 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d730d4c1-bfb1-48c6-9e02-8e24b823eac7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:41.898503 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d730d4c1-bfb1-48c6-9e02-8e24b823eac7 None admin] RBAC: Adding query filter params (interface=public, service_id=554ced60acfe4402892f794013aed99d, region_id=RegionOne) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:41.898826 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d730d4c1-bfb1-48c6-9e02-8e24b823eac7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:41.902995 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d730d4c1-bfb1-48c6-9e02-8e24b823eac7 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:41.923033 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 390/778] 10.222.0.67 () {56 vars in 1251 bytes} [Thu Jul 14 17:40:41 2022] GET /identity/v3/endpoints?service_id=554ced60acfe4402892f794013aed99d&interface=public®ion_id=RegionOne => generated 194 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:41.929036 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d730d4c1-bfb1-48c6-9e02-8e24b823eac7 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:41.972382 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca67df75-69a0-46bf-a3e4-3deaf23a5d96 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:42.043979 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:42.054839 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d730d4c1-bfb1-48c6-9e02-8e24b823eac7 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:42.063731 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4424c6de-67be-4eb4-a043-f48bb5867e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:42.064416 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4424c6de-67be-4eb4-a043-f48bb5867e53 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:42.064696 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4424c6de-67be-4eb4-a043-f48bb5867e53 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:42.064964 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4424c6de-67be-4eb4-a043-f48bb5867e53 None admin] PATH_INFO: `/v3/services` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:42.065694 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4424c6de-67be-4eb4-a043-f48bb5867e53 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:42.067120 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4424c6de-67be-4eb4-a043-f48bb5867e53 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:42.081737 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 389/779] 10.222.0.67 () {56 vars in 1087 bytes} [Thu Jul 14 17:40:41 2022] GET /identity/v3/services => generated 772 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:42.097412 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9b5c79-90d9-4e0a-89a5-69e94deade4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:42.098147 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9b5c79-90d9-4e0a-89a5-69e94deade4d None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:42.098435 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9b5c79-90d9-4e0a-89a5-69e94deade4d None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:42.098715 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9b5c79-90d9-4e0a-89a5-69e94deade4d None admin] PATH_INFO: `/v3/services` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:42.099488 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9b5c79-90d9-4e0a-89a5-69e94deade4d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:42.101647 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9b5c79-90d9-4e0a-89a5-69e94deade4d None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:42.108172 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 391/780] 10.222.0.67 () {56 vars in 1087 bytes} [Thu Jul 14 17:40:41 2022] GET /identity/v3/services => generated 772 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:42.908645 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b30caa-8384-4010-b251-9761ccc51772 None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:42.909182 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b30caa-8384-4010-b251-9761ccc51772 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:42.909182 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b30caa-8384-4010-b251-9761ccc51772 None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:42.910832 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 390/781] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:40:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:40:42.916609 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1371dc0f-be0d-4829-afc8-996d80c73c91 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:42.917050 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1371dc0f-be0d-4829-afc8-996d80c73c91 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:42.917268 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1371dc0f-be0d-4829-afc8-996d80c73c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:42.938547 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-1371dc0f-be0d-4829-afc8-996d80c73c91 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:40:42.939755 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-1371dc0f-be0d-4829-afc8-996d80c73c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:40:43.030190 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 392/782] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:40:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 17:40:43.052716 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b30caa-8384-4010-b251-9761ccc51772 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:43.152740 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e073ba-d2c7-40a0-a627-834d41f72477 None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:43.153071 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e073ba-d2c7-40a0-a627-834d41f72477 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:43.153299 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e073ba-d2c7-40a0-a627-834d41f72477 None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:43.155387 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 393/783] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:40:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:40:43.161708 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454acd4f-bdeb-41db-9b5e-f3780dcf03c9 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:43.161933 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454acd4f-bdeb-41db-9b5e-f3780dcf03c9 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:43.162419 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454acd4f-bdeb-41db-9b5e-f3780dcf03c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:43.183206 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-454acd4f-bdeb-41db-9b5e-f3780dcf03c9 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:40:43.184597 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-454acd4f-bdeb-41db-9b5e-f3780dcf03c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:40:43.201912 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:43.226366 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b30caa-8384-4010-b251-9761ccc51772 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:43.265649 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 394/784] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:40:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 17:40:43.267070 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c4a03-d458-4f31-b2d4-43ea76994560 None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:43.267357 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c4a03-d458-4f31-b2d4-43ea76994560 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:43.267695 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c4a03-d458-4f31-b2d4-43ea76994560 None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:43.268135 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d56c63c-d193-4828-a9c6-b1d8f9f74da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:43.269060 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d56c63c-d193-4828-a9c6-b1d8f9f74da2 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:43.269356 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d56c63c-d193-4828-a9c6-b1d8f9f74da2 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:43.269662 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d56c63c-d193-4828-a9c6-b1d8f9f74da2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:43.272875 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 395/785] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:40:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:40:43.276266 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce605a8-efba-4c79-968f-b361c5fda59c None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:43.276551 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce605a8-efba-4c79-968f-b361c5fda59c None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:43.276823 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce605a8-efba-4c79-968f-b361c5fda59c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:43.281097 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d56c63c-d193-4828-a9c6-b1d8f9f74da2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:40:43.289775 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-5d56c63c-d193-4828-a9c6-b1d8f9f74da2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 17:40:43.289775 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:43.289775 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:43.289775 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:43.289775 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:43.289775 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:43.289775 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:43.289775 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:43.289775 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:43.289775 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:43.289775 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:43.289775 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:43.289775 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:40:43.289775 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:40:43.289775 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:40:43.289775 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:40:43.290764 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:40:43.290764 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:40:43.290764 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:40:43.290764 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:40:43.290764 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:43.290764 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:43.290764 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:43.290764 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:43.290764 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:43.290764 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:43.290764 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:43.290764 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:43.290764 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:43.290764 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:43.290764 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:43.290764 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:43.291623 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:43.291623 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:43.291623 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:43.291623 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:43.291623 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:40:43.291623 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:40:43.291623 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:40:43.291623 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:40:43.291623 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:40:43.291623 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:40:43.291623 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 17:40:43.291623 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:40:43.291623 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 391/786] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 14 17:40:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:43.297255 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d56c63c-d193-4828-a9c6-b1d8f9f74da2 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:43.309053 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-3ce605a8-efba-4c79-968f-b361c5fda59c None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:40:43.310331 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-3ce605a8-efba-4c79-968f-b361c5fda59c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:40:43.321685 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:43.388126 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 396/787] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:40:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 17:40:43.389168 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce605a8-efba-4c79-968f-b361c5fda59c None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:43.414738 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d56c63c-d193-4828-a9c6-b1d8f9f74da2 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:43.473570 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6e2c3f-31a8-4caa-9e1f-6cf0079a7b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:43.473570 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e2c3f-31a8-4caa-9e1f-6cf0079a7b1b None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:43.473570 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e2c3f-31a8-4caa-9e1f-6cf0079a7b1b None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:43.473570 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e2c3f-31a8-4caa-9e1f-6cf0079a7b1b None admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:43.474017 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6e2c3f-31a8-4caa-9e1f-6cf0079a7b1b None admin] RBAC: Adding query filter params (name=admin) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:43.474017 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6e2c3f-31a8-4caa-9e1f-6cf0079a7b1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:43.474017 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6e2c3f-31a8-4caa-9e1f-6cf0079a7b1b None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:43.484310 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 392/788] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 14 17:40:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:40:43.485521 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6e2c3f-31a8-4caa-9e1f-6cf0079a7b1b None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:43.488563 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:43.499486 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce605a8-efba-4c79-968f-b361c5fda59c None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:43.540096 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f967270-7e67-406f-9b0e-038be63e60aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:43.541247 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f967270-7e67-406f-9b0e-038be63e60aa None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:43.541788 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f967270-7e67-406f-9b0e-038be63e60aa None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:43.542266 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f967270-7e67-406f-9b0e-038be63e60aa None admin] PATH_INFO: `/v3/roles/service` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:43.554790 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f967270-7e67-406f-9b0e-038be63e60aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:40:43.563055 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-0f967270-7e67-406f-9b0e-038be63e60aa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 17:40:43.563055 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:43.563055 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:43.563055 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:43.563055 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:43.563055 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:43.563055 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:43.563055 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:43.563055 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:43.563055 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:43.563055 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:43.563055 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:43.563055 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:40:43.563055 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:40:43.563055 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:40:43.563055 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:40:43.564237 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:40:43.564237 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:40:43.564237 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:40:43.564237 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:40:43.564237 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:43.564237 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:43.564237 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:43.564237 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:43.564237 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:43.564237 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:43.564237 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:43.564237 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:43.564237 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:43.564237 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:43.564237 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:43.564237 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:43.565376 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:43.565376 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:43.565376 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:43.565376 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:43.565376 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:40:43.565376 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:40:43.565376 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:40:43.565376 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:40:43.565376 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:40:43.565376 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:40:43.565376 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 17:40:43.565376 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:40:43.565376 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 397/789] 10.222.0.67 () {56 vars in 1102 bytes} [Thu Jul 14 17:40:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:43.565376 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f967270-7e67-406f-9b0e-038be63e60aa None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:43.569942 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:43.627162 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6e2c3f-31a8-4caa-9e1f-6cf0079a7b1b None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:43.677633 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911102e5-e2b1-4d2c-9b04-ee98fd6ec96c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:43.677633 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911102e5-e2b1-4d2c-9b04-ee98fd6ec96c None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:43.677633 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911102e5-e2b1-4d2c-9b04-ee98fd6ec96c None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:43.677633 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911102e5-e2b1-4d2c-9b04-ee98fd6ec96c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:43.681078 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f967270-7e67-406f-9b0e-038be63e60aa None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:43.691558 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911102e5-e2b1-4d2c-9b04-ee98fd6ec96c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:40:43.701835 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-911102e5-e2b1-4d2c-9b04-ee98fd6ec96c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 17:40:43.701835 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:43.701835 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:43.701835 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:43.701835 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:43.701835 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:43.701835 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:43.701835 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:43.701835 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:43.701835 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:43.701835 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:43.701835 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:43.701835 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:40:43.701835 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:40:43.701835 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:40:43.701835 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:40:43.702838 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:40:43.702838 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:40:43.702838 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:40:43.702838 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:40:43.702838 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:43.702838 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:43.702838 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:43.702838 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:43.702838 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:43.702838 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:43.702838 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:43.702838 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:43.702838 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:43.702838 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:43.702838 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:43.702838 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:43.703701 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:43.703701 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:43.703701 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:43.703701 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:43.703701 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:40:43.703701 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:40:43.703701 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:40:43.703701 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:40:43.703701 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:40:43.703701 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:40:43.703701 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 17:40:43.703701 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:40:43.704822 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 393/790] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 14 17:40:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:43.704903 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911102e5-e2b1-4d2c-9b04-ee98fd6ec96c None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:43.724865 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d82d455-7978-4fb4-8f61-b7a3c8791bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:43.726511 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d82d455-7978-4fb4-8f61-b7a3c8791bfa None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:43.726865 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d82d455-7978-4fb4-8f61-b7a3c8791bfa None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:43.727213 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d82d455-7978-4fb4-8f61-b7a3c8791bfa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:43.739765 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d82d455-7978-4fb4-8f61-b7a3c8791bfa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:43.741390 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d82d455-7978-4fb4-8f61-b7a3c8791bfa None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:43.761212 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-9d82d455-7978-4fb4-8f61-b7a3c8791bfa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:43.761212 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:43.761212 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:43.761212 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:43.761212 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:43.761212 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:43.761212 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:43.761212 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:43.761212 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:43.761212 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:43.761212 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:43.761212 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:43.761212 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:40:43.761212 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:40:43.761212 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:40:43.763200 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:40:43.763200 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:43.763200 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:43.763200 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:43.763200 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:43.763200 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:43.763200 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:43.763200 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:43.763200 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:43.763200 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:43.763200 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:43.763200 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:43.763200 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:43.763200 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:43.763200 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:43.763200 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:43.763200 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:43.764465 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:40:43.764465 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:40:43.764465 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:43.764465 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:40:43.764465 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 398/791] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:40:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:43.764465 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d82d455-7978-4fb4-8f61-b7a3c8791bfa None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:43.786259 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:43.829981 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:43.841467 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911102e5-e2b1-4d2c-9b04-ee98fd6ec96c None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:43.882213 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9a570d-4fd9-48a5-8561-ffe0de034415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:43.883179 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a570d-4fd9-48a5-8561-ffe0de034415 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:43.883607 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a570d-4fd9-48a5-8561-ffe0de034415 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:43.883817 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d82d455-7978-4fb4-8f61-b7a3c8791bfa None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:43.884204 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a570d-4fd9-48a5-8561-ffe0de034415 None admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:43.885092 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9a570d-4fd9-48a5-8561-ffe0de034415 None admin] RBAC: Adding query filter params (name=service) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:43.885564 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9a570d-4fd9-48a5-8561-ffe0de034415 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:43.887123 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9a570d-4fd9-48a5-8561-ffe0de034415 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:43.895989 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 394/792] 10.222.0.67 () {56 vars in 1103 bytes} [Thu Jul 14 17:40:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:43.896983 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9a570d-4fd9-48a5-8561-ffe0de034415 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:43.924240 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbfc5cf-b067-439f-82e6-6a841aa25564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:43.924920 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbfc5cf-b067-439f-82e6-6a841aa25564 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:43.925262 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbfc5cf-b067-439f-82e6-6a841aa25564 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:43.925628 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbfc5cf-b067-439f-82e6-6a841aa25564 None admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:43.926349 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbfc5cf-b067-439f-82e6-6a841aa25564 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:43.926660 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbfc5cf-b067-439f-82e6-6a841aa25564 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:43.928297 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbfc5cf-b067-439f-82e6-6a841aa25564 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:43.942647 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 399/793] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 14 17:40:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:43.942647 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbfc5cf-b067-439f-82e6-6a841aa25564 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:44.012321 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9a570d-4fd9-48a5-8561-ffe0de034415 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:44.043421 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:44.052638 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bf4a06-f0c5-484b-892f-b36cd585d969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:44.054280 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf4a06-f0c5-484b-892f-b36cd585d969 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:44.054718 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf4a06-f0c5-484b-892f-b36cd585d969 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:44.055431 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf4a06-f0c5-484b-892f-b36cd585d969 None admin] PATH_INFO: `/v3/domains` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:44.056345 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bf4a06-f0c5-484b-892f-b36cd585d969 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:44.056832 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bf4a06-f0c5-484b-892f-b36cd585d969 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:44.058473 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bf4a06-f0c5-484b-892f-b36cd585d969 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:44.062016 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbfc5cf-b067-439f-82e6-6a841aa25564 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:44.073029 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 395/794] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 14 17:40:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:44.074310 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bf4a06-f0c5-484b-892f-b36cd585d969 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:44.085919 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:44.103033 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe7f89b-b8ef-42b2-be2a-67e0aec06e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:44.103874 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe7f89b-b8ef-42b2-be2a-67e0aec06e91 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:44.104159 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe7f89b-b8ef-42b2-be2a-67e0aec06e91 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:44.104438 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe7f89b-b8ef-42b2-be2a-67e0aec06e91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:44.117650 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe7f89b-b8ef-42b2-be2a-67e0aec06e91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:44.119450 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe7f89b-b8ef-42b2-be2a-67e0aec06e91 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:44.140190 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-6fe7f89b-b8ef-42b2-be2a-67e0aec06e91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:44.140190 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:44.140190 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:44.140190 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:44.140190 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:44.140190 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:44.140190 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:44.140190 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:44.140190 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:44.140190 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:44.140190 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:44.140190 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:44.140190 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:40:44.140190 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:40:44.140190 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:40:44.141214 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:40:44.141214 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:44.141214 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:44.141214 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:44.141214 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:44.141214 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:44.141214 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:44.141214 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:44.141214 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:44.141214 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:44.141214 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:44.141214 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:44.141214 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:44.141214 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:44.141214 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:44.141214 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:44.141214 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:44.142179 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:40:44.142179 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:40:44.142179 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:44.142179 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:40:44.142179 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 400/795] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:40:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:44.142902 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe7f89b-b8ef-42b2-be2a-67e0aec06e91 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:44.194630 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bf4a06-f0c5-484b-892f-b36cd585d969 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:44.235090 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a0f4ea-2cb6-4082-98ea-f72313f7dd10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:44.236264 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a0f4ea-2cb6-4082-98ea-f72313f7dd10 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:44.236892 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a0f4ea-2cb6-4082-98ea-f72313f7dd10 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:44.237385 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a0f4ea-2cb6-4082-98ea-f72313f7dd10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:44.250324 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a0f4ea-2cb6-4082-98ea-f72313f7dd10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:44.252290 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a0f4ea-2cb6-4082-98ea-f72313f7dd10 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:44.265079 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe7f89b-b8ef-42b2-be2a-67e0aec06e91 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:44.273852 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-63a0f4ea-2cb6-4082-98ea-f72313f7dd10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:44.273852 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:44.273852 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:44.273852 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:44.273852 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:44.273852 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:44.273852 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:44.273852 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:44.273852 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:44.273852 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:44.273852 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:44.273852 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:44.273852 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:40:44.273852 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:40:44.273852 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:40:44.274833 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:40:44.274833 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:44.274833 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:44.274833 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:44.274833 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:44.274833 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:44.274833 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:44.274833 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:44.274833 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:44.274833 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:44.274833 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:44.274833 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:44.274833 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:44.274833 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:44.274833 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:44.274833 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:44.274833 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:44.275742 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:40:44.275742 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:40:44.275742 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:44.275742 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:40:44.282587 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 396/796] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:40:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:44.283977 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a0f4ea-2cb6-4082-98ea-f72313f7dd10 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:44.302689 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c956edd0-080b-444c-9b74-d48904488b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:44.303491 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c956edd0-080b-444c-9b74-d48904488b55 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:44.303902 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c956edd0-080b-444c-9b74-d48904488b55 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:44.304096 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c956edd0-080b-444c-9b74-d48904488b55 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:44.312649 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c956edd0-080b-444c-9b74-d48904488b55 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:44.314852 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c956edd0-080b-444c-9b74-d48904488b55 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:44.329924 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:44.330991 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-c956edd0-080b-444c-9b74-d48904488b55 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 14 17:40:44.330991 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:44.330991 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:44.330991 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:44.330991 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:44.330991 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:44.330991 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:44.330991 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:44.330991 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:44.330991 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:44.330991 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:44.330991 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:44.330991 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 17:40:44.330991 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 17:40:44.330991 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 17:40:44.330991 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 17:40:44.331967 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:44.331967 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:44.331967 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 17:40:44.331967 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:40:44.331967 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 17:40:44.331967 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:40:44.331967 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:44.331967 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:44.331967 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:44.331967 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:44.331967 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:44.331967 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:44.331967 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:44.331967 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:44.331967 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:44.331967 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:44.331967 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:44.331967 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:44.332986 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:44.332986 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:44.332986 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 17:40:44.332986 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 17:40:44.332986 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 17:40:44.332986 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 17:40:44.332986 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 17:40:44.332986 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 17:40:44.332986 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 14 17:40:44.332986 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:40:44.332986 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 401/797] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 14 17:40:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:44.334107 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c956edd0-080b-444c-9b74-d48904488b55 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:44.367079 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:44.403533 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a0f4ea-2cb6-4082-98ea-f72313f7dd10 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:44.443742 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa7e33-5119-4f0c-afea-3e2fcbedd66b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:44.443987 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c956edd0-080b-444c-9b74-d48904488b55 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:44.445583 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa7e33-5119-4f0c-afea-3e2fcbedd66b None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:44.446169 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa7e33-5119-4f0c-afea-3e2fcbedd66b None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:44.446645 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa7e33-5119-4f0c-afea-3e2fcbedd66b None admin] PATH_INFO: `/v3/domains` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:44.447686 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fa7e33-5119-4f0c-afea-3e2fcbedd66b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:44.448212 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fa7e33-5119-4f0c-afea-3e2fcbedd66b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:44.449885 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fa7e33-5119-4f0c-afea-3e2fcbedd66b None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:44.464222 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 397/798] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 14 17:40:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:44.465393 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa7e33-5119-4f0c-afea-3e2fcbedd66b None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:44.482503 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fe2d80-fabc-4193-99a4-e9856eb3d1e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:44.483183 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe2d80-fabc-4193-99a4-e9856eb3d1e8 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:44.483466 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe2d80-fabc-4193-99a4-e9856eb3d1e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:44.483739 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe2d80-fabc-4193-99a4-e9856eb3d1e8 None admin] PATH_INFO: `/v3/domains` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:44.484581 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fe2d80-fabc-4193-99a4-e9856eb3d1e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:44.484872 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fe2d80-fabc-4193-99a4-e9856eb3d1e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:44.486431 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fe2d80-fabc-4193-99a4-e9856eb3d1e8 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:44.504702 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 402/799] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 14 17:40:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:44.504702 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fe2d80-fabc-4193-99a4-e9856eb3d1e8 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:44.580370 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:44.588121 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa7e33-5119-4f0c-afea-3e2fcbedd66b None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:44.604996 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:44.617408 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fe2d80-fabc-4193-99a4-e9856eb3d1e8 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:44.628937 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ef2786-e750-46b8-bf07-7aac7a2d902a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:44.630087 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ef2786-e750-46b8-bf07-7aac7a2d902a None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:44.630576 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ef2786-e750-46b8-bf07-7aac7a2d902a None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:44.631076 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ef2786-e750-46b8-bf07-7aac7a2d902a None admin] PATH_INFO: `/v3/users` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:44.632258 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ef2786-e750-46b8-bf07-7aac7a2d902a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:44.632796 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ef2786-e750-46b8-bf07-7aac7a2d902a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:44.634633 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ef2786-e750-46b8-bf07-7aac7a2d902a None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:44.654800 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9dff4f-aef0-4eff-b823-d3a398ef646e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:44.655500 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 398/800] 10.222.0.67 () {56 vars in 1135 bytes} [Thu Jul 14 17:40:44 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:44.655610 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9dff4f-aef0-4eff-b823-d3a398ef646e None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:44.655925 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9dff4f-aef0-4eff-b823-d3a398ef646e None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:44.656209 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9dff4f-aef0-4eff-b823-d3a398ef646e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:44.657120 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ef2786-e750-46b8-bf07-7aac7a2d902a None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:44.665516 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9dff4f-aef0-4eff-b823-d3a398ef646e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:44.667038 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9dff4f-aef0-4eff-b823-d3a398ef646e None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:44.684943 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-ab9dff4f-aef0-4eff-b823-d3a398ef646e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 17:40:44.684943 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:44.684943 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:44.684943 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:44.684943 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:44.684943 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:44.684943 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:44.684943 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:44.684943 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:44.684943 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:44.684943 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:44.684943 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:44.684943 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 17:40:44.684943 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 17:40:44.684943 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 17:40:44.684943 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 17:40:44.686013 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:44.686013 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:44.686013 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 17:40:44.686013 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:40:44.686013 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 17:40:44.686013 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:40:44.686013 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:44.686013 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:44.686013 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:44.686013 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:44.686013 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:44.686013 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:44.686013 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:44.686013 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:44.686013 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:44.686013 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:44.686013 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:44.686013 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:44.686985 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:44.686985 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:44.686985 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 17:40:44.686985 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 17:40:44.686985 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 17:40:44.686985 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 17:40:44.686985 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 17:40:44.686985 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 17:40:44.686985 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 17:40:44.686985 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:40:44.686985 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 403/801] 10.222.0.67 () {56 vars in 1117 bytes} [Thu Jul 14 17:40:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:44.687605 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9dff4f-aef0-4eff-b823-d3a398ef646e None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:44.773740 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ef2786-e750-46b8-bf07-7aac7a2d902a None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:44.797782 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9dff4f-aef0-4eff-b823-d3a398ef646e None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:44.808800 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018def59-de80-4674-9b49-000b0d5534f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:44.809638 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018def59-de80-4674-9b49-000b0d5534f9 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:44.809920 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018def59-de80-4674-9b49-000b0d5534f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:44.810194 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018def59-de80-4674-9b49-000b0d5534f9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:44.817482 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018def59-de80-4674-9b49-000b0d5534f9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:44.819250 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018def59-de80-4674-9b49-000b0d5534f9 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:44.833705 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-018def59-de80-4674-9b49-000b0d5534f9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 17:40:44.833705 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:44.833705 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:44.833705 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:44.833705 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:44.833705 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:44.833705 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:44.833705 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:44.833705 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:44.833705 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:44.833705 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:44.833705 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:44.833705 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 17:40:44.833705 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 17:40:44.833705 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 17:40:44.833705 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 17:40:44.834780 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:44.834780 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:44.834780 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 17:40:44.834780 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:40:44.834780 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 17:40:44.834780 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:40:44.834780 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:44.834780 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:44.834780 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:44.834780 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:44.834780 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:44.834780 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:44.834780 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:44.834780 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:44.834780 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:44.834780 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:44.834780 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:44.834780 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:44.840675 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:44.840675 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:44.840675 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 17:40:44.840675 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 17:40:44.840675 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 17:40:44.840675 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 17:40:44.840675 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 17:40:44.840675 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 17:40:44.840675 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 17:40:44.840675 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:40:44.840675 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 399/802] 10.222.0.67 () {56 vars in 1093 bytes} [Thu Jul 14 17:40:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:44.841329 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf7098b-051c-42fe-b9df-a79ef99d2294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:44.841433 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e78103-ba6f-4fb7-a0e6-3c2cb3868af7 None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:44.841433 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e78103-ba6f-4fb7-a0e6-3c2cb3868af7 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:44.841630 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf7098b-051c-42fe-b9df-a79ef99d2294 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:44.841725 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e78103-ba6f-4fb7-a0e6-3c2cb3868af7 None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:44.841809 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf7098b-051c-42fe-b9df-a79ef99d2294 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:44.841809 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf7098b-051c-42fe-b9df-a79ef99d2294 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:44.841959 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 400/803] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:40:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:40:44.841959 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e78103-ba6f-4fb7-a0e6-3c2cb3868af7 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:44.853922 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf7098b-051c-42fe-b9df-a79ef99d2294 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:44.855382 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf7098b-051c-42fe-b9df-a79ef99d2294 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:44.857724 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:44.875405 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-ebf7098b-051c-42fe-b9df-a79ef99d2294 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:44.875405 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:44.875405 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:44.875405 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:44.875405 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:44.875405 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:44.875405 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:44.875405 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:44.875405 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:44.875405 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:44.875405 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:44.875405 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:44.875405 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:40:44.875405 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:40:44.875405 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:40:44.876480 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:40:44.876480 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:44.876480 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:44.876480 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:44.876480 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:44.876480 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:44.876480 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:44.876480 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:44.876480 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:44.876480 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:44.876480 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:44.876480 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:44.876480 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:44.876480 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:44.876480 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:44.876480 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:44.876480 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:44.877713 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:40:44.877713 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:40:44.877713 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:44.877713 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:40:44.877713 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 404/804] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:40:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:44.878242 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e51e545-8b14-4485-8d31-a4c5c5398cba None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:44.878926 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e51e545-8b14-4485-8d31-a4c5c5398cba None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:44.878926 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e51e545-8b14-4485-8d31-a4c5c5398cba None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:44.879985 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 405/805] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:40:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:40:44.880659 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e51e545-8b14-4485-8d31-a4c5c5398cba None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:44.883812 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:44.962591 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e78103-ba6f-4fb7-a0e6-3c2cb3868af7 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:44.995440 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e51e545-8b14-4485-8d31-a4c5c5398cba None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:44.999429 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060210fe-80a3-476d-8fe3-1b43420877aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:45.000112 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060210fe-80a3-476d-8fe3-1b43420877aa None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:45.000396 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060210fe-80a3-476d-8fe3-1b43420877aa None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:45.000677 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060210fe-80a3-476d-8fe3-1b43420877aa None admin] PATH_INFO: `/v3/users` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:45.001543 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060210fe-80a3-476d-8fe3-1b43420877aa None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:45.001860 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060210fe-80a3-476d-8fe3-1b43420877aa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:45.003311 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060210fe-80a3-476d-8fe3-1b43420877aa None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:45.024286 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 401/806] 10.222.0.67 () {56 vars in 1149 bytes} [Thu Jul 14 17:40:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:45.025485 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081684a4-80ac-479f-b7cd-97bdf174e581 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:45.025793 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081684a4-80ac-479f-b7cd-97bdf174e581 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:45.026066 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081684a4-80ac-479f-b7cd-97bdf174e581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:45.034313 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2fc3f1-618c-4d8c-8923-0a5faffbd43f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:45.034990 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2fc3f1-618c-4d8c-8923-0a5faffbd43f None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:45.035277 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2fc3f1-618c-4d8c-8923-0a5faffbd43f None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:45.035559 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2fc3f1-618c-4d8c-8923-0a5faffbd43f None admin] PATH_INFO: `/v3/users` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:45.036405 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2fc3f1-618c-4d8c-8923-0a5faffbd43f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:45.036716 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2fc3f1-618c-4d8c-8923-0a5faffbd43f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:45.038753 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2fc3f1-618c-4d8c-8923-0a5faffbd43f None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:45.043612 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-081684a4-80ac-479f-b7cd-97bdf174e581 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:40:45.044797 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-081684a4-80ac-479f-b7cd-97bdf174e581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:40:45.057918 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 406/807] 10.222.0.67 () {56 vars in 1133 bytes} [Thu Jul 14 17:40:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:45.058998 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2fc3f1-618c-4d8c-8923-0a5faffbd43f None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:45.119943 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 402/808] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:40:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 17:40:45.121227 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f1f437-5e42-4679-9645-2426ef64bdb3 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:45.121509 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f1f437-5e42-4679-9645-2426ef64bdb3 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:45.121812 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f1f437-5e42-4679-9645-2426ef64bdb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:45.126654 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:45.142685 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-37f1f437-5e42-4679-9645-2426ef64bdb3 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:40:45.144664 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-37f1f437-5e42-4679-9645-2426ef64bdb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:40:45.145292 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:45.192086 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2fc3f1-618c-4d8c-8923-0a5faffbd43f None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:45.221909 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 403/809] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:40:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 17:40:45.222773 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f1f437-5e42-4679-9645-2426ef64bdb3 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:45.232404 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3019687-1ca7-49df-9597-949aa15ea4b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:45.233080 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3019687-1ca7-49df-9597-949aa15ea4b2 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:45.233361 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3019687-1ca7-49df-9597-949aa15ea4b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:45.233674 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3019687-1ca7-49df-9597-949aa15ea4b2 None admin] PATH_INFO: `/v3/domains` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:45.234408 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3019687-1ca7-49df-9597-949aa15ea4b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:45.234719 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3019687-1ca7-49df-9597-949aa15ea4b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:45.236100 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3019687-1ca7-49df-9597-949aa15ea4b2 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:45.248375 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 407/810] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 14 17:40:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:45.249212 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3019687-1ca7-49df-9597-949aa15ea4b2 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:45.343540 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f1f437-5e42-4679-9645-2426ef64bdb3 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:45.356591 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3019687-1ca7-49df-9597-949aa15ea4b2 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:45.373916 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:45.380213 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b6d95b-eec4-4cd0-84f7-2c7b5a7ca642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:45.380427 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:45.381015 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b6d95b-eec4-4cd0-84f7-2c7b5a7ca642 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:45.381284 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b6d95b-eec4-4cd0-84f7-2c7b5a7ca642 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:45.381599 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b6d95b-eec4-4cd0-84f7-2c7b5a7ca642 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:45.392859 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b6d95b-eec4-4cd0-84f7-2c7b5a7ca642 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:45.394437 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b6d95b-eec4-4cd0-84f7-2c7b5a7ca642 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:45.396111 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d500ddc9-6e7e-4409-be60-76aa6505b660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:45.396771 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d500ddc9-6e7e-4409-be60-76aa6505b660 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:45.397052 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d500ddc9-6e7e-4409-be60-76aa6505b660 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:45.397330 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d500ddc9-6e7e-4409-be60-76aa6505b660 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:45.413804 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-42b6d95b-eec4-4cd0-84f7-2c7b5a7ca642 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:45.413804 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:45.413804 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:45.413804 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:45.413804 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:45.413804 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:45.413804 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:45.413804 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:45.413804 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:45.413804 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:45.413804 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:45.413804 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:45.413804 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:40:45.413804 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:40:45.413804 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:40:45.415024 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:40:45.415024 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:45.415024 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:45.415024 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:45.415024 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:45.415024 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:45.415024 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:45.415024 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:45.415024 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:45.415024 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:45.415024 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:45.415024 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:45.415024 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:45.415024 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:45.415024 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:45.415024 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:45.415024 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:45.415958 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:40:45.415958 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:40:45.415958 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:45.415958 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:40:45.415958 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 404/811] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:40:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:45.416238 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b6d95b-eec4-4cd0-84f7-2c7b5a7ca642 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:45.479667 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d500ddc9-6e7e-4409-be60-76aa6505b660 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:45.481157 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d500ddc9-6e7e-4409-be60-76aa6505b660 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:45.521149 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b6d95b-eec4-4cd0-84f7-2c7b5a7ca642 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:45.557134 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebd86b3-6bd8-4b38-beab-d5a820fedea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:45.557975 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebd86b3-6bd8-4b38-beab-d5a820fedea5 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:45.558256 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebd86b3-6bd8-4b38-beab-d5a820fedea5 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:45.558528 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebd86b3-6bd8-4b38-beab-d5a820fedea5 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:45.559187 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebd86b3-6bd8-4b38-beab-d5a820fedea5 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:45.560823 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebd86b3-6bd8-4b38-beab-d5a820fedea5 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:45.574480 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-cebd86b3-6bd8-4b38-beab-d5a820fedea5 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 17:40:45.574480 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:45.574480 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 17:40:45.574480 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 17:40:45.574480 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 17:40:45.574480 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 17:40:45.574480 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 17:40:45.574480 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 17:40:45.574480 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 17:40:45.574480 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:40:45.574480 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 17:40:45.574480 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:40:45.574480 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:45.574480 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:45.574480 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:45.574480 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:45.575564 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:45.575564 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:45.575564 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:45.575564 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:45.575564 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:45.575564 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:45.575564 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:45.575564 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 17:40:45.575564 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 17:40:45.575564 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 17:40:45.575564 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 17:40:45.575564 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:45.575564 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:45.575564 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:45.575564 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:45.575564 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:45.576439 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:45.576439 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:45.576439 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:45.576439 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:45.576439 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:45.576439 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:45.576439 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:45.576439 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:45.576439 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:45.576439 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:45.576439 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:45.576439 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 17:40:45.576439 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 17:40:45.576439 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 17:40:45.576439 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:40:45.576439 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 405/812] 10.222.0.67 () {56 vars in 1129 bytes} [Thu Jul 14 17:40:45 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:45.577299 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebd86b3-6bd8-4b38-beab-d5a820fedea5 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:45.594607 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 408/813] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 14 17:40:45 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 17:40:45.595661 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d500ddc9-6e7e-4409-be60-76aa6505b660 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:45.619491 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:45.649056 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:45.707130 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebd86b3-6bd8-4b38-beab-d5a820fedea5 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:45.707812 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d500ddc9-6e7e-4409-be60-76aa6505b660 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:45.743125 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32275434-a35f-4fa8-81d7-4df35f33f473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:45.744174 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32275434-a35f-4fa8-81d7-4df35f33f473 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:45.744460 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32275434-a35f-4fa8-81d7-4df35f33f473 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:45.744732 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32275434-a35f-4fa8-81d7-4df35f33f473 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:45.745668 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a39edb0-7558-40e5-8107-7aa3fcdd1825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:45.746457 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a39edb0-7558-40e5-8107-7aa3fcdd1825 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:45.746743 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a39edb0-7558-40e5-8107-7aa3fcdd1825 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:45.747008 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a39edb0-7558-40e5-8107-7aa3fcdd1825 None admin] PATH_INFO: `/v3/services/network` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:45.747694 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a39edb0-7558-40e5-8107-7aa3fcdd1825 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:45.749104 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a39edb0-7558-40e5-8107-7aa3fcdd1825 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:45.753154 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32275434-a35f-4fa8-81d7-4df35f33f473 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:45.754641 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32275434-a35f-4fa8-81d7-4df35f33f473 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:45.763125 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-6a39edb0-7558-40e5-8107-7aa3fcdd1825 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 17:40:45.763125 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:45.763125 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 17:40:45.763125 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 17:40:45.763125 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 17:40:45.763125 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 17:40:45.763125 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 17:40:45.763125 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 17:40:45.763125 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 17:40:45.763125 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:40:45.763125 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 17:40:45.763125 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:40:45.763125 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:45.763125 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:45.763125 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:45.763125 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:45.763125 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:45.764191 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:45.764191 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:45.764191 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:45.764191 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:45.764191 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:45.764191 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:45.764191 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 17:40:45.764191 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 17:40:45.764191 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 17:40:45.764191 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 17:40:45.764191 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:45.764191 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:45.764191 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:45.764191 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:45.764191 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:45.764191 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:45.765077 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:45.765077 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:45.765077 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:45.765077 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:45.765077 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:45.765077 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:45.765077 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:45.765077 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:45.765077 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:45.765077 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:45.765077 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 17:40:45.765077 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 17:40:45.765077 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 17:40:45.765077 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:40:45.765077 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 406/814] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 14 17:40:45 2022] GET /identity/v3/services/network => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:45.765931 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a39edb0-7558-40e5-8107-7aa3fcdd1825 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:45.769092 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-32275434-a35f-4fa8-81d7-4df35f33f473 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:40:45.769092 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:45.769092 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:45.769092 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:45.769092 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:45.769092 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:45.769092 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:45.769092 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:45.769092 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:45.769092 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:45.769092 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:45.769092 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:45.769092 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 17:40:45.769092 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 17:40:45.769092 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 17:40:45.770043 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 17:40:45.770043 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:45.770043 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:45.770043 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:45.770043 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:45.770043 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:45.770043 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:45.770043 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:45.770043 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:45.770043 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:45.770043 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:45.770043 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:45.770043 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:45.770043 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:45.770043 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:45.770043 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:45.770043 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:45.770973 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 17:40:45.770973 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 17:40:45.770973 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 17:40:45.770973 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 17:40:45.770973 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 17:40:45.770973 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 17:40:45.770973 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:40:45.770973 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:40:45.773694 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 409/815] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 14 17:40:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:45.774624 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32275434-a35f-4fa8-81d7-4df35f33f473 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:45.865424 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:45.880106 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a39edb0-7558-40e5-8107-7aa3fcdd1825 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:45.887328 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32275434-a35f-4fa8-81d7-4df35f33f473 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:45.895280 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:45.921831 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59220e8f-b0f1-4bda-9990-57853bfc1e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:45.922408 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59220e8f-b0f1-4bda-9990-57853bfc1e42 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:45.922688 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59220e8f-b0f1-4bda-9990-57853bfc1e42 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:45.922960 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59220e8f-b0f1-4bda-9990-57853bfc1e42 None admin] PATH_INFO: `/v3/services` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:45.923675 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59220e8f-b0f1-4bda-9990-57853bfc1e42 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:45.923976 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59220e8f-b0f1-4bda-9990-57853bfc1e42 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:45.925339 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59220e8f-b0f1-4bda-9990-57853bfc1e42 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:45.926002 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f713289-535f-4dba-8ca1-8d9d647a5e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:45.926676 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f713289-535f-4dba-8ca1-8d9d647a5e66 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:45.926962 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f713289-535f-4dba-8ca1-8d9d647a5e66 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:45.927240 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f713289-535f-4dba-8ca1-8d9d647a5e66 None admin] PATH_INFO: `/v3/domains` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:45.927964 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f713289-535f-4dba-8ca1-8d9d647a5e66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:45.928267 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f713289-535f-4dba-8ca1-8d9d647a5e66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:45.930197 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f713289-535f-4dba-8ca1-8d9d647a5e66 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:45.931348 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 410/816] 10.222.0.67 () {56 vars in 1124 bytes} [Thu Jul 14 17:40:45 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:45.932062 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59220e8f-b0f1-4bda-9990-57853bfc1e42 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:45.942572 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 407/817] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 14 17:40:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:45.943461 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f713289-535f-4dba-8ca1-8d9d647a5e66 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:46.051768 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59220e8f-b0f1-4bda-9990-57853bfc1e42 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:46.053215 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f713289-535f-4dba-8ca1-8d9d647a5e66 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:46.088226 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c976450a-9214-4074-bdfd-8da527b52345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:46.088900 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c976450a-9214-4074-bdfd-8da527b52345 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:46.089190 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c976450a-9214-4074-bdfd-8da527b52345 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:46.089295 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1207fa83-3218-462a-94a5-a66b5cf31e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:46.089466 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c976450a-9214-4074-bdfd-8da527b52345 None admin] PATH_INFO: `/v3/services` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:46.090166 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1207fa83-3218-462a-94a5-a66b5cf31e4f None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:46.090298 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c976450a-9214-4074-bdfd-8da527b52345 None admin] RBAC: Adding query filter params (name=network) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:46.090505 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c976450a-9214-4074-bdfd-8da527b52345 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:46.090596 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1207fa83-3218-462a-94a5-a66b5cf31e4f None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:46.090923 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1207fa83-3218-462a-94a5-a66b5cf31e4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:46.091878 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c976450a-9214-4074-bdfd-8da527b52345 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:46.096837 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 408/818] 10.222.0.67 () {56 vars in 1112 bytes} [Thu Jul 14 17:40:45 2022] GET /identity/v3/services?name=network => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:46.097674 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c976450a-9214-4074-bdfd-8da527b52345 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:46.104501 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1207fa83-3218-462a-94a5-a66b5cf31e4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:46.106049 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1207fa83-3218-462a-94a5-a66b5cf31e4f None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:46.109273 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:46.126100 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-1207fa83-3218-462a-94a5-a66b5cf31e4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:46.126100 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:46.126100 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:46.126100 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:46.126100 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:46.126100 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:46.126100 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:46.126100 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:46.126100 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:46.126100 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:46.126100 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:46.126100 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:46.126100 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:40:46.126100 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:40:46.126100 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:40:46.127973 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:40:46.127973 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:46.127973 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:46.127973 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:46.127973 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:46.127973 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:46.127973 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:46.127973 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:46.127973 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:46.127973 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:46.127973 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:46.127973 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:46.127973 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:46.127973 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:46.127973 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:46.127973 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:46.127973 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:46.129722 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:40:46.129722 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:40:46.129722 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:46.129722 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:40:46.129722 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 411/819] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:40:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:46.129722 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1207fa83-3218-462a-94a5-a66b5cf31e4f None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:46.139739 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:46.210566 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c976450a-9214-4074-bdfd-8da527b52345 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:46.247288 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1207fa83-3218-462a-94a5-a66b5cf31e4f None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:46.247729 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73edefa4-583d-4196-b470-8c3b06b59a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:46.248399 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73edefa4-583d-4196-b470-8c3b06b59a19 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:46.248682 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73edefa4-583d-4196-b470-8c3b06b59a19 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:46.248993 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73edefa4-583d-4196-b470-8c3b06b59a19 None admin] PATH_INFO: `/v3/projects` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:46.249806 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73edefa4-583d-4196-b470-8c3b06b59a19 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:46.250108 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73edefa4-583d-4196-b470-8c3b06b59a19 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:46.251546 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73edefa4-583d-4196-b470-8c3b06b59a19 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:46.264696 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 409/820] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 14 17:40:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:46.265564 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73edefa4-583d-4196-b470-8c3b06b59a19 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:46.288154 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cda1e4-7811-4bad-97a3-53e30fa60b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:46.288836 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cda1e4-7811-4bad-97a3-53e30fa60b42 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:46.289116 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cda1e4-7811-4bad-97a3-53e30fa60b42 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:46.289389 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cda1e4-7811-4bad-97a3-53e30fa60b42 None admin] PATH_INFO: `/v3/services` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:46.290147 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cda1e4-7811-4bad-97a3-53e30fa60b42 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:46.290454 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cda1e4-7811-4bad-97a3-53e30fa60b42 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:46.291841 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cda1e4-7811-4bad-97a3-53e30fa60b42 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:46.296849 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 412/821] 10.222.0.67 () {56 vars in 1124 bytes} [Thu Jul 14 17:40:46 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:46.297676 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cda1e4-7811-4bad-97a3-53e30fa60b42 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:46.362957 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:46.381288 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:46.388250 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73edefa4-583d-4196-b470-8c3b06b59a19 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:46.408109 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cda1e4-7811-4bad-97a3-53e30fa60b42 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:46.424865 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0455494-7bf4-4355-a333-786b53c52451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:46.425698 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0455494-7bf4-4355-a333-786b53c52451 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:46.425978 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0455494-7bf4-4355-a333-786b53c52451 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:46.426250 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0455494-7bf4-4355-a333-786b53c52451 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:46.435045 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0455494-7bf4-4355-a333-786b53c52451 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:46.436484 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0455494-7bf4-4355-a333-786b53c52451 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:46.443388 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3482ae9-47af-4eb0-a01a-4505ac7aef71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:46.444054 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3482ae9-47af-4eb0-a01a-4505ac7aef71 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:46.444377 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3482ae9-47af-4eb0-a01a-4505ac7aef71 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:46.445180 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3482ae9-47af-4eb0-a01a-4505ac7aef71 None admin] PATH_INFO: `/v3/services` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:46.445930 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3482ae9-47af-4eb0-a01a-4505ac7aef71 None admin] RBAC: Adding query filter params (type=network) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:46.446240 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3482ae9-47af-4eb0-a01a-4505ac7aef71 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:46.447598 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3482ae9-47af-4eb0-a01a-4505ac7aef71 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:46.452066 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-c0455494-7bf4-4355-a333-786b53c52451 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:40:46.452066 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:46.452066 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:46.452066 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:46.452066 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:46.452066 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:46.452066 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:46.452066 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:46.452066 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:46.452066 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:46.452066 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:46.452066 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:46.452066 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 17:40:46.452066 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 17:40:46.452066 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 17:40:46.453110 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 17:40:46.453110 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:46.453110 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:46.453110 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:46.453110 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:46.453110 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:46.453110 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:46.453110 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:46.453110 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:46.453110 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:46.453110 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:46.453110 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:46.453110 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:46.453110 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:46.453110 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:46.453110 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:46.453110 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:46.454266 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 17:40:46.454266 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 17:40:46.454266 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 17:40:46.454266 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 17:40:46.454266 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 17:40:46.454266 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 17:40:46.454266 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:40:46.454266 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:40:46.454266 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 410/822] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 14 17:40:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:46.455100 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0455494-7bf4-4355-a333-786b53c52451 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:46.456241 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 413/823] 10.222.0.67 () {56 vars in 1112 bytes} [Thu Jul 14 17:40:46 2022] GET /identity/v3/services?type=network => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:46.457072 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3482ae9-47af-4eb0-a01a-4505ac7aef71 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:46.563228 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3482ae9-47af-4eb0-a01a-4505ac7aef71 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:46.567621 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0455494-7bf4-4355-a333-786b53c52451 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:46.589550 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:46.602081 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b27448-0ab4-4c22-b24c-9e836abfe55f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:46.602979 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b27448-0ab4-4c22-b24c-9e836abfe55f None admin] REQUEST_METHOD: `PUT` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:46.603259 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b27448-0ab4-4c22-b24c-9e836abfe55f None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:46.603535 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b27448-0ab4-4c22-b24c-9e836abfe55f None admin] PATH_INFO: `/v3/projects/39a570421bb64fac8b1a0129f1bcc7d9/users/c65607a396474192a43c374d306ef5ba/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:46.604010 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd0e359-4ce9-4212-a757-cab14c57d9ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:46.604674 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0e359-4ce9-4212-a757-cab14c57d9ff None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:46.604957 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0e359-4ce9-4212-a757-cab14c57d9ff None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:46.605230 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0e359-4ce9-4212-a757-cab14c57d9ff None admin] PATH_INFO: `/v3/domains` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:46.605553 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b27448-0ab4-4c22-b24c-9e836abfe55f None admin] RBAC: Authorizing `identity:create_grant(project_id=39a570421bb64fac8b1a0129f1bcc7d9, user_id=c65607a396474192a43c374d306ef5ba, role_id=4651a1cc7b4d4ab7a7a9ca1e77e58e71)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:46.605983 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd0e359-4ce9-4212-a757-cab14c57d9ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:46.606286 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd0e359-4ce9-4212-a757-cab14c57d9ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:46.607038 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b27448-0ab4-4c22-b24c-9e836abfe55f None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:46.607647 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd0e359-4ce9-4212-a757-cab14c57d9ff None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:46.622389 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 414/824] 10.222.0.67 () {58 vars in 1439 bytes} [Thu Jul 14 17:40:46 2022] PUT /identity/v3/projects/39a570421bb64fac8b1a0129f1bcc7d9/users/c65607a396474192a43c374d306ef5ba/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:40:46.623199 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b27448-0ab4-4c22-b24c-9e836abfe55f None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:46.627873 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 411/825] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 14 17:40:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:46.627873 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd0e359-4ce9-4212-a757-cab14c57d9ff None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:46.649230 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:46.767068 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd0e359-4ce9-4212-a757-cab14c57d9ff None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:46.780585 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b27448-0ab4-4c22-b24c-9e836abfe55f None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:46.823342 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff0b285-be23-4303-9384-4ebf07174f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:46.824020 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff0b285-be23-4303-9384-4ebf07174f87 None admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:46.824298 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff0b285-be23-4303-9384-4ebf07174f87 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:46.824576 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff0b285-be23-4303-9384-4ebf07174f87 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:46.824922 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f5b8e3-cd60-4bb9-b807-6644a2b047da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:46.825331 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff0b285-be23-4303-9384-4ebf07174f87 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:46.825616 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f5b8e3-cd60-4bb9-b807-6644a2b047da None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:46.825903 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f5b8e3-cd60-4bb9-b807-6644a2b047da None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:46.826177 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f5b8e3-cd60-4bb9-b807-6644a2b047da None admin] PATH_INFO: `/v3/projects` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:46.826743 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff0b285-be23-4303-9384-4ebf07174f87 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:46.826971 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f5b8e3-cd60-4bb9-b807-6644a2b047da None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:46.827277 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f5b8e3-cd60-4bb9-b807-6644a2b047da None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:46.828697 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f5b8e3-cd60-4bb9-b807-6644a2b047da None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:46.843081 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 412/826] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 14 17:40:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:46.844492 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f5b8e3-cd60-4bb9-b807-6644a2b047da None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:46.857727 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 415/827] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 14 17:40:46 2022] POST /identity/v3/endpoints => generated 346 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:40:46.859187 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff0b285-be23-4303-9384-4ebf07174f87 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:46.920271 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:46.953075 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:46.988737 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f5b8e3-cd60-4bb9-b807-6644a2b047da None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:47.024245 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff0b285-be23-4303-9384-4ebf07174f87 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:47.046917 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d30b95b-0ffd-4fa8-8285-7a007d4d5cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:47.047993 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d30b95b-0ffd-4fa8-8285-7a007d4d5cab None admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:47.048282 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d30b95b-0ffd-4fa8-8285-7a007d4d5cab None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:47.048945 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d30b95b-0ffd-4fa8-8285-7a007d4d5cab None admin] PATH_INFO: `/v3/endpoints` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:47.049429 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d30b95b-0ffd-4fa8-8285-7a007d4d5cab None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:47.056821 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d30b95b-0ffd-4fa8-8285-7a007d4d5cab None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:47.078799 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c966cc6d-c956-4cb2-b041-af78f91122b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:47.079626 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c966cc6d-c956-4cb2-b041-af78f91122b4 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:47.079931 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 413/828] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 14 17:40:46 2022] POST /identity/v3/endpoints => generated 327 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:40:47.080082 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c966cc6d-c956-4cb2-b041-af78f91122b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:47.080255 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c966cc6d-c956-4cb2-b041-af78f91122b4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:47.080777 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d30b95b-0ffd-4fa8-8285-7a007d4d5cab None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:47.088711 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c966cc6d-c956-4cb2-b041-af78f91122b4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:47.091486 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c966cc6d-c956-4cb2-b041-af78f91122b4 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:47.109248 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-c966cc6d-c956-4cb2-b041-af78f91122b4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:40:47.109248 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:47.109248 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:47.109248 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:47.109248 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:47.109248 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:47.109248 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:47.109248 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:47.109248 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:47.109248 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:47.109248 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:47.109248 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:47.109248 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 17:40:47.109248 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 17:40:47.109248 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 17:40:47.110337 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 17:40:47.110337 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:47.110337 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:47.110337 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:47.110337 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:47.110337 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:47.110337 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:47.110337 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:47.110337 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:47.110337 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:47.110337 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:47.110337 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:47.110337 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:47.110337 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:47.110337 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:47.110337 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:47.110337 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:47.111260 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 17:40:47.111260 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 17:40:47.111260 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 17:40:47.111260 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 17:40:47.111260 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 17:40:47.111260 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 17:40:47.111260 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:40:47.111260 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:40:47.111813 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 416/829] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 14 17:40:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:47.119136 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c966cc6d-c956-4cb2-b041-af78f91122b4 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:47.264034 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d30b95b-0ffd-4fa8-8285-7a007d4d5cab None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:47.281511 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c966cc6d-c956-4cb2-b041-af78f91122b4 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:47.298478 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:47.299603 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:47.309764 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cc21b1-a5b6-48ba-9bf2-fc2bd0fde132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:47.311152 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc21b1-a5b6-48ba-9bf2-fc2bd0fde132 None admin] REQUEST_METHOD: `PUT` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:47.312000 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc21b1-a5b6-48ba-9bf2-fc2bd0fde132 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:47.312372 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc21b1-a5b6-48ba-9bf2-fc2bd0fde132 None admin] PATH_INFO: `/v3/projects/39a570421bb64fac8b1a0129f1bcc7d9/users/45542602225b452fa323f5499c1843ec/roles/edc349453a61464087c153399e397247` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:47.330300 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a36aa88-a27c-47c0-88bc-89f99851c221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:47.331125 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a36aa88-a27c-47c0-88bc-89f99851c221 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:47.331483 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a36aa88-a27c-47c0-88bc-89f99851c221 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:47.331782 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a36aa88-a27c-47c0-88bc-89f99851c221 None admin] PATH_INFO: `/v3/projects` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:47.332491 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cc21b1-a5b6-48ba-9bf2-fc2bd0fde132 None admin] RBAC: Authorizing `identity:create_grant(project_id=39a570421bb64fac8b1a0129f1bcc7d9, user_id=45542602225b452fa323f5499c1843ec, role_id=edc349453a61464087c153399e397247)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:47.332613 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a36aa88-a27c-47c0-88bc-89f99851c221 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:47.332989 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a36aa88-a27c-47c0-88bc-89f99851c221 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:47.334352 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cc21b1-a5b6-48ba-9bf2-fc2bd0fde132 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:47.334573 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a36aa88-a27c-47c0-88bc-89f99851c221 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:47.349912 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 417/830] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 14 17:40:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:47.356462 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a36aa88-a27c-47c0-88bc-89f99851c221 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:47.362298 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 414/831] 10.222.0.67 () {58 vars in 1439 bytes} [Thu Jul 14 17:40:47 2022] PUT /identity/v3/projects/39a570421bb64fac8b1a0129f1bcc7d9/users/45542602225b452fa323f5499c1843ec/roles/edc349453a61464087c153399e397247 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:40:47.488015 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a36aa88-a27c-47c0-88bc-89f99851c221 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:47.533914 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6794cea3-d08f-4ea2-ac03-7e0d3c711278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:47.534338 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6794cea3-d08f-4ea2-ac03-7e0d3c711278 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:47.534752 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6794cea3-d08f-4ea2-ac03-7e0d3c711278 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:47.535124 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6794cea3-d08f-4ea2-ac03-7e0d3c711278 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:47.536084 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6794cea3-d08f-4ea2-ac03-7e0d3c711278 None admin] RBAC: Adding query filter params (role.id=4651a1cc7b4d4ab7a7a9ca1e77e58e71, scope.project.id=39a570421bb64fac8b1a0129f1bcc7d9, user.id=41b893bdf4ec474dbfa819c22fc29ce9) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:47.536497 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6794cea3-d08f-4ea2-ac03-7e0d3c711278 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:47.538148 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6794cea3-d08f-4ea2-ac03-7e0d3c711278 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:47.548186 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 418/832] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 14 17:40:47 2022] GET /identity/v3/role_assignments?user.id=41b893bdf4ec474dbfa819c22fc29ce9&scope.project.id=39a570421bb64fac8b1a0129f1bcc7d9&role.id=4651a1cc7b4d4ab7a7a9ca1e77e58e71 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:48.767779 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d431ec-741e-4e8c-9a52-484f3ef93ae5 None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:48.768286 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d431ec-741e-4e8c-9a52-484f3ef93ae5 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:48.768286 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d431ec-741e-4e8c-9a52-484f3ef93ae5 None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:48.769855 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 415/833] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:40:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:40:48.775767 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304568a1-37ee-4b67-bf6b-4eb9bc6a25ae None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:48.776193 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304568a1-37ee-4b67-bf6b-4eb9bc6a25ae None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:48.776367 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304568a1-37ee-4b67-bf6b-4eb9bc6a25ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:48.793809 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-304568a1-37ee-4b67-bf6b-4eb9bc6a25ae None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:40:48.795010 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-304568a1-37ee-4b67-bf6b-4eb9bc6a25ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:40:48.810067 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:48.862808 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 419/834] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:40:48 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 17:40:48.887026 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d431ec-741e-4e8c-9a52-484f3ef93ae5 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:48.997027 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d431ec-741e-4e8c-9a52-484f3ef93ae5 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:49.033398 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e6985e-a99b-4e12-8120-17cde429e597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:49.034160 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e6985e-a99b-4e12-8120-17cde429e597 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:49.034447 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e6985e-a99b-4e12-8120-17cde429e597 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:49.034729 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e6985e-a99b-4e12-8120-17cde429e597 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:49.045469 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e6985e-a99b-4e12-8120-17cde429e597 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:40:49.053664 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-d1e6985e-a99b-4e12-8120-17cde429e597 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 17:40:49.053664 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:49.053664 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:49.053664 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:49.053664 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:49.053664 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:49.053664 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:49.053664 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:49.053664 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:49.053664 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:49.053664 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:49.053664 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:49.053664 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:40:49.053664 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:40:49.053664 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:40:49.053664 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:40:49.054689 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:40:49.054689 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:40:49.054689 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:40:49.054689 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:40:49.054689 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:49.054689 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:49.054689 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:49.054689 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:49.054689 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:49.054689 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:49.054689 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:49.054689 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:49.054689 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:49.054689 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:49.054689 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:49.054689 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:49.055542 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:49.055542 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:49.055542 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:49.055542 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:49.055542 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:40:49.055542 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:40:49.055542 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:40:49.055542 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:40:49.055542 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:40:49.055542 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:40:49.055542 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 17:40:49.055542 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:40:49.055542 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 416/835] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 14 17:40:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:49.060945 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304568a1-37ee-4b67-bf6b-4eb9bc6a25ae None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:49.175560 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304568a1-37ee-4b67-bf6b-4eb9bc6a25ae None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:49.213093 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bcbdde-9b78-41ac-a8bd-4239ecfe08e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:49.213851 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bcbdde-9b78-41ac-a8bd-4239ecfe08e0 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:49.214135 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bcbdde-9b78-41ac-a8bd-4239ecfe08e0 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:49.214413 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bcbdde-9b78-41ac-a8bd-4239ecfe08e0 None admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:49.215177 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bcbdde-9b78-41ac-a8bd-4239ecfe08e0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:49.215489 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bcbdde-9b78-41ac-a8bd-4239ecfe08e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:49.216866 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bcbdde-9b78-41ac-a8bd-4239ecfe08e0 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:49.226199 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 420/836] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 14 17:40:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:49.231521 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e6985e-a99b-4e12-8120-17cde429e597 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:49.234676 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636953e0-fa4e-4307-ace8-6f0cb8aa102e None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:49.234969 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636953e0-fa4e-4307-ace8-6f0cb8aa102e None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:49.235256 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636953e0-fa4e-4307-ace8-6f0cb8aa102e None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:49.236606 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 421/837] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:40:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 17:40:49.241927 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b9d5c-a809-4179-a75c-553eb31bba4f None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:49.242259 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b9d5c-a809-4179-a75c-553eb31bba4f None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:49.242545 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b9d5c-a809-4179-a75c-553eb31bba4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:49.263521 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-d71b9d5c-a809-4179-a75c-553eb31bba4f None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:40:49.265390 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-d71b9d5c-a809-4179-a75c-553eb31bba4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:40:49.274794 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:49.280367 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:49.342952 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 422/838] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:40:49 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 17:40:49.347170 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e6985e-a99b-4e12-8120-17cde429e597 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:49.364707 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71b9d5c-a809-4179-a75c-553eb31bba4f None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:49.390304 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646feabd-a189-4575-9df0-cc50c9d0147f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:49.391115 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646feabd-a189-4575-9df0-cc50c9d0147f None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:49.391400 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646feabd-a189-4575-9df0-cc50c9d0147f None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:49.391678 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646feabd-a189-4575-9df0-cc50c9d0147f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:49.411165 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646feabd-a189-4575-9df0-cc50c9d0147f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:49.413236 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646feabd-a189-4575-9df0-cc50c9d0147f None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:49.438167 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-646feabd-a189-4575-9df0-cc50c9d0147f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:49.438167 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:49.438167 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:49.438167 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:49.438167 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:49.438167 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:49.438167 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:49.438167 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:49.438167 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:49.438167 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:49.438167 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:49.438167 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:49.438167 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:40:49.438167 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:40:49.438167 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:40:49.439128 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:40:49.439128 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:49.439128 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:49.439128 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:49.439128 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:49.439128 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:49.439128 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:49.439128 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:49.439128 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:49.439128 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:49.439128 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:49.439128 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:49.439128 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:49.439128 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:49.439128 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:49.439128 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:49.439128 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:49.440061 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:40:49.440061 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:40:49.440061 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:49.440061 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:40:49.441617 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 417/839] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:40:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:49.445657 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646feabd-a189-4575-9df0-cc50c9d0147f None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:49.482479 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71b9d5c-a809-4179-a75c-553eb31bba4f None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:49.526382 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc481163-a4b5-4492-ae4c-8f1b6da1be76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:49.527345 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc481163-a4b5-4492-ae4c-8f1b6da1be76 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:49.527633 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc481163-a4b5-4492-ae4c-8f1b6da1be76 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:49.527910 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc481163-a4b5-4492-ae4c-8f1b6da1be76 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:49.528852 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc481163-a4b5-4492-ae4c-8f1b6da1be76 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:49.530537 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc481163-a4b5-4492-ae4c-8f1b6da1be76 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:49.544836 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-fc481163-a4b5-4492-ae4c-8f1b6da1be76 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 17:40:49.544836 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:49.544836 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 17:40:49.544836 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 17:40:49.544836 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 17:40:49.544836 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 17:40:49.544836 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 17:40:49.544836 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 17:40:49.544836 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 17:40:49.544836 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:40:49.544836 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 17:40:49.544836 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:40:49.544836 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:49.544836 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:49.544836 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:49.544836 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:49.544836 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:49.546181 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:49.546181 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:49.546181 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:49.546181 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:49.546181 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:49.546181 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:49.546181 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 17:40:49.546181 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 17:40:49.546181 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 17:40:49.546181 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 17:40:49.546181 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:49.546181 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:49.546181 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:49.546181 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:49.546181 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:49.546181 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:49.547080 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:49.547080 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:49.547080 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:49.547080 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:49.547080 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:49.547080 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:49.547080 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:49.547080 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:49.547080 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:49.547080 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:49.547080 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 17:40:49.547080 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 17:40:49.547080 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 17:40:49.547080 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:40:49.550985 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 423/840] 10.222.0.67 () {56 vars in 1114 bytes} [Thu Jul 14 17:40:49 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 17:40:49.556782 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc481163-a4b5-4492-ae4c-8f1b6da1be76 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:49.567867 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:49.572806 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:49.586309 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646feabd-a189-4575-9df0-cc50c9d0147f None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:49.622518 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e3aa80-6685-405c-b869-bae17f445b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:49.623189 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e3aa80-6685-405c-b869-bae17f445b8b None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:49.623469 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e3aa80-6685-405c-b869-bae17f445b8b None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:49.623740 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e3aa80-6685-405c-b869-bae17f445b8b None admin] PATH_INFO: `/v3/domains` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:49.624463 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e3aa80-6685-405c-b869-bae17f445b8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:49.624767 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e3aa80-6685-405c-b869-bae17f445b8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:49.626178 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e3aa80-6685-405c-b869-bae17f445b8b None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:49.638640 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 418/841] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 14 17:40:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:49.639914 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10bd62e-6230-4b52-acb8-6dea330eebfb None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:49.640223 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10bd62e-6230-4b52-acb8-6dea330eebfb None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:49.640476 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10bd62e-6230-4b52-acb8-6dea330eebfb None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:49.642000 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 419/842] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:40:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:40:49.643649 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10bd62e-6230-4b52-acb8-6dea330eebfb None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:49.758760 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10bd62e-6230-4b52-acb8-6dea330eebfb None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:49.794275 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6e8132-416a-4ca4-a28f-3548aa063a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:49.795068 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e8132-416a-4ca4-a28f-3548aa063a06 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:49.795345 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e8132-416a-4ca4-a28f-3548aa063a06 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:49.795615 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e8132-416a-4ca4-a28f-3548aa063a06 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:49.799618 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc481163-a4b5-4492-ae4c-8f1b6da1be76 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:49.803401 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6e8132-416a-4ca4-a28f-3548aa063a06 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:49.805359 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6e8132-416a-4ca4-a28f-3548aa063a06 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:49.819947 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-3f6e8132-416a-4ca4-a28f-3548aa063a06 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 14 17:40:49.819947 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:49.819947 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:49.819947 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:49.819947 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:49.819947 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:49.819947 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:49.819947 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:49.819947 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:49.819947 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:49.819947 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:49.819947 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:49.819947 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 17:40:49.819947 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 17:40:49.819947 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 17:40:49.819947 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 17:40:49.820981 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:49.820981 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:49.820981 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 17:40:49.820981 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:40:49.820981 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 17:40:49.820981 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:40:49.820981 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:49.820981 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:49.820981 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:49.820981 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:49.820981 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:49.820981 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:49.820981 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:49.820981 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:49.820981 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:49.820981 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:49.820981 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:49.820981 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:49.821991 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:49.821991 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:49.821991 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 17:40:49.821991 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 17:40:49.821991 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 17:40:49.821991 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 17:40:49.821991 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 17:40:49.821991 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 17:40:49.821991 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 14 17:40:49.821991 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:40:49.825873 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 420/843] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 14 17:40:49 2022] GET /identity/v3/users/swift => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 17:40:49.827174 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d7e0b-9978-4e6a-bc51-49f1dc824649 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:49.827455 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d7e0b-9978-4e6a-bc51-49f1dc824649 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:49.827725 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d7e0b-9978-4e6a-bc51-49f1dc824649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:49.834336 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d490cd08-50d3-4ba9-8f11-93ba3f6a78b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:49.835066 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d490cd08-50d3-4ba9-8f11-93ba3f6a78b5 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:49.835346 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d490cd08-50d3-4ba9-8f11-93ba3f6a78b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:49.835625 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d490cd08-50d3-4ba9-8f11-93ba3f6a78b5 None admin] PATH_INFO: `/v3/services` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:49.836342 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d490cd08-50d3-4ba9-8f11-93ba3f6a78b5 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:49.836650 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d490cd08-50d3-4ba9-8f11-93ba3f6a78b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:49.838068 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d490cd08-50d3-4ba9-8f11-93ba3f6a78b5 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:49.842618 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 424/844] 10.222.0.67 () {56 vars in 1114 bytes} [Thu Jul 14 17:40:49 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:49.843791 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-773d7e0b-9978-4e6a-bc51-49f1dc824649 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:40:49.843917 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc348e9-fbc1-4301-92da-547d22aa2619 None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:49.844107 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc348e9-fbc1-4301-92da-547d22aa2619 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:49.844387 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc348e9-fbc1-4301-92da-547d22aa2619 None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:49.844966 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-773d7e0b-9978-4e6a-bc51-49f1dc824649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:40:49.849303 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 425/845] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:40:49 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:40:49.849303 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc348e9-fbc1-4301-92da-547d22aa2619 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:49.851205 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:49.915863 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 421/846] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:40:49 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 17:40:49.916714 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773d7e0b-9978-4e6a-bc51-49f1dc824649 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:49.922744 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:49.963426 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc348e9-fbc1-4301-92da-547d22aa2619 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:49.998317 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e1fa79-9c3a-462f-bf51-77496fe8efff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:49.998985 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e1fa79-9c3a-462f-bf51-77496fe8efff None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:49.999265 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e1fa79-9c3a-462f-bf51-77496fe8efff None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:49.999536 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e1fa79-9c3a-462f-bf51-77496fe8efff None admin] PATH_INFO: `/v3/users` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:50.000410 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e1fa79-9c3a-462f-bf51-77496fe8efff None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:50.000715 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e1fa79-9c3a-462f-bf51-77496fe8efff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:50.002221 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e1fa79-9c3a-462f-bf51-77496fe8efff None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:50.023741 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 426/847] 10.222.0.67 () {56 vars in 1135 bytes} [Thu Jul 14 17:40:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:50.023741 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49054e8-88e4-483e-ba8b-a794bb92043a None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:50.023741 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49054e8-88e4-483e-ba8b-a794bb92043a None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:50.023741 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49054e8-88e4-483e-ba8b-a794bb92043a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:50.026855 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773d7e0b-9978-4e6a-bc51-49f1dc824649 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:50.038964 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-e49054e8-88e4-483e-ba8b-a794bb92043a None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:40:50.040151 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-e49054e8-88e4-483e-ba8b-a794bb92043a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:40:50.069926 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd911ec-5508-4a9d-a815-b51fa003d571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:50.071088 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd911ec-5508-4a9d-a815-b51fa003d571 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:50.071593 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd911ec-5508-4a9d-a815-b51fa003d571 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:50.072103 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd911ec-5508-4a9d-a815-b51fa003d571 None admin] PATH_INFO: `/v3/services` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:50.073437 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd911ec-5508-4a9d-a815-b51fa003d571 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:50.074042 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd911ec-5508-4a9d-a815-b51fa003d571 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:50.076151 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd911ec-5508-4a9d-a815-b51fa003d571 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:50.081153 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 422/848] 10.222.0.67 () {56 vars in 1114 bytes} [Thu Jul 14 17:40:49 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:50.082024 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd911ec-5508-4a9d-a815-b51fa003d571 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:50.085821 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:50.129716 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 427/849] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:40:50 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 17:40:50.130701 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49054e8-88e4-483e-ba8b-a794bb92043a None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:50.200081 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:50.215454 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd911ec-5508-4a9d-a815-b51fa003d571 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:50.253061 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49054e8-88e4-483e-ba8b-a794bb92043a None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:50.258323 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64cabab-9abc-4162-bfb6-28d71790e199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:50.259718 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64cabab-9abc-4162-bfb6-28d71790e199 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:50.259718 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64cabab-9abc-4162-bfb6-28d71790e199 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:50.260938 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64cabab-9abc-4162-bfb6-28d71790e199 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:50.272934 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64cabab-9abc-4162-bfb6-28d71790e199 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:40:50.280928 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-c64cabab-9abc-4162-bfb6-28d71790e199 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 17:40:50.280928 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:50.280928 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:50.280928 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:50.280928 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:50.280928 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:50.280928 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:50.280928 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:50.280928 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:50.280928 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:50.280928 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:50.280928 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:50.280928 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:40:50.280928 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:40:50.280928 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:40:50.280928 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:40:50.282067 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:40:50.282067 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:40:50.282067 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:40:50.282067 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:40:50.282067 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:50.282067 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:50.282067 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:50.282067 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:50.282067 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:50.282067 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:50.282067 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:50.282067 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:50.282067 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:50.282067 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:50.282067 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:50.282067 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:50.282990 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:50.282990 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:50.282990 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:50.282990 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:50.282990 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:40:50.282990 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:40:50.282990 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:40:50.282990 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:40:50.282990 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:40:50.282990 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:40:50.282990 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 17:40:50.282990 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:40:50.282990 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 423/850] 10.222.0.67 () {56 vars in 1102 bytes} [Thu Jul 14 17:40:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:50.283801 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64cabab-9abc-4162-bfb6-28d71790e199 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:50.298850 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e0b53f-3236-4a15-9667-b66ad0ad680b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:50.299617 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e0b53f-3236-4a15-9667-b66ad0ad680b None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:50.299971 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e0b53f-3236-4a15-9667-b66ad0ad680b None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:50.300546 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e0b53f-3236-4a15-9667-b66ad0ad680b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:50.353830 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:50.371804 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e0b53f-3236-4a15-9667-b66ad0ad680b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:50.373307 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e0b53f-3236-4a15-9667-b66ad0ad680b None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:50.399695 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64cabab-9abc-4162-bfb6-28d71790e199 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:50.432210 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:50.438089 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e870f6-34d3-421f-a333-4234865bea9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:50.438920 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e870f6-34d3-421f-a333-4234865bea9c None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:50.439202 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e870f6-34d3-421f-a333-4234865bea9c None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:50.439483 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e870f6-34d3-421f-a333-4234865bea9c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:50.440146 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e870f6-34d3-421f-a333-4234865bea9c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:50.441545 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e870f6-34d3-421f-a333-4234865bea9c None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:50.457207 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-68e870f6-34d3-421f-a333-4234865bea9c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 17:40:50.457207 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:50.457207 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 17:40:50.457207 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 17:40:50.457207 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 17:40:50.457207 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 17:40:50.457207 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 17:40:50.457207 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 17:40:50.457207 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 17:40:50.457207 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:40:50.457207 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 17:40:50.457207 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:40:50.457207 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:50.457207 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:50.457207 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:50.457207 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:50.458308 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:50.458308 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:50.458308 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:50.458308 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:50.458308 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:50.458308 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:50.458308 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:50.458308 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 17:40:50.458308 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 17:40:50.458308 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 17:40:50.458308 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 17:40:50.458308 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:50.458308 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:50.458308 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:50.458308 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:50.458308 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:50.459208 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:50.459208 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:50.459208 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:50.459208 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:50.459208 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:50.459208 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:50.459208 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:50.459208 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:50.459208 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:50.459208 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:50.459208 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:50.459208 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 17:40:50.459208 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 17:40:50.459208 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 17:40:50.459208 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:40:50.460633 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 424/851] 10.222.0.67 () {56 vars in 1132 bytes} [Thu Jul 14 17:40:50 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:50.460712 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e870f6-34d3-421f-a333-4234865bea9c None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:50.488026 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 428/852] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 14 17:40:50 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 17:40:50.488026 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e0b53f-3236-4a15-9667-b66ad0ad680b None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:50.567799 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e870f6-34d3-421f-a333-4234865bea9c None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:50.598347 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:50.599284 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e0b53f-3236-4a15-9667-b66ad0ad680b None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:50.609214 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bcd459-2f79-412a-b773-7934d9eedb0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:50.610044 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bcd459-2f79-412a-b773-7934d9eedb0a None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:50.610327 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bcd459-2f79-412a-b773-7934d9eedb0a None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:50.610602 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bcd459-2f79-412a-b773-7934d9eedb0a None admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:50.611477 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bcd459-2f79-412a-b773-7934d9eedb0a None admin] RBAC: Adding query filter params (name=service) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:50.611783 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bcd459-2f79-412a-b773-7934d9eedb0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:50.613241 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bcd459-2f79-412a-b773-7934d9eedb0a None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:50.627780 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 425/853] 10.222.0.67 () {56 vars in 1103 bytes} [Thu Jul 14 17:40:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:50.627780 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bcd459-2f79-412a-b773-7934d9eedb0a None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:50.642044 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3accceb9-b130-4ee0-b46e-852d426fca84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:50.642715 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3accceb9-b130-4ee0-b46e-852d426fca84 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:50.642997 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3accceb9-b130-4ee0-b46e-852d426fca84 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:50.643276 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3accceb9-b130-4ee0-b46e-852d426fca84 None admin] PATH_INFO: `/v3/services` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:50.643987 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3accceb9-b130-4ee0-b46e-852d426fca84 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:50.644291 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3accceb9-b130-4ee0-b46e-852d426fca84 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:50.645677 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3accceb9-b130-4ee0-b46e-852d426fca84 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:50.650984 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 429/854] 10.222.0.67 () {56 vars in 1126 bytes} [Thu Jul 14 17:40:50 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:50.651785 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3accceb9-b130-4ee0-b46e-852d426fca84 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:50.678786 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:50.737730 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bcd459-2f79-412a-b773-7934d9eedb0a None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:50.760958 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3accceb9-b130-4ee0-b46e-852d426fca84 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:50.775462 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d749527-81b9-4743-9209-c2fc4d8f7302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:50.776501 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d749527-81b9-4743-9209-c2fc4d8f7302 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:50.776924 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d749527-81b9-4743-9209-c2fc4d8f7302 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:50.777344 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d749527-81b9-4743-9209-c2fc4d8f7302 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:50.789974 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d749527-81b9-4743-9209-c2fc4d8f7302 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:50.791890 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d749527-81b9-4743-9209-c2fc4d8f7302 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:50.796309 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404e83a4-4231-4d64-8b14-149cddff0c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:50.797111 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e83a4-4231-4d64-8b14-149cddff0c73 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:50.797393 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e83a4-4231-4d64-8b14-149cddff0c73 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:50.797702 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e83a4-4231-4d64-8b14-149cddff0c73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:50.808491 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404e83a4-4231-4d64-8b14-149cddff0c73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:50.809973 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404e83a4-4231-4d64-8b14-149cddff0c73 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:50.812895 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-6d749527-81b9-4743-9209-c2fc4d8f7302 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:50.812895 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:50.812895 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:50.812895 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:50.812895 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:50.812895 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:50.812895 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:50.812895 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:50.812895 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:50.812895 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:50.812895 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:50.812895 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:50.812895 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:40:50.812895 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:40:50.812895 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:40:50.814268 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:40:50.814268 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:50.814268 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:50.814268 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:50.814268 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:50.814268 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:50.814268 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:50.814268 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:50.814268 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:50.814268 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:50.814268 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:50.814268 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:50.814268 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:50.814268 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:50.814268 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:50.814268 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:50.814268 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:50.815372 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:40:50.815372 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:40:50.815372 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:50.815372 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:40:50.817131 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 426/855] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:40:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:50.818166 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d749527-81b9-4743-9209-c2fc4d8f7302 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:50.832915 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-404e83a4-4231-4d64-8b14-149cddff0c73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:50.832915 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:50.832915 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:50.832915 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:50.832915 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:50.832915 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:50.832915 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:50.832915 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:50.832915 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:50.832915 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:50.832915 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:50.832915 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:50.832915 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:40:50.832915 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:40:50.832915 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:40:50.834095 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:40:50.834095 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:50.834095 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:50.834095 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:50.834095 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:50.834095 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:50.834095 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:50.834095 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:50.834095 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:50.834095 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:50.834095 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:50.834095 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:50.834095 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:50.834095 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:50.834095 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:50.834095 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:50.834095 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:50.835047 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:40:50.835047 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:40:50.835047 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:50.835047 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:40:50.835047 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 430/856] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:40:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:50.835047 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404e83a4-4231-4d64-8b14-149cddff0c73 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:50.871436 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:50.919723 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:50.932680 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d749527-81b9-4743-9209-c2fc4d8f7302 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:50.949845 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404e83a4-4231-4d64-8b14-149cddff0c73 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:50.968759 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c056b3-46e7-4bfd-bbde-b705aaa75f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:50.969434 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c056b3-46e7-4bfd-bbde-b705aaa75f3e None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:50.969751 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c056b3-46e7-4bfd-bbde-b705aaa75f3e None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:50.970030 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c056b3-46e7-4bfd-bbde-b705aaa75f3e None admin] PATH_INFO: `/v3/services` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:50.970744 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c056b3-46e7-4bfd-bbde-b705aaa75f3e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:50.971054 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c056b3-46e7-4bfd-bbde-b705aaa75f3e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:50.972431 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c056b3-46e7-4bfd-bbde-b705aaa75f3e None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:50.989328 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e338f4-95a2-439f-bb72-d5ad6fa2bf8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:50.989721 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 427/857] 10.222.0.67 () {56 vars in 1126 bytes} [Thu Jul 14 17:40:50 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:50.990529 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e338f4-95a2-439f-bb72-d5ad6fa2bf8d None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:50.990710 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c056b3-46e7-4bfd-bbde-b705aaa75f3e None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:50.991255 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e338f4-95a2-439f-bb72-d5ad6fa2bf8d None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:50.991778 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e338f4-95a2-439f-bb72-d5ad6fa2bf8d None admin] PATH_INFO: `/v3/domains` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:50.992725 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e338f4-95a2-439f-bb72-d5ad6fa2bf8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:50.993221 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e338f4-95a2-439f-bb72-d5ad6fa2bf8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:50.995136 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e338f4-95a2-439f-bb72-d5ad6fa2bf8d None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:51.009681 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 431/858] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 14 17:40:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:51.015036 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e338f4-95a2-439f-bb72-d5ad6fa2bf8d None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:51.151540 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e338f4-95a2-439f-bb72-d5ad6fa2bf8d None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:51.155950 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c056b3-46e7-4bfd-bbde-b705aaa75f3e None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:51.165750 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:51.195580 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8654d84b-1c8b-4623-9a0a-41b64be97766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:51.196417 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8654d84b-1c8b-4623-9a0a-41b64be97766 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:51.196728 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8654d84b-1c8b-4623-9a0a-41b64be97766 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:51.196955 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8654d84b-1c8b-4623-9a0a-41b64be97766 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:51.203577 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34555003-e977-4389-b7da-8369faa58335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:51.204254 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34555003-e977-4389-b7da-8369faa58335 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:51.204537 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34555003-e977-4389-b7da-8369faa58335 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:51.204809 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34555003-e977-4389-b7da-8369faa58335 None admin] PATH_INFO: `/v3/domains` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:51.205588 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34555003-e977-4389-b7da-8369faa58335 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:51.205920 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34555003-e977-4389-b7da-8369faa58335 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:51.206069 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8654d84b-1c8b-4623-9a0a-41b64be97766 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:51.207298 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34555003-e977-4389-b7da-8369faa58335 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:51.207467 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8654d84b-1c8b-4623-9a0a-41b64be97766 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:51.208165 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:51.224295 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-8654d84b-1c8b-4623-9a0a-41b64be97766 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:40:51.224295 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:51.224295 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:51.224295 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:51.224295 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:51.224295 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:51.224295 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:51.224295 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:51.224295 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:51.224295 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:51.224295 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:51.224295 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:51.224295 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 17:40:51.224295 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 17:40:51.224295 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 17:40:51.225567 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 17:40:51.225567 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:51.225567 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:51.225567 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:51.225567 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:51.225567 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:51.225567 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:51.225567 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:51.225567 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:51.225567 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:51.225567 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:51.225567 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:51.225567 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:51.225567 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:51.225567 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:51.225567 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:51.225567 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:51.227035 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 17:40:51.227035 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 17:40:51.227035 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 17:40:51.227035 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 17:40:51.227035 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 17:40:51.227035 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 17:40:51.227035 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:40:51.227035 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:40:51.230956 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 432/859] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 14 17:40:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:51.231750 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 428/860] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 14 17:40:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:51.237591 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8654d84b-1c8b-4623-9a0a-41b64be97766 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:51.237791 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34555003-e977-4389-b7da-8369faa58335 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:51.345570 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8654d84b-1c8b-4623-9a0a-41b64be97766 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:51.381288 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34555003-e977-4389-b7da-8369faa58335 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:51.382503 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f8a4de-187d-4ca0-96a9-2ddffbe44968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:51.383222 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f8a4de-187d-4ca0-96a9-2ddffbe44968 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:51.383507 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f8a4de-187d-4ca0-96a9-2ddffbe44968 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:51.383780 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f8a4de-187d-4ca0-96a9-2ddffbe44968 None admin] PATH_INFO: `/v3/projects` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:51.384574 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f8a4de-187d-4ca0-96a9-2ddffbe44968 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:51.384879 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f8a4de-187d-4ca0-96a9-2ddffbe44968 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:51.386359 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f8a4de-187d-4ca0-96a9-2ddffbe44968 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:51.400299 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 433/861] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 14 17:40:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:51.410044 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f8a4de-187d-4ca0-96a9-2ddffbe44968 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:51.422282 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f808d4a8-6a4b-4c8e-88f0-e3f0e5884b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:51.423110 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f808d4a8-6a4b-4c8e-88f0-e3f0e5884b07 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:51.423814 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f808d4a8-6a4b-4c8e-88f0-e3f0e5884b07 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:51.424098 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f808d4a8-6a4b-4c8e-88f0-e3f0e5884b07 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:51.435308 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f808d4a8-6a4b-4c8e-88f0-e3f0e5884b07 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:51.437309 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f808d4a8-6a4b-4c8e-88f0-e3f0e5884b07 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:51.455911 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-f808d4a8-6a4b-4c8e-88f0-e3f0e5884b07 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 17:40:51.455911 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:51.455911 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:51.455911 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:51.455911 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:51.455911 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:51.455911 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:51.455911 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:51.455911 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:51.455911 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:51.455911 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:51.455911 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:51.455911 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 17:40:51.455911 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 17:40:51.455911 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 17:40:51.455911 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 17:40:51.457731 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:51.457731 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:51.457731 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 17:40:51.457731 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:40:51.457731 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 17:40:51.457731 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:40:51.457731 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:51.457731 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:51.457731 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:51.457731 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:51.457731 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:51.457731 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:51.457731 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:51.457731 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:51.457731 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:51.457731 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:51.457731 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:51.457731 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:51.459688 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:51.459688 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:51.459688 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 17:40:51.459688 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 17:40:51.459688 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 17:40:51.459688 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 17:40:51.459688 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 17:40:51.459688 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 17:40:51.459688 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 17:40:51.459688 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:40:51.459688 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 429/862] 10.222.0.67 () {56 vars in 1117 bytes} [Thu Jul 14 17:40:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 17:40:51.464378 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f808d4a8-6a4b-4c8e-88f0-e3f0e5884b07 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:51.482001 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:51.498545 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:51.532866 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f8a4de-187d-4ca0-96a9-2ddffbe44968 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:51.576262 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f808d4a8-6a4b-4c8e-88f0-e3f0e5884b07 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:51.579909 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bdd377-9d55-45f8-b6db-b375c0045c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:51.581347 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bdd377-9d55-45f8-b6db-b375c0045c83 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:51.581839 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bdd377-9d55-45f8-b6db-b375c0045c83 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:51.582260 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bdd377-9d55-45f8-b6db-b375c0045c83 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:51.583281 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bdd377-9d55-45f8-b6db-b375c0045c83 None admin] RBAC: Adding query filter params (role.id=4651a1cc7b4d4ab7a7a9ca1e77e58e71, scope.project.id=39a570421bb64fac8b1a0129f1bcc7d9, user.id=c65607a396474192a43c374d306ef5ba) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:51.583752 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bdd377-9d55-45f8-b6db-b375c0045c83 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:51.586228 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bdd377-9d55-45f8-b6db-b375c0045c83 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:51.601864 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 434/863] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 14 17:40:51 2022] GET /identity/v3/role_assignments?user.id=c65607a396474192a43c374d306ef5ba&scope.project.id=39a570421bb64fac8b1a0129f1bcc7d9&role.id=4651a1cc7b4d4ab7a7a9ca1e77e58e71 => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:51.622870 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e206a5b-21a7-4e1d-9e69-1ca6edaf59a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:51.623568 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e206a5b-21a7-4e1d-9e69-1ca6edaf59a9 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:51.623854 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e206a5b-21a7-4e1d-9e69-1ca6edaf59a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:51.624132 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e206a5b-21a7-4e1d-9e69-1ca6edaf59a9 None admin] PATH_INFO: `/v3/users` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:51.624984 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e206a5b-21a7-4e1d-9e69-1ca6edaf59a9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:51.625300 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e206a5b-21a7-4e1d-9e69-1ca6edaf59a9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:51.626808 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e206a5b-21a7-4e1d-9e69-1ca6edaf59a9 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:51.652130 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 430/864] 10.222.0.67 () {56 vars in 1149 bytes} [Thu Jul 14 17:40:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:40:51.653719 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bdd377-9d55-45f8-b6db-b375c0045c83 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:51.776551 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bdd377-9d55-45f8-b6db-b375c0045c83 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:51.795952 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:51.817197 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b43319-04ae-4798-a94b-19b83159955d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:51.817896 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b43319-04ae-4798-a94b-19b83159955d None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:51.818169 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b43319-04ae-4798-a94b-19b83159955d None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:51.818450 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b43319-04ae-4798-a94b-19b83159955d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:51.897782 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b43319-04ae-4798-a94b-19b83159955d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:51.899613 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b43319-04ae-4798-a94b-19b83159955d None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:52.016345 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 435/865] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 14 17:40:51 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 14 17:40:52.022014 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e206a5b-21a7-4e1d-9e69-1ca6edaf59a9 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:52.125057 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:52.143795 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e206a5b-21a7-4e1d-9e69-1ca6edaf59a9 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:52.180559 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df15bc1-9156-48e6-9e82-ce765dae8eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:52.181306 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df15bc1-9156-48e6-9e82-ce765dae8eb1 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:52.181629 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df15bc1-9156-48e6-9e82-ce765dae8eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:52.181910 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df15bc1-9156-48e6-9e82-ce765dae8eb1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:52.194425 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df15bc1-9156-48e6-9e82-ce765dae8eb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:52.196684 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df15bc1-9156-48e6-9e82-ce765dae8eb1 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:52.218795 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-9df15bc1-9156-48e6-9e82-ce765dae8eb1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:52.218795 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:52.218795 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:52.218795 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:52.218795 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:52.218795 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:52.218795 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:52.218795 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:52.218795 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:52.218795 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:52.218795 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:52.218795 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:52.218795 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:40:52.218795 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:40:52.218795 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:40:52.219800 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:40:52.219800 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:52.219800 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:52.219800 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:52.219800 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:52.219800 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:52.219800 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:52.219800 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:52.219800 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:52.219800 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:52.219800 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:52.219800 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:52.219800 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:52.219800 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:52.219800 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:52.219800 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:52.219800 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:52.220728 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:40:52.220728 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:40:52.220728 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:52.220728 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:40:52.220728 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 431/866] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:40:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:52.228272 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b43319-04ae-4798-a94b-19b83159955d None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:52.250115 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:52.342121 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b43319-04ae-4798-a94b-19b83159955d None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:52.378619 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d79bab9-00f5-4cc9-87e7-43cd670c20b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:52.379304 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d79bab9-00f5-4cc9-87e7-43cd670c20b0 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:52.379586 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d79bab9-00f5-4cc9-87e7-43cd670c20b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:52.379859 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d79bab9-00f5-4cc9-87e7-43cd670c20b0 None admin] PATH_INFO: `/v3/domains` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:52.380604 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d79bab9-00f5-4cc9-87e7-43cd670c20b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:52.380909 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d79bab9-00f5-4cc9-87e7-43cd670c20b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:52.382351 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d79bab9-00f5-4cc9-87e7-43cd670c20b0 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:52.391350 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f5c22-b754-4d81-bd67-6473b5a0bb4a None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:52.391632 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f5c22-b754-4d81-bd67-6473b5a0bb4a None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:52.391911 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f5c22-b754-4d81-bd67-6473b5a0bb4a None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:52.393550 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 432/867] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:40:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 17:40:52.394891 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 436/868] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 14 17:40:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:52.399300 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf64dfe-02a4-4ad1-8769-bf4992de5c51 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:52.399582 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf64dfe-02a4-4ad1-8769-bf4992de5c51 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:52.399853 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf64dfe-02a4-4ad1-8769-bf4992de5c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:52.402978 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d79bab9-00f5-4cc9-87e7-43cd670c20b0 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:52.426373 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-bbf64dfe-02a4-4ad1-8769-bf4992de5c51 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:40:52.427622 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-bbf64dfe-02a4-4ad1-8769-bf4992de5c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:40:52.514799 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:52.527441 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 433/869] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:40:52 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 17:40:52.543642 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d79bab9-00f5-4cc9-87e7-43cd670c20b0 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:52.550200 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf64dfe-02a4-4ad1-8769-bf4992de5c51 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:52.582559 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c6bb1d-0966-4bed-a1cc-defe39e0abe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:52.583698 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c6bb1d-0966-4bed-a1cc-defe39e0abe9 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:52.584149 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c6bb1d-0966-4bed-a1cc-defe39e0abe9 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:52.584682 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c6bb1d-0966-4bed-a1cc-defe39e0abe9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:52.592669 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c6bb1d-0966-4bed-a1cc-defe39e0abe9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:52.594368 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c6bb1d-0966-4bed-a1cc-defe39e0abe9 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:52.611249 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-e5c6bb1d-0966-4bed-a1cc-defe39e0abe9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:40:52.611249 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:52.611249 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:52.611249 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:52.611249 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:52.611249 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:52.611249 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:52.611249 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:52.611249 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:52.611249 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:52.611249 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:52.611249 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:52.611249 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 17:40:52.611249 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 17:40:52.611249 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 17:40:52.612419 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 17:40:52.612419 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:52.612419 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:52.612419 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:52.612419 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:52.612419 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:52.612419 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:52.612419 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:52.612419 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:52.612419 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:52.612419 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:52.612419 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:52.612419 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:52.612419 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:52.612419 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:52.612419 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:52.612419 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:52.613561 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 17:40:52.613561 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 17:40:52.613561 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 17:40:52.613561 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 17:40:52.613561 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 17:40:52.613561 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 17:40:52.613561 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:40:52.613561 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:40:52.621169 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 437/870] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 14 17:40:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:52.622677 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c6bb1d-0966-4bed-a1cc-defe39e0abe9 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:52.624634 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:52.661821 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf64dfe-02a4-4ad1-8769-bf4992de5c51 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:52.699636 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24208f94-8850-42bc-bde1-77c19f201460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:52.700324 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24208f94-8850-42bc-bde1-77c19f201460 None admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:52.700604 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24208f94-8850-42bc-bde1-77c19f201460 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:52.700874 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24208f94-8850-42bc-bde1-77c19f201460 None admin] PATH_INFO: `/v3/services` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:52.702006 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24208f94-8850-42bc-bde1-77c19f201460 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:52.703071 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24208f94-8850-42bc-bde1-77c19f201460 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:52.726516 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 434/871] 10.222.0.67 () {60 vars in 1141 bytes} [Thu Jul 14 17:40:52 2022] POST /identity/v3/services => generated 251 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 17:40:52.742707 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c6bb1d-0966-4bed-a1cc-defe39e0abe9 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:52.792628 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf131de-9a13-4a87-a220-97527e75911d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:52.793746 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf131de-9a13-4a87-a220-97527e75911d None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:52.794273 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf131de-9a13-4a87-a220-97527e75911d None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:52.794734 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf131de-9a13-4a87-a220-97527e75911d None admin] PATH_INFO: `/v3/projects` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:52.795870 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf131de-9a13-4a87-a220-97527e75911d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:52.796458 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf131de-9a13-4a87-a220-97527e75911d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:52.798381 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf131de-9a13-4a87-a220-97527e75911d None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:52.800749 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:52.817235 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 438/872] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 14 17:40:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:52.823765 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24208f94-8850-42bc-bde1-77c19f201460 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:52.954926 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24208f94-8850-42bc-bde1-77c19f201460 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:52.988428 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:53.001282 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80b8e8a-c30f-47f8-9650-64d7fdc61712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:53.002329 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80b8e8a-c30f-47f8-9650-64d7fdc61712 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:53.002841 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80b8e8a-c30f-47f8-9650-64d7fdc61712 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:53.003352 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80b8e8a-c30f-47f8-9650-64d7fdc61712 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:53.004268 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80b8e8a-c30f-47f8-9650-64d7fdc61712 None admin] RBAC: Adding query filter params (role.id=edc349453a61464087c153399e397247, scope.project.id=39a570421bb64fac8b1a0129f1bcc7d9, user.id=45542602225b452fa323f5499c1843ec) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:53.004671 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80b8e8a-c30f-47f8-9650-64d7fdc61712 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:53.006242 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80b8e8a-c30f-47f8-9650-64d7fdc61712 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:53.017577 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 435/873] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 14 17:40:52 2022] GET /identity/v3/role_assignments?user.id=45542602225b452fa323f5499c1843ec&scope.project.id=39a570421bb64fac8b1a0129f1bcc7d9&role.id=edc349453a61464087c153399e397247 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:40:53.244498 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c9c325-4feb-497d-bdac-b1046436b437 None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:53.244498 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c9c325-4feb-497d-bdac-b1046436b437 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:53.244498 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c9c325-4feb-497d-bdac-b1046436b437 None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:53.245282 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 439/874] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:40:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:40:53.250130 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac4904-5b56-4c4f-9bf0-b077c21a0848 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:53.250587 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac4904-5b56-4c4f-9bf0-b077c21a0848 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:53.250770 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac4904-5b56-4c4f-9bf0-b077c21a0848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:53.278201 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-52ac4904-5b56-4c4f-9bf0-b077c21a0848 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:40:53.279506 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-52ac4904-5b56-4c4f-9bf0-b077c21a0848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:40:53.357364 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 436/875] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:40:53 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 17:40:53.383323 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c9c325-4feb-497d-bdac-b1046436b437 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:53.503432 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c9c325-4feb-497d-bdac-b1046436b437 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:53.539223 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7147df-5163-4d9d-b840-7dd3ae3408f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:53.539906 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7147df-5163-4d9d-b840-7dd3ae3408f0 None admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:53.540194 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7147df-5163-4d9d-b840-7dd3ae3408f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:53.540477 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7147df-5163-4d9d-b840-7dd3ae3408f0 None admin] PATH_INFO: `/v3/services` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:53.541233 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7147df-5163-4d9d-b840-7dd3ae3408f0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:53.542656 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7147df-5163-4d9d-b840-7dd3ae3408f0 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:53.559520 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 440/876] 10.222.0.67 () {60 vars in 1141 bytes} [Thu Jul 14 17:40:53 2022] POST /identity/v3/services => generated 269 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:40:53.943199 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e6411-aa36-4f19-8bf2-8f19c5008219 None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:53.943606 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e6411-aa36-4f19-8bf2-8f19c5008219 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:53.943802 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e6411-aa36-4f19-8bf2-8f19c5008219 None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:53.946074 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 437/877] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:40:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:40:53.951675 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2858c9ef-c932-4301-8643-3a0066e560f1 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:53.954172 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2858c9ef-c932-4301-8643-3a0066e560f1 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:53.954172 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2858c9ef-c932-4301-8643-3a0066e560f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:53.970436 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-2858c9ef-c932-4301-8643-3a0066e560f1 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:40:53.971934 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-2858c9ef-c932-4301-8643-3a0066e560f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:40:54.023663 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:54.048807 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 441/878] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:40:53 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 17:40:54.071071 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6e6411-aa36-4f19-8bf2-8f19c5008219 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:54.184707 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6e6411-aa36-4f19-8bf2-8f19c5008219 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:54.206170 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:54.220866 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a456dc-27d1-427d-b8e5-10b24f91093e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:54.221705 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a456dc-27d1-427d-b8e5-10b24f91093e None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:54.221986 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a456dc-27d1-427d-b8e5-10b24f91093e None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:54.222259 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a456dc-27d1-427d-b8e5-10b24f91093e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:54.222910 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a456dc-27d1-427d-b8e5-10b24f91093e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:54.224270 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a456dc-27d1-427d-b8e5-10b24f91093e None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:54.237424 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-81a456dc-27d1-427d-b8e5-10b24f91093e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 17:40:54.237424 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:54.237424 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 17:40:54.237424 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 17:40:54.237424 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 17:40:54.237424 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 17:40:54.237424 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 17:40:54.237424 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 17:40:54.237424 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 17:40:54.237424 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:40:54.237424 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 17:40:54.237424 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:40:54.237424 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:54.237424 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:54.237424 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:54.237424 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:54.237424 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:54.238511 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:54.238511 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:54.238511 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:54.238511 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:54.238511 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:54.238511 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:54.238511 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 17:40:54.238511 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 17:40:54.238511 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 17:40:54.238511 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 17:40:54.238511 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:54.238511 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:54.238511 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:54.238511 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:54.238511 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:54.238511 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:54.239786 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:54.239786 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:54.239786 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:54.239786 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:54.239786 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:54.239786 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:54.239786 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:54.239786 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:54.239786 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:54.239786 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:54.239786 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 17:40:54.239786 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 17:40:54.239786 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 17:40:54.239786 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:40:54.239786 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 438/879] 10.222.0.67 () {56 vars in 1126 bytes} [Thu Jul 14 17:40:54 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:54.245857 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2858c9ef-c932-4301-8643-3a0066e560f1 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:54.347771 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2858c9ef-c932-4301-8643-3a0066e560f1 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:54.383328 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf07e763-41ba-46f8-8b8a-1d3e396b8779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:54.384009 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf07e763-41ba-46f8-8b8a-1d3e396b8779 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:54.384291 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf07e763-41ba-46f8-8b8a-1d3e396b8779 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:54.384571 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf07e763-41ba-46f8-8b8a-1d3e396b8779 None admin] PATH_INFO: `/v3/services` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:54.385292 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf07e763-41ba-46f8-8b8a-1d3e396b8779 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:54.385626 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf07e763-41ba-46f8-8b8a-1d3e396b8779 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:54.387010 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf07e763-41ba-46f8-8b8a-1d3e396b8779 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:54.392601 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 442/880] 10.222.0.67 () {56 vars in 1122 bytes} [Thu Jul 14 17:40:54 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:54.398517 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a456dc-27d1-427d-b8e5-10b24f91093e None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:54.509864 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a456dc-27d1-427d-b8e5-10b24f91093e None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:54.545578 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30713ba0-cbc4-4fdb-8411-7d1a55ae0b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:54.546258 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30713ba0-cbc4-4fdb-8411-7d1a55ae0b2e None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:54.546538 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30713ba0-cbc4-4fdb-8411-7d1a55ae0b2e None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:54.546808 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30713ba0-cbc4-4fdb-8411-7d1a55ae0b2e None admin] PATH_INFO: `/v3/services` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:54.547510 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30713ba0-cbc4-4fdb-8411-7d1a55ae0b2e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:54.547811 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30713ba0-cbc4-4fdb-8411-7d1a55ae0b2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:54.549164 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30713ba0-cbc4-4fdb-8411-7d1a55ae0b2e None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:54.554410 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 439/881] 10.222.0.67 () {56 vars in 1122 bytes} [Thu Jul 14 17:40:54 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:55.067010 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7412ec5-6b5d-4c34-991f-5d69e9480776 None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:55.068072 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7412ec5-6b5d-4c34-991f-5d69e9480776 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:55.068584 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7412ec5-6b5d-4c34-991f-5d69e9480776 None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:55.070674 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 443/882] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:40:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:40:55.076810 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762e1e65-9fb3-4d0a-bf8b-418277cbe5ae None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:55.077591 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762e1e65-9fb3-4d0a-bf8b-418277cbe5ae None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:55.078110 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762e1e65-9fb3-4d0a-bf8b-418277cbe5ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:55.096921 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-762e1e65-9fb3-4d0a-bf8b-418277cbe5ae None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:40:55.098623 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-762e1e65-9fb3-4d0a-bf8b-418277cbe5ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:40:55.149733 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:55.178100 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 440/883] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:40:55 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 17:40:55.201342 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7412ec5-6b5d-4c34-991f-5d69e9480776 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:55.250196 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:55.310856 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7412ec5-6b5d-4c34-991f-5d69e9480776 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:55.346709 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b3b5be-21ce-4592-ba6c-74ced5a3111e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:55.347469 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b3b5be-21ce-4592-ba6c-74ced5a3111e None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:55.347759 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b3b5be-21ce-4592-ba6c-74ced5a3111e None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:55.348034 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b3b5be-21ce-4592-ba6c-74ced5a3111e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:55.348687 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b3b5be-21ce-4592-ba6c-74ced5a3111e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:55.350103 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b3b5be-21ce-4592-ba6c-74ced5a3111e None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:55.362982 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-42b3b5be-21ce-4592-ba6c-74ced5a3111e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 17:40:55.362982 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:55.362982 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 17:40:55.362982 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 17:40:55.362982 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 17:40:55.362982 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 17:40:55.362982 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 17:40:55.362982 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 17:40:55.362982 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 17:40:55.362982 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:40:55.362982 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 17:40:55.362982 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:40:55.362982 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:55.362982 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:55.362982 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:55.362982 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:55.362982 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:55.364027 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:55.364027 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:55.364027 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:55.364027 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:55.364027 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:55.364027 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:55.364027 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 17:40:55.364027 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 17:40:55.364027 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 17:40:55.364027 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 17:40:55.364027 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:55.364027 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:55.364027 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:55.364027 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:55.364027 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:55.364027 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:55.364882 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:55.364882 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:55.364882 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:55.364882 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:55.364882 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:55.364882 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:55.364882 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:55.364882 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:55.364882 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:55.364882 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:55.364882 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 17:40:55.364882 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 17:40:55.364882 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 17:40:55.364882 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:40:55.364882 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 444/884] 10.222.0.67 () {56 vars in 1114 bytes} [Thu Jul 14 17:40:55 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:55.373560 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762e1e65-9fb3-4d0a-bf8b-418277cbe5ae None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:55.434250 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83edc4c1-faa4-4e3d-b4d1-05c9663e4295 None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:55.434583 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83edc4c1-faa4-4e3d-b4d1-05c9663e4295 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:55.434805 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83edc4c1-faa4-4e3d-b4d1-05c9663e4295 None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:55.436420 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 445/885] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:40:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:40:55.443805 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4487a2-1f5e-44b3-a7ee-426234394f12 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:55.444202 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4487a2-1f5e-44b3-a7ee-426234394f12 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:55.445196 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4487a2-1f5e-44b3-a7ee-426234394f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:55.466491 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-af4487a2-1f5e-44b3-a7ee-426234394f12 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:40:55.468232 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-af4487a2-1f5e-44b3-a7ee-426234394f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:40:55.491763 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762e1e65-9fb3-4d0a-bf8b-418277cbe5ae None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:55.531108 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dce78f5-d6e7-469f-b2ef-4fe14f672b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:55.532069 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce78f5-d6e7-469f-b2ef-4fe14f672b67 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:55.532559 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce78f5-d6e7-469f-b2ef-4fe14f672b67 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:55.533090 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce78f5-d6e7-469f-b2ef-4fe14f672b67 None admin] PATH_INFO: `/v3/services` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:55.534060 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dce78f5-d6e7-469f-b2ef-4fe14f672b67 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:55.534564 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dce78f5-d6e7-469f-b2ef-4fe14f672b67 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:55.536111 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dce78f5-d6e7-469f-b2ef-4fe14f672b67 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:55.546619 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 441/886] 10.222.0.67 () {56 vars in 1114 bytes} [Thu Jul 14 17:40:55 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:55.547865 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dce78f5-d6e7-469f-b2ef-4fe14f672b67 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:55.557607 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 446/887] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:40:55 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 17:40:55.582628 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4487a2-1f5e-44b3-a7ee-426234394f12 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:55.610022 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:55.630236 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:55.688779 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dce78f5-d6e7-469f-b2ef-4fe14f672b67 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:55.702476 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4487a2-1f5e-44b3-a7ee-426234394f12 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:55.730306 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47395cd4-a588-4f49-bb6f-26618a3dc7b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:55.731252 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47395cd4-a588-4f49-bb6f-26618a3dc7b5 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:55.731705 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47395cd4-a588-4f49-bb6f-26618a3dc7b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:55.732116 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47395cd4-a588-4f49-bb6f-26618a3dc7b5 None admin] PATH_INFO: `/v3/services` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:55.732996 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47395cd4-a588-4f49-bb6f-26618a3dc7b5 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:55.733304 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47395cd4-a588-4f49-bb6f-26618a3dc7b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:55.734715 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47395cd4-a588-4f49-bb6f-26618a3dc7b5 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:55.745918 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 442/888] 10.222.0.67 () {56 vars in 1114 bytes} [Thu Jul 14 17:40:55 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:55.745918 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e3a23-6665-4ef1-800a-45952872c719 None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:55.745918 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e3a23-6665-4ef1-800a-45952872c719 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:55.745918 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e3a23-6665-4ef1-800a-45952872c719 None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:55.745918 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 443/889] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:40:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:40:55.747923 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30e3a23-6665-4ef1-800a-45952872c719 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:55.750585 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd91575e-943a-4358-9895-04029edaec72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:55.751466 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd91575e-943a-4358-9895-04029edaec72 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:55.751749 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd91575e-943a-4358-9895-04029edaec72 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:55.752899 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd91575e-943a-4358-9895-04029edaec72 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:55.763784 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd91575e-943a-4358-9895-04029edaec72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:40:55.771973 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-fd91575e-943a-4358-9895-04029edaec72 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 17:40:55.771973 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:55.771973 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:55.771973 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:55.771973 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:55.771973 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:55.771973 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:55.771973 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:55.771973 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:55.771973 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:55.771973 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:55.771973 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:55.771973 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:40:55.771973 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:40:55.771973 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:40:55.771973 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:40:55.772965 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:40:55.772965 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:40:55.772965 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:40:55.772965 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:40:55.772965 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:55.772965 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:55.772965 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:55.772965 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:55.772965 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:55.772965 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:55.772965 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:55.772965 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:55.772965 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:55.772965 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:55.772965 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:55.772965 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:55.773862 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:55.773862 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:55.773862 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:55.773862 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:55.773862 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:40:55.773862 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:40:55.773862 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:40:55.773862 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:40:55.773862 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:40:55.773862 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:40:55.773862 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 17:40:55.773862 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:40:55.773862 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 447/890] 10.222.0.67 () {56 vars in 1120 bytes} [Thu Jul 14 17:40:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 17:40:55.774573 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625979b1-4a2d-419c-a2fb-c1b0079e8033 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:55.775134 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625979b1-4a2d-419c-a2fb-c1b0079e8033 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:55.775134 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625979b1-4a2d-419c-a2fb-c1b0079e8033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:55.792283 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-625979b1-4a2d-419c-a2fb-c1b0079e8033 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:40:55.793471 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-625979b1-4a2d-419c-a2fb-c1b0079e8033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:40:55.862379 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30e3a23-6665-4ef1-800a-45952872c719 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:55.865189 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 448/891] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:40:55 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 17:40:55.865952 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625979b1-4a2d-419c-a2fb-c1b0079e8033 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:55.876216 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:55.899872 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:55.912472 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8522ee7-41f5-4397-88e0-f4c91b635ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:55.913164 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8522ee7-41f5-4397-88e0-f4c91b635ced None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:55.913987 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8522ee7-41f5-4397-88e0-f4c91b635ced None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:55.914261 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8522ee7-41f5-4397-88e0-f4c91b635ced None admin] PATH_INFO: `/v3/endpoints` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:55.915490 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8522ee7-41f5-4397-88e0-f4c91b635ced None admin] RBAC: Adding query filter params (interface=public, service_id=aa375d8b041a4ef99083bf21df3b111b, region_id=RegionOne) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:55.915798 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8522ee7-41f5-4397-88e0-f4c91b635ced None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:55.917558 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8522ee7-41f5-4397-88e0-f4c91b635ced None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:55.923431 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 444/892] 10.222.0.67 () {56 vars in 1251 bytes} [Thu Jul 14 17:40:55 2022] GET /identity/v3/endpoints?service_id=aa375d8b041a4ef99083bf21df3b111b&interface=public®ion_id=RegionOne => generated 194 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:40:55.924051 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8522ee7-41f5-4397-88e0-f4c91b635ced None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:55.981855 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625979b1-4a2d-419c-a2fb-c1b0079e8033 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:56.018934 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68b500b-6b3f-42b0-b011-0dd6be0562f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:56.019881 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b500b-6b3f-42b0-b011-0dd6be0562f1 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:56.020163 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b500b-6b3f-42b0-b011-0dd6be0562f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:56.020435 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b500b-6b3f-42b0-b011-0dd6be0562f1 None admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:56.021175 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68b500b-6b3f-42b0-b011-0dd6be0562f1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:56.021478 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68b500b-6b3f-42b0-b011-0dd6be0562f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:56.023292 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68b500b-6b3f-42b0-b011-0dd6be0562f1 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:56.038092 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8522ee7-41f5-4397-88e0-f4c91b635ced None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:56.038272 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 449/893] 10.222.0.67 () {56 vars in 1115 bytes} [Thu Jul 14 17:40:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:56.038272 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68b500b-6b3f-42b0-b011-0dd6be0562f1 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:56.072033 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cbf284-f4e1-4532-bc0b-33bf79c99817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:56.072876 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cbf284-f4e1-4532-bc0b-33bf79c99817 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:56.073156 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cbf284-f4e1-4532-bc0b-33bf79c99817 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:56.073427 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cbf284-f4e1-4532-bc0b-33bf79c99817 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:56.074131 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cbf284-f4e1-4532-bc0b-33bf79c99817 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:56.075551 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cbf284-f4e1-4532-bc0b-33bf79c99817 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:56.090316 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-35cbf284-f4e1-4532-bc0b-33bf79c99817 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 17:40:56.090316 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:56.090316 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 17:40:56.090316 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 17:40:56.090316 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 17:40:56.090316 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 17:40:56.090316 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 17:40:56.090316 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 17:40:56.090316 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 17:40:56.090316 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:40:56.090316 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 17:40:56.090316 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:40:56.090316 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:56.090316 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:56.090316 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:56.090316 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:56.091422 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:56.091422 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:56.091422 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:56.091422 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:56.091422 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:56.091422 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:56.091422 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:56.091422 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 17:40:56.091422 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 17:40:56.091422 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 17:40:56.091422 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 17:40:56.091422 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:56.091422 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:56.091422 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:56.091422 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:56.091422 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:56.092278 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:56.092278 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:56.092278 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:56.092278 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:56.092278 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:56.092278 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:56.092278 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:56.092278 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:56.092278 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:56.092278 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:56.092278 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:56.092278 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 17:40:56.092278 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 17:40:56.092278 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 17:40:56.092278 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:40:56.092278 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 445/894] 10.222.0.67 () {56 vars in 1132 bytes} [Thu Jul 14 17:40:55 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:56.093153 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cbf284-f4e1-4532-bc0b-33bf79c99817 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:56.134501 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:56.155696 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:56.168119 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68b500b-6b3f-42b0-b011-0dd6be0562f1 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:56.206270 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50738654-155e-40df-bec2-8446bbe20493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:56.207376 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50738654-155e-40df-bec2-8446bbe20493 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:56.207952 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50738654-155e-40df-bec2-8446bbe20493 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:56.208297 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50738654-155e-40df-bec2-8446bbe20493 None admin] PATH_INFO: `/v3/services` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:56.208999 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50738654-155e-40df-bec2-8446bbe20493 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:56.210955 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50738654-155e-40df-bec2-8446bbe20493 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:56.211348 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cbf284-f4e1-4532-bc0b-33bf79c99817 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:56.225599 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 450/895] 10.222.0.67 () {56 vars in 1087 bytes} [Thu Jul 14 17:40:56 2022] GET /identity/v3/services => generated 1268 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:40:56.225599 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50738654-155e-40df-bec2-8446bbe20493 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:56.263498 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde37630-1cb3-4ce8-b913-603a6506604b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:56.264443 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde37630-1cb3-4ce8-b913-603a6506604b None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:56.264770 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde37630-1cb3-4ce8-b913-603a6506604b None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:56.265048 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde37630-1cb3-4ce8-b913-603a6506604b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:56.279175 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde37630-1cb3-4ce8-b913-603a6506604b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:56.280705 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde37630-1cb3-4ce8-b913-603a6506604b None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:56.301951 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-bde37630-1cb3-4ce8-b913-603a6506604b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:56.301951 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:56.301951 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:56.301951 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:56.301951 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:56.301951 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:56.301951 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:56.301951 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:56.301951 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:56.301951 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:56.301951 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:56.301951 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:56.301951 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:40:56.301951 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:40:56.301951 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:40:56.302999 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:40:56.302999 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:56.302999 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:56.302999 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:56.302999 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:56.302999 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:56.302999 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:56.302999 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:56.302999 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:56.302999 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:56.302999 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:56.302999 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:56.302999 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:56.302999 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:56.302999 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:56.302999 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:56.302999 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:56.303977 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:40:56.303977 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:40:56.303977 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:56.303977 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:40:56.303977 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 446/896] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:40:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:56.309127 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde37630-1cb3-4ce8-b913-603a6506604b None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:56.362771 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50738654-155e-40df-bec2-8446bbe20493 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:56.411177 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899dafeb-bcd4-4ae2-b446-f73427634f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:56.411784 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899dafeb-bcd4-4ae2-b446-f73427634f5b None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:56.412067 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899dafeb-bcd4-4ae2-b446-f73427634f5b None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:56.412342 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899dafeb-bcd4-4ae2-b446-f73427634f5b None admin] PATH_INFO: `/v3/services` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:56.413289 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899dafeb-bcd4-4ae2-b446-f73427634f5b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:56.414196 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899dafeb-bcd4-4ae2-b446-f73427634f5b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:56.416625 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899dafeb-bcd4-4ae2-b446-f73427634f5b None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:56.419040 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:56.425883 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 451/897] 10.222.0.67 () {56 vars in 1126 bytes} [Thu Jul 14 17:40:56 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:56.430388 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899dafeb-bcd4-4ae2-b446-f73427634f5b None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:56.445573 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde37630-1cb3-4ce8-b913-603a6506604b None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:56.454889 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:56.502384 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcf65a2-5e94-455e-bbc1-12aa69e1d361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:56.504622 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf65a2-5e94-455e-bbc1-12aa69e1d361 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:56.505135 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf65a2-5e94-455e-bbc1-12aa69e1d361 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:56.505983 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf65a2-5e94-455e-bbc1-12aa69e1d361 None admin] PATH_INFO: `/v3/domains` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:56.507123 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcf65a2-5e94-455e-bbc1-12aa69e1d361 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:56.508356 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcf65a2-5e94-455e-bbc1-12aa69e1d361 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:56.510495 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcf65a2-5e94-455e-bbc1-12aa69e1d361 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:56.534685 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 447/898] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 14 17:40:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:56.542295 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcf65a2-5e94-455e-bbc1-12aa69e1d361 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:56.567270 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899dafeb-bcd4-4ae2-b446-f73427634f5b None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:56.609583 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba95e65-7f19-421a-8019-ee3c600f2c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:56.610260 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba95e65-7f19-421a-8019-ee3c600f2c5d None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:56.610540 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba95e65-7f19-421a-8019-ee3c600f2c5d None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:56.610811 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba95e65-7f19-421a-8019-ee3c600f2c5d None admin] PATH_INFO: `/v3/services` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:56.611536 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba95e65-7f19-421a-8019-ee3c600f2c5d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:56.611836 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba95e65-7f19-421a-8019-ee3c600f2c5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:56.613552 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba95e65-7f19-421a-8019-ee3c600f2c5d None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:56.625571 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 452/899] 10.222.0.67 () {56 vars in 1126 bytes} [Thu Jul 14 17:40:56 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:56.628557 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba95e65-7f19-421a-8019-ee3c600f2c5d None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:56.695457 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcf65a2-5e94-455e-bbc1-12aa69e1d361 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:56.735868 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:56.742629 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79667df1-c007-41e2-93c9-6c769b7e3393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:56.743829 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79667df1-c007-41e2-93c9-6c769b7e3393 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:56.744607 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79667df1-c007-41e2-93c9-6c769b7e3393 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:56.744959 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79667df1-c007-41e2-93c9-6c769b7e3393 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:56.753037 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79667df1-c007-41e2-93c9-6c769b7e3393 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:56.754591 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79667df1-c007-41e2-93c9-6c769b7e3393 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:56.755814 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba95e65-7f19-421a-8019-ee3c600f2c5d None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:56.769941 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-79667df1-c007-41e2-93c9-6c769b7e3393 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 17:40:56.769941 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:56.769941 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:56.769941 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:56.769941 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:56.769941 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:56.769941 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:56.769941 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:56.769941 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:56.769941 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:56.769941 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:56.769941 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:56.769941 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 17:40:56.769941 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 17:40:56.769941 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 17:40:56.769941 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 17:40:56.770950 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:56.770950 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:56.770950 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 17:40:56.770950 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:40:56.770950 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 17:40:56.770950 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:40:56.770950 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:56.770950 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:56.770950 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:56.770950 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:56.770950 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:56.770950 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:56.770950 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:56.770950 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:56.770950 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:56.770950 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:56.770950 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:56.770950 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:56.771924 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:56.771924 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:56.771924 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 17:40:56.771924 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 17:40:56.771924 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 17:40:56.771924 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 17:40:56.771924 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 17:40:56.771924 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 17:40:56.771924 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 17:40:56.771924 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:40:56.773688 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 448/900] 10.222.0.67 () {56 vars in 1117 bytes} [Thu Jul 14 17:40:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 17:40:56.775341 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b10dbd-2a26-486f-b0fb-6aa9ac8af811 None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:56.776910 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b10dbd-2a26-486f-b0fb-6aa9ac8af811 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:56.777195 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b10dbd-2a26-486f-b0fb-6aa9ac8af811 None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:56.778690 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 449/901] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:40:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:40:56.785554 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b10dbd-2a26-486f-b0fb-6aa9ac8af811 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:56.793494 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:56.807581 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1155dd25-b960-4938-af62-a6f290bc5219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:56.808240 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1155dd25-b960-4938-af62-a6f290bc5219 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:56.808969 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1155dd25-b960-4938-af62-a6f290bc5219 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:56.809254 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1155dd25-b960-4938-af62-a6f290bc5219 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:56.810253 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1155dd25-b960-4938-af62-a6f290bc5219 None admin] RBAC: Adding query filter params (interface=public, service_id=b260743fd13d4a7e9fc3d56b97d2dda6, region_id=RegionOne) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:56.810574 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1155dd25-b960-4938-af62-a6f290bc5219 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:56.811949 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1155dd25-b960-4938-af62-a6f290bc5219 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:56.817145 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 453/902] 10.222.0.67 () {56 vars in 1251 bytes} [Thu Jul 14 17:40:56 2022] GET /identity/v3/endpoints?service_id=b260743fd13d4a7e9fc3d56b97d2dda6&interface=public®ion_id=RegionOne => generated 194 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:40:56.817145 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c073c8ad-f487-4256-8f23-b15bd72e3788 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:56.817145 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c073c8ad-f487-4256-8f23-b15bd72e3788 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:56.817145 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c073c8ad-f487-4256-8f23-b15bd72e3788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:56.835701 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-c073c8ad-f487-4256-8f23-b15bd72e3788 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:40:56.837248 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-c073c8ad-f487-4256-8f23-b15bd72e3788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:40:56.900806 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b10dbd-2a26-486f-b0fb-6aa9ac8af811 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:56.905723 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 454/903] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:40:56 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 17:40:56.909349 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c073c8ad-f487-4256-8f23-b15bd72e3788 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:56.939240 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b401c8-a697-49fd-9f92-d13e09f33e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:56.940019 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b401c8-a697-49fd-9f92-d13e09f33e16 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:56.940306 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b401c8-a697-49fd-9f92-d13e09f33e16 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:56.940584 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b401c8-a697-49fd-9f92-d13e09f33e16 None admin] PATH_INFO: `/v3/users` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:56.941424 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b401c8-a697-49fd-9f92-d13e09f33e16 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:56.941777 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b401c8-a697-49fd-9f92-d13e09f33e16 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:56.943209 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b401c8-a697-49fd-9f92-d13e09f33e16 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:56.963317 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 450/904] 10.222.0.67 () {56 vars in 1149 bytes} [Thu Jul 14 17:40:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:56.964493 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b401c8-a697-49fd-9f92-d13e09f33e16 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:57.002124 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:57.028662 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:57.029870 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c073c8ad-f487-4256-8f23-b15bd72e3788 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:57.066576 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f0d120-74e1-4375-9338-e69278aa9f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:57.067243 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f0d120-74e1-4375-9338-e69278aa9f96 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:57.067530 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f0d120-74e1-4375-9338-e69278aa9f96 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:57.067810 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f0d120-74e1-4375-9338-e69278aa9f96 None admin] PATH_INFO: `/v3/services` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:57.068498 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f0d120-74e1-4375-9338-e69278aa9f96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:57.069937 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f0d120-74e1-4375-9338-e69278aa9f96 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:57.071159 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b401c8-a697-49fd-9f92-d13e09f33e16 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:57.075824 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 455/905] 10.222.0.67 () {56 vars in 1087 bytes} [Thu Jul 14 17:40:56 2022] GET /identity/v3/services => generated 1268 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:40:57.076521 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f0d120-74e1-4375-9338-e69278aa9f96 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:57.114766 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab33f2d-f67e-4499-838e-47ca566d2fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:57.115919 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab33f2d-f67e-4499-838e-47ca566d2fa5 None admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:57.116406 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab33f2d-f67e-4499-838e-47ca566d2fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:57.117407 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab33f2d-f67e-4499-838e-47ca566d2fa5 None admin] PATH_INFO: `/v3/services` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:57.118499 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab33f2d-f67e-4499-838e-47ca566d2fa5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:57.120391 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab33f2d-f67e-4499-838e-47ca566d2fa5 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:57.145605 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 451/906] 10.222.0.67 () {60 vars in 1141 bytes} [Thu Jul 14 17:40:56 2022] POST /identity/v3/services => generated 241 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:40:57.202138 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f0d120-74e1-4375-9338-e69278aa9f96 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:57.251778 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e744f956-f61e-4ef8-a013-160ae464ef30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:57.252367 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e744f956-f61e-4ef8-a013-160ae464ef30 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:57.252654 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e744f956-f61e-4ef8-a013-160ae464ef30 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:57.252937 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e744f956-f61e-4ef8-a013-160ae464ef30 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:57.256884 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:57.327981 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e744f956-f61e-4ef8-a013-160ae464ef30 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:57.329432 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e744f956-f61e-4ef8-a013-160ae464ef30 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:57.435690 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 456/907] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 14 17:40:57 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 17:40:57.441118 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab33f2d-f67e-4499-838e-47ca566d2fa5 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:57.558218 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab33f2d-f67e-4499-838e-47ca566d2fa5 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:57.583111 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:57.595447 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad42e46-9de7-4145-afc9-ac9c68ec8696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:57.596623 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad42e46-9de7-4145-afc9-ac9c68ec8696 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:57.597402 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad42e46-9de7-4145-afc9-ac9c68ec8696 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:57.597728 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad42e46-9de7-4145-afc9-ac9c68ec8696 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:57.609836 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad42e46-9de7-4145-afc9-ac9c68ec8696 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:57.611381 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad42e46-9de7-4145-afc9-ac9c68ec8696 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:57.630132 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-cad42e46-9de7-4145-afc9-ac9c68ec8696 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:57.630132 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:57.630132 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:57.630132 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:57.630132 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:57.630132 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:57.630132 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:57.630132 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:57.630132 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:57.630132 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:57.630132 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:57.630132 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:57.630132 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:40:57.630132 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:40:57.630132 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:40:57.631094 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:40:57.631094 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:57.631094 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:57.631094 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:57.631094 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:57.631094 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:57.631094 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:57.631094 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:57.631094 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:57.631094 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:57.631094 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:57.631094 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:57.631094 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:57.631094 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:57.631094 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:57.631094 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:57.631094 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:57.632024 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:40:57.632024 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:40:57.632024 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:40:57.632024 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:40:57.632024 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 452/908] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:40:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:57.637332 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e744f956-f61e-4ef8-a013-160ae464ef30 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:57.675330 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:57.748203 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e744f956-f61e-4ef8-a013-160ae464ef30 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:57.789192 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8472b45-5a70-4195-b169-75f7f2c8094a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:57.789888 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8472b45-5a70-4195-b169-75f7f2c8094a None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:57.790175 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8472b45-5a70-4195-b169-75f7f2c8094a None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:57.790449 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8472b45-5a70-4195-b169-75f7f2c8094a None admin] PATH_INFO: `/v3/domains` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:57.791181 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8472b45-5a70-4195-b169-75f7f2c8094a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:57.791487 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8472b45-5a70-4195-b169-75f7f2c8094a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:57.792859 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8472b45-5a70-4195-b169-75f7f2c8094a None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:57.805605 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 457/909] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 14 17:40:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:57.811105 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad42e46-9de7-4145-afc9-ac9c68ec8696 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:57.920040 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad42e46-9de7-4145-afc9-ac9c68ec8696 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:57.956164 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51f18f7-42e8-4448-a2d8-6fb6dff2fed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:57.957332 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51f18f7-42e8-4448-a2d8-6fb6dff2fed8 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:57.957851 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51f18f7-42e8-4448-a2d8-6fb6dff2fed8 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:57.958366 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51f18f7-42e8-4448-a2d8-6fb6dff2fed8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:57.966366 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51f18f7-42e8-4448-a2d8-6fb6dff2fed8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:57.968074 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51f18f7-42e8-4448-a2d8-6fb6dff2fed8 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:57.983279 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-d51f18f7-42e8-4448-a2d8-6fb6dff2fed8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:40:57.983279 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:57.983279 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:57.983279 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:57.983279 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:57.983279 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:57.983279 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:57.983279 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:57.983279 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:57.983279 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:57.983279 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:57.983279 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:57.983279 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 17:40:57.983279 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 17:40:57.983279 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 17:40:57.984222 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 17:40:57.984222 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:57.984222 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:57.984222 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:57.984222 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:57.984222 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:57.984222 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:57.984222 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:57.984222 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:57.984222 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:57.984222 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:57.984222 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:57.984222 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:57.984222 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:57.984222 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:57.984222 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:57.984222 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:57.985178 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 17:40:57.985178 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 17:40:57.985178 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 17:40:57.985178 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 17:40:57.985178 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 17:40:57.985178 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 17:40:57.985178 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:40:57.985178 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:40:57.987652 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 453/910] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 14 17:40:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:57.993572 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8472b45-5a70-4195-b169-75f7f2c8094a None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:58.092596 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:58.100546 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8472b45-5a70-4195-b169-75f7f2c8094a None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:58.136605 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e904bb-2c9d-4945-a435-defc6e9754cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:58.137690 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e904bb-2c9d-4945-a435-defc6e9754cc None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:58.138181 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e904bb-2c9d-4945-a435-defc6e9754cc None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:58.138698 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e904bb-2c9d-4945-a435-defc6e9754cc None admin] PATH_INFO: `/v3/projects` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:58.144985 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e904bb-2c9d-4945-a435-defc6e9754cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:58.145588 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e904bb-2c9d-4945-a435-defc6e9754cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:58.147249 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e904bb-2c9d-4945-a435-defc6e9754cc None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:58.161003 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 458/911] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 14 17:40:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:58.167217 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51f18f7-42e8-4448-a2d8-6fb6dff2fed8 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:58.202941 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:58.274308 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51f18f7-42e8-4448-a2d8-6fb6dff2fed8 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:58.311918 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b061210b-d78e-467a-adcd-37fccdce2f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:58.312582 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b061210b-d78e-467a-adcd-37fccdce2f77 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:58.312861 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b061210b-d78e-467a-adcd-37fccdce2f77 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:58.313133 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b061210b-d78e-467a-adcd-37fccdce2f77 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:58.313992 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b061210b-d78e-467a-adcd-37fccdce2f77 None admin] RBAC: Adding query filter params (role.id=4a2ee10af7ed4ffab3293e28d925b9ab, scope.project.id=39a570421bb64fac8b1a0129f1bcc7d9, user.id=45542602225b452fa323f5499c1843ec) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:58.314300 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b061210b-d78e-467a-adcd-37fccdce2f77 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:58.315780 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b061210b-d78e-467a-adcd-37fccdce2f77 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:58.322231 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 454/912] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 14 17:40:58 2022] GET /identity/v3/role_assignments?user.id=45542602225b452fa323f5499c1843ec&scope.project.id=39a570421bb64fac8b1a0129f1bcc7d9&role.id=4a2ee10af7ed4ffab3293e28d925b9ab => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:58.373883 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467686ea-67b7-45d5-9245-395dceaab848 None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:58.374418 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467686ea-67b7-45d5-9245-395dceaab848 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:58.374418 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467686ea-67b7-45d5-9245-395dceaab848 None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:58.376196 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 459/913] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:40:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:40:58.382114 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf921791-f2e2-4219-92ef-f48ee0c7ba4c None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:58.382975 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf921791-f2e2-4219-92ef-f48ee0c7ba4c None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:58.383261 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf921791-f2e2-4219-92ef-f48ee0c7ba4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:58.403028 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-cf921791-f2e2-4219-92ef-f48ee0c7ba4c None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:40:58.404486 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-cf921791-f2e2-4219-92ef-f48ee0c7ba4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:40:58.495000 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 455/914] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:40:58 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 17:40:58.517786 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467686ea-67b7-45d5-9245-395dceaab848 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:58.621938 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467686ea-67b7-45d5-9245-395dceaab848 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:58.656400 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7773e2b-0472-4209-ae46-7f7dd3b00479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:58.657173 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7773e2b-0472-4209-ae46-7f7dd3b00479 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:58.657461 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7773e2b-0472-4209-ae46-7f7dd3b00479 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:58.657782 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7773e2b-0472-4209-ae46-7f7dd3b00479 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:58.658442 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7773e2b-0472-4209-ae46-7f7dd3b00479 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:58.659861 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7773e2b-0472-4209-ae46-7f7dd3b00479 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:58.672521 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-e7773e2b-0472-4209-ae46-7f7dd3b00479 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 17:40:58.672521 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:58.672521 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 17:40:58.672521 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 17:40:58.672521 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 17:40:58.672521 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 17:40:58.672521 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 17:40:58.672521 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 17:40:58.672521 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 17:40:58.672521 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:40:58.672521 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 17:40:58.672521 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:40:58.672521 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:58.672521 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:58.672521 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:58.672521 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:58.672521 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:58.673553 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:58.673553 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:58.673553 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:58.673553 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:58.673553 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:58.673553 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:58.673553 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 17:40:58.673553 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 17:40:58.673553 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 17:40:58.673553 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 17:40:58.673553 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:58.673553 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:58.673553 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:58.673553 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:58.673553 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:58.673553 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:58.674435 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:58.674435 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:58.674435 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:58.674435 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:58.674435 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:58.674435 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:58.674435 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:58.674435 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:58.674435 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:58.674435 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:58.674435 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 17:40:58.674435 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 17:40:58.674435 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 17:40:58.674435 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:40:58.677711 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 460/915] 10.222.0.67 () {56 vars in 1114 bytes} [Thu Jul 14 17:40:58 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:58.680159 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf921791-f2e2-4219-92ef-f48ee0c7ba4c None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:58.712141 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:58.790261 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf921791-f2e2-4219-92ef-f48ee0c7ba4c None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:58.837923 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e236f7-b9d9-4857-8a74-0ed67e5cc844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:58.838606 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e236f7-b9d9-4857-8a74-0ed67e5cc844 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:58.838894 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e236f7-b9d9-4857-8a74-0ed67e5cc844 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:58.839169 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e236f7-b9d9-4857-8a74-0ed67e5cc844 None admin] PATH_INFO: `/v3/services` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:58.839893 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e236f7-b9d9-4857-8a74-0ed67e5cc844 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:58.840204 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e236f7-b9d9-4857-8a74-0ed67e5cc844 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:58.841617 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e236f7-b9d9-4857-8a74-0ed67e5cc844 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:58.852864 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 456/916] 10.222.0.67 () {56 vars in 1114 bytes} [Thu Jul 14 17:40:58 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:58.854342 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7773e2b-0472-4209-ae46-7f7dd3b00479 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:58.901984 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:58.968407 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7773e2b-0472-4209-ae46-7f7dd3b00479 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:59.006224 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be8f518-9132-4ae6-89fa-9572033c5646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:59.006912 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be8f518-9132-4ae6-89fa-9572033c5646 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:59.007281 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be8f518-9132-4ae6-89fa-9572033c5646 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:59.007566 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be8f518-9132-4ae6-89fa-9572033c5646 None admin] PATH_INFO: `/v3/services` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:59.008291 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be8f518-9132-4ae6-89fa-9572033c5646 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:59.008603 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be8f518-9132-4ae6-89fa-9572033c5646 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:59.010104 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be8f518-9132-4ae6-89fa-9572033c5646 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:59.021238 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 461/917] 10.222.0.67 () {56 vars in 1114 bytes} [Thu Jul 14 17:40:58 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:59.022697 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e236f7-b9d9-4857-8a74-0ed67e5cc844 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:59.145494 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:59.154751 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e236f7-b9d9-4857-8a74-0ed67e5cc844 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:59.187829 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e2507d-8cef-4359-901d-e16ae50dc457 None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:59.188469 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e2507d-8cef-4359-901d-e16ae50dc457 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:59.188972 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e2507d-8cef-4359-901d-e16ae50dc457 None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:59.190860 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 462/918] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:40:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:40:59.194820 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5147e3-c41a-436f-ac9b-301b688b219e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:59.194820 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5147e3-c41a-436f-ac9b-301b688b219e None admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:59.194820 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5147e3-c41a-436f-ac9b-301b688b219e None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:59.194820 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5147e3-c41a-436f-ac9b-301b688b219e None admin] PATH_INFO: `/v3/endpoints` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:59.195687 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5147e3-c41a-436f-ac9b-301b688b219e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:59.195687 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5147e3-c41a-436f-ac9b-301b688b219e None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:59.197329 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926996ce-0304-464e-9816-81a634b944b4 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:59.197856 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926996ce-0304-464e-9816-81a634b944b4 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:59.198347 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926996ce-0304-464e-9816-81a634b944b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:59.217773 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 457/919] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 14 17:40:59 2022] POST /identity/v3/endpoints => generated 346 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:40:59.219475 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-926996ce-0304-464e-9816-81a634b944b4 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:40:59.220967 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-926996ce-0304-464e-9816-81a634b944b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:40:59.314193 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 463/920] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:40:59 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 17:40:59.338385 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5147e3-c41a-436f-ac9b-301b688b219e None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:59.464971 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5147e3-c41a-436f-ac9b-301b688b219e None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:59.504094 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a689832-2161-4e26-bf18-cd09e050be08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:59.504857 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a689832-2161-4e26-bf18-cd09e050be08 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:59.505144 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a689832-2161-4e26-bf18-cd09e050be08 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:59.505418 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a689832-2161-4e26-bf18-cd09e050be08 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:59.506128 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a689832-2161-4e26-bf18-cd09e050be08 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:59.508059 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a689832-2161-4e26-bf18-cd09e050be08 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:59.513895 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f189cbdd-bce9-48b5-94f6-7113e84b29c9 None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:59.514399 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f189cbdd-bce9-48b5-94f6-7113e84b29c9 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:59.514500 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f189cbdd-bce9-48b5-94f6-7113e84b29c9 None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:59.516215 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 464/921] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:40:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:40:59.521737 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-7a689832-2161-4e26-bf18-cd09e050be08 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 17:40:59.521737 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:59.521737 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 17:40:59.521737 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 17:40:59.521737 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 17:40:59.521737 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 17:40:59.521737 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 17:40:59.521737 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 17:40:59.521737 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 17:40:59.521737 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:40:59.521737 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 17:40:59.521737 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:40:59.521737 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:59.521737 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:59.521737 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:59.521737 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:59.522748 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:59.522748 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:59.522748 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:59.522748 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:59.522748 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:59.522748 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:59.522748 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:59.522748 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 17:40:59.522748 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 17:40:59.522748 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 17:40:59.522748 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 17:40:59.522748 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:59.522748 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:59.522748 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:59.522748 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:59.522748 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:59.524193 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:59.524193 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:59.524193 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:59.524193 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:59.524193 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:59.524193 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:59.524193 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:59.524193 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:59.524193 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:59.524193 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:59.524193 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:59.524193 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 17:40:59.524193 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 17:40:59.524193 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 17:40:59.524193 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:40:59.524998 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108c474-d89c-4918-9337-4ce5ccb52256 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:59.524998 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108c474-d89c-4918-9337-4ce5ccb52256 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:59.524998 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108c474-d89c-4918-9337-4ce5ccb52256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:59.525183 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 458/922] 10.222.0.67 () {56 vars in 1132 bytes} [Thu Jul 14 17:40:59 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:59.531916 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a689832-2161-4e26-bf18-cd09e050be08 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:59.542960 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-d108c474-d89c-4918-9337-4ce5ccb52256 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:40:59.544170 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-d108c474-d89c-4918-9337-4ce5ccb52256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:40:59.547586 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:59.561800 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:59.627348 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 465/923] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:40:59 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 17:40:59.650983 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d108c474-d89c-4918-9337-4ce5ccb52256 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:59.691574 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a689832-2161-4e26-bf18-cd09e050be08 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:59.732511 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606179c1-5fa4-462e-ac0f-bd216efce6e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:59.733194 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606179c1-5fa4-462e-ac0f-bd216efce6e5 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:59.733478 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606179c1-5fa4-462e-ac0f-bd216efce6e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:59.733789 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606179c1-5fa4-462e-ac0f-bd216efce6e5 None admin] PATH_INFO: `/v3/services` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:59.734511 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606179c1-5fa4-462e-ac0f-bd216efce6e5 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:59.734818 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606179c1-5fa4-462e-ac0f-bd216efce6e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:59.736218 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606179c1-5fa4-462e-ac0f-bd216efce6e5 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:59.742884 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 459/924] 10.222.0.67 () {56 vars in 1126 bytes} [Thu Jul 14 17:40:59 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:40:59.748733 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606179c1-5fa4-462e-ac0f-bd216efce6e5 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:59.784695 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d108c474-d89c-4918-9337-4ce5ccb52256 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:59.834212 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87857814-a1fd-45b8-968b-0e944943aa95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:59.835500 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87857814-a1fd-45b8-968b-0e944943aa95 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:59.835783 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87857814-a1fd-45b8-968b-0e944943aa95 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:59.836055 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87857814-a1fd-45b8-968b-0e944943aa95 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:59.836721 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87857814-a1fd-45b8-968b-0e944943aa95 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:59.838207 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87857814-a1fd-45b8-968b-0e944943aa95 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:59.852113 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-87857814-a1fd-45b8-968b-0e944943aa95 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 17:40:59.852113 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:59.852113 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 17:40:59.852113 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 17:40:59.852113 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 17:40:59.852113 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 17:40:59.852113 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 17:40:59.852113 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 17:40:59.852113 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 17:40:59.852113 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:40:59.852113 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 17:40:59.852113 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:40:59.852113 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:40:59.852113 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:40:59.852113 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:40:59.852113 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:40:59.852113 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:40:59.854057 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:40:59.854057 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:40:59.854057 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:40:59.854057 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:40:59.854057 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:40:59.854057 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:40:59.854057 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 17:40:59.854057 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 17:40:59.854057 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 17:40:59.854057 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 17:40:59.854057 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:40:59.854057 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:40:59.854057 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:40:59.854057 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:40:59.854057 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:40:59.854057 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:40:59.855644 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:40:59.855644 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:40:59.855644 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:40:59.855644 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:40:59.855644 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:40:59.855644 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:40:59.855644 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:40:59.855644 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:40:59.855644 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:40:59.855644 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:40:59.855644 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 17:40:59.855644 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 17:40:59.855644 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 17:40:59.855644 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:40:59.858570 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 466/925] 10.222.0.67 () {56 vars in 1126 bytes} [Thu Jul 14 17:40:59 2022] GET /identity/v3/services/object-store => generated 93 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:40:59.858874 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:59.859492 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87857814-a1fd-45b8-968b-0e944943aa95 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:40:59.903281 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606179c1-5fa4-462e-ac0f-bd216efce6e5 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:40:59.934062 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:40:59.948969 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdb28b0-cb79-408d-8b43-09b546aad1e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:40:59.950109 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb28b0-cb79-408d-8b43-09b546aad1e5 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:40:59.950645 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb28b0-cb79-408d-8b43-09b546aad1e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:40:59.951101 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb28b0-cb79-408d-8b43-09b546aad1e5 None admin] PATH_INFO: `/v3/services` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:40:59.951977 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdb28b0-cb79-408d-8b43-09b546aad1e5 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:40:59.952626 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdb28b0-cb79-408d-8b43-09b546aad1e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:40:59.955111 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdb28b0-cb79-408d-8b43-09b546aad1e5 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:40:59.961835 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 460/926] 10.222.0.67 () {56 vars in 1126 bytes} [Thu Jul 14 17:40:59 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:40:59.968765 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdb28b0-cb79-408d-8b43-09b546aad1e5 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:00.017286 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87857814-a1fd-45b8-968b-0e944943aa95 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:00.069161 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe2c0e6-7ed3-43e6-84b1-41d9d3525e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:00.070148 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe2c0e6-7ed3-43e6-84b1-41d9d3525e0d None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:00.070592 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe2c0e6-7ed3-43e6-84b1-41d9d3525e0d None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:00.071046 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe2c0e6-7ed3-43e6-84b1-41d9d3525e0d None admin] PATH_INFO: `/v3/services` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:00.071922 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe2c0e6-7ed3-43e6-84b1-41d9d3525e0d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:41:00.072382 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe2c0e6-7ed3-43e6-84b1-41d9d3525e0d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:00.073948 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe2c0e6-7ed3-43e6-84b1-41d9d3525e0d None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:00.080856 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 467/927] 10.222.0.67 () {56 vars in 1122 bytes} [Thu Jul 14 17:40:59 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:41:00.097457 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe2c0e6-7ed3-43e6-84b1-41d9d3525e0d None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:00.118832 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdb28b0-cb79-408d-8b43-09b546aad1e5 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:00.164037 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1007eff5-fb0a-4122-980c-58043c2faed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:00.165191 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1007eff5-fb0a-4122-980c-58043c2faed8 None admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:00.165726 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1007eff5-fb0a-4122-980c-58043c2faed8 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:00.166245 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1007eff5-fb0a-4122-980c-58043c2faed8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:00.167229 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1007eff5-fb0a-4122-980c-58043c2faed8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:00.169060 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1007eff5-fb0a-4122-980c-58043c2faed8 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:00.200850 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:00.217813 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 461/928] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 14 17:40:59 2022] POST /identity/v3/endpoints => generated 347 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:41:00.239882 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:00.293961 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe2c0e6-7ed3-43e6-84b1-41d9d3525e0d None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:00.345471 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab0e3bc-b666-44b0-83a3-79fcab991eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:00.346556 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab0e3bc-b666-44b0-83a3-79fcab991eea None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:00.347090 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab0e3bc-b666-44b0-83a3-79fcab991eea None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:00.347606 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab0e3bc-b666-44b0-83a3-79fcab991eea None admin] PATH_INFO: `/v3/services` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:00.348584 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab0e3bc-b666-44b0-83a3-79fcab991eea None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:41:00.349141 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab0e3bc-b666-44b0-83a3-79fcab991eea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:00.351660 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab0e3bc-b666-44b0-83a3-79fcab991eea None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:00.358608 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 468/929] 10.222.0.67 () {56 vars in 1122 bytes} [Thu Jul 14 17:41:00 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:41:00.368624 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1007eff5-fb0a-4122-980c-58043c2faed8 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:00.532086 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1007eff5-fb0a-4122-980c-58043c2faed8 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:00.562331 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732cc73-b2cc-4c7f-8e66-5cc05a9c8044 None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:00.563044 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732cc73-b2cc-4c7f-8e66-5cc05a9c8044 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:00.563044 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732cc73-b2cc-4c7f-8e66-5cc05a9c8044 None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:00.564299 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 469/930] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:41:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 17:41:00.570550 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92483486-3246-4cd2-8f4a-cf72131d1ed0 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:00.570945 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92483486-3246-4cd2-8f4a-cf72131d1ed0 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:00.571114 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92483486-3246-4cd2-8f4a-cf72131d1ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:00.574197 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74328770-628e-4b75-a5f8-dc8576d9e7ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:00.574977 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74328770-628e-4b75-a5f8-dc8576d9e7ab None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:00.575260 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74328770-628e-4b75-a5f8-dc8576d9e7ab None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:00.575535 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74328770-628e-4b75-a5f8-dc8576d9e7ab None admin] PATH_INFO: `/v3/endpoints` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:00.576411 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74328770-628e-4b75-a5f8-dc8576d9e7ab None admin] RBAC: Adding query filter params (interface=public, service_id=f917ec9f3c59498d9b819929a72b60ec, region_id=RegionOne) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:41:00.576730 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74328770-628e-4b75-a5f8-dc8576d9e7ab None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:00.578174 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74328770-628e-4b75-a5f8-dc8576d9e7ab None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:00.584448 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 462/931] 10.222.0.67 () {56 vars in 1251 bytes} [Thu Jul 14 17:41:00 2022] GET /identity/v3/endpoints?service_id=f917ec9f3c59498d9b819929a72b60ec&interface=public®ion_id=RegionOne => generated 194 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:41:00.590895 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-92483486-3246-4cd2-8f4a-cf72131d1ed0 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:41:00.592279 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-92483486-3246-4cd2-8f4a-cf72131d1ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:41:00.594571 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74328770-628e-4b75-a5f8-dc8576d9e7ab None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:00.669689 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 470/932] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:41:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 17:41:00.688122 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92483486-3246-4cd2-8f4a-cf72131d1ed0 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:00.690447 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:00.721157 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74328770-628e-4b75-a5f8-dc8576d9e7ab None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:00.761878 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bf31c8-5847-4936-9e7b-0f29e5e88020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:00.762715 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bf31c8-5847-4936-9e7b-0f29e5e88020 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:00.762987 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bf31c8-5847-4936-9e7b-0f29e5e88020 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:00.763257 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bf31c8-5847-4936-9e7b-0f29e5e88020 None admin] PATH_INFO: `/v3/services` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:00.764459 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bf31c8-5847-4936-9e7b-0f29e5e88020 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:00.765871 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:00.766147 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bf31c8-5847-4936-9e7b-0f29e5e88020 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:00.775083 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 463/933] 10.222.0.67 () {56 vars in 1087 bytes} [Thu Jul 14 17:41:00 2022] GET /identity/v3/services => generated 1497 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 17:41:00.821827 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92483486-3246-4cd2-8f4a-cf72131d1ed0 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:00.862866 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a6923b-974a-4271-b560-e02274269590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:00.863782 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a6923b-974a-4271-b560-e02274269590 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:00.864051 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a6923b-974a-4271-b560-e02274269590 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:00.864328 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a6923b-974a-4271-b560-e02274269590 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:00.878368 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a6923b-974a-4271-b560-e02274269590 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:41:00.887631 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-b6a6923b-974a-4271-b560-e02274269590 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 17:41:00.887631 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:41:00.887631 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:41:00.887631 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:41:00.887631 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:41:00.887631 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:41:00.887631 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:41:00.887631 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:41:00.887631 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:41:00.887631 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:41:00.887631 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:41:00.887631 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:41:00.887631 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:41:00.887631 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:41:00.887631 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:41:00.887631 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:41:00.890316 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:41:00.890316 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:41:00.890316 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:41:00.890316 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:41:00.890316 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:41:00.890316 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:41:00.890316 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:41:00.890316 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:41:00.890316 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:41:00.890316 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:41:00.890316 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:41:00.890316 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:41:00.890316 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:41:00.890316 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:41:00.890316 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:41:00.890316 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:41:00.891830 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:41:00.891830 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:41:00.891830 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:41:00.891830 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:41:00.891830 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:41:00.891830 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:41:00.891830 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:41:00.891830 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:41:00.891830 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:41:00.891830 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:41:00.891830 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 17:41:00.891830 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:41:00.891830 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 471/934] 10.222.0.67 () {56 vars in 1120 bytes} [Thu Jul 14 17:41:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 17:41:00.899019 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bf31c8-5847-4936-9e7b-0f29e5e88020 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:01.038163 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bf31c8-5847-4936-9e7b-0f29e5e88020 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:01.092195 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:01.108060 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba80b0a3-d92e-4cc9-82a9-de0454cc4972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:01.109489 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba80b0a3-d92e-4cc9-82a9-de0454cc4972 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:01.110209 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba80b0a3-d92e-4cc9-82a9-de0454cc4972 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:01.110883 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba80b0a3-d92e-4cc9-82a9-de0454cc4972 None admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:01.112565 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba80b0a3-d92e-4cc9-82a9-de0454cc4972 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:41:01.113345 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba80b0a3-d92e-4cc9-82a9-de0454cc4972 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:01.116104 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba80b0a3-d92e-4cc9-82a9-de0454cc4972 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:01.133814 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 464/935] 10.222.0.67 () {56 vars in 1115 bytes} [Thu Jul 14 17:41:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:41:01.141597 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a6923b-974a-4271-b560-e02274269590 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:01.252476 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a6923b-974a-4271-b560-e02274269590 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:01.270863 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:01.289019 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b63881-65c1-464e-83fc-02e31a9d6ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:01.289931 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b63881-65c1-464e-83fc-02e31a9d6ddf None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:01.290272 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b63881-65c1-464e-83fc-02e31a9d6ddf None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:01.290776 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b63881-65c1-464e-83fc-02e31a9d6ddf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:01.302296 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b63881-65c1-464e-83fc-02e31a9d6ddf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:01.303747 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b63881-65c1-464e-83fc-02e31a9d6ddf None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:01.322240 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-47b63881-65c1-464e-83fc-02e31a9d6ddf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:41:01.322240 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:41:01.322240 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:41:01.322240 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:41:01.322240 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:41:01.322240 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:41:01.322240 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:41:01.322240 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:41:01.322240 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:41:01.322240 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:41:01.322240 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:41:01.322240 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:41:01.322240 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:41:01.322240 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:41:01.322240 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:41:01.324037 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:41:01.324037 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:41:01.324037 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:41:01.324037 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:41:01.324037 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:41:01.324037 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:41:01.324037 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:41:01.324037 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:41:01.324037 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:41:01.324037 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:41:01.324037 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:41:01.324037 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:41:01.324037 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:41:01.324037 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:41:01.324037 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:41:01.324037 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:41:01.324037 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:41:01.327708 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:41:01.327708 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:41:01.327708 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:41:01.327708 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:41:01.327708 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 472/936] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:41:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:41:01.333863 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba80b0a3-d92e-4cc9-82a9-de0454cc4972 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:01.446844 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba80b0a3-d92e-4cc9-82a9-de0454cc4972 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:01.489565 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b340db-e64c-4db7-b666-596cc540b11a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:01.489565 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b340db-e64c-4db7-b666-596cc540b11a None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:01.489565 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b340db-e64c-4db7-b666-596cc540b11a None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:01.489565 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b340db-e64c-4db7-b666-596cc540b11a None admin] PATH_INFO: `/v3/domains` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:01.490282 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b340db-e64c-4db7-b666-596cc540b11a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:41:01.490482 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b340db-e64c-4db7-b666-596cc540b11a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:01.492045 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b340db-e64c-4db7-b666-596cc540b11a None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:01.511485 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 465/937] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 14 17:41:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:41:01.513024 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b63881-65c1-464e-83fc-02e31a9d6ddf None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:01.670433 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a99e9d-af2f-4644-8ece-376b7b38a5f0 None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:01.670729 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a99e9d-af2f-4644-8ece-376b7b38a5f0 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:01.670982 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a99e9d-af2f-4644-8ece-376b7b38a5f0 None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:01.672628 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 466/938] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:41:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 17:41:01.676809 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b63881-65c1-464e-83fc-02e31a9d6ddf None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:01.678056 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc171f7-df70-4ecd-bb03-bf8878712ae5 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:01.678343 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc171f7-df70-4ecd-bb03-bf8878712ae5 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:01.678809 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc171f7-df70-4ecd-bb03-bf8878712ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:01.707432 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-8fc171f7-df70-4ecd-bb03-bf8878712ae5 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:41:01.708556 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-8fc171f7-df70-4ecd-bb03-bf8878712ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:41:01.732699 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca15b0c-80e7-4971-9208-eca9e8b949a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:01.734632 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca15b0c-80e7-4971-9208-eca9e8b949a7 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:01.735395 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca15b0c-80e7-4971-9208-eca9e8b949a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:01.736088 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca15b0c-80e7-4971-9208-eca9e8b949a7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:01.748417 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca15b0c-80e7-4971-9208-eca9e8b949a7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:01.750486 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca15b0c-80e7-4971-9208-eca9e8b949a7 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:01.779243 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:01.798470 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-3ca15b0c-80e7-4971-9208-eca9e8b949a7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 17:41:01.798470 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:41:01.798470 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:41:01.798470 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:41:01.798470 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:41:01.798470 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:41:01.798470 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:41:01.798470 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:41:01.798470 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:41:01.798470 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:41:01.798470 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:41:01.798470 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:41:01.798470 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 17:41:01.798470 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 17:41:01.798470 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 17:41:01.798470 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 17:41:01.800346 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:41:01.800346 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:41:01.800346 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 17:41:01.800346 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:41:01.800346 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 17:41:01.800346 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:41:01.800346 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:41:01.800346 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:41:01.800346 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:41:01.800346 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:41:01.800346 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:41:01.800346 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:41:01.800346 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:41:01.800346 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:41:01.800346 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:41:01.800346 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:41:01.800346 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:41:01.800346 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:41:01.802222 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:41:01.802222 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:41:01.802222 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 17:41:01.802222 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 17:41:01.802222 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 17:41:01.802222 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 17:41:01.802222 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 17:41:01.802222 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 17:41:01.802222 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 17:41:01.802222 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:41:01.803260 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 473/939] 10.222.0.67 () {56 vars in 1117 bytes} [Thu Jul 14 17:41:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:41:01.809365 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca15b0c-80e7-4971-9208-eca9e8b949a7 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:01.826885 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 467/940] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:41:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 17:41:01.852915 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:01.855735 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc171f7-df70-4ecd-bb03-bf8878712ae5 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:01.934205 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca15b0c-80e7-4971-9208-eca9e8b949a7 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:01.971448 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a89e955-1506-464a-8fac-8c6ea368bd38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:01.972530 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a89e955-1506-464a-8fac-8c6ea368bd38 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:01.973055 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a89e955-1506-464a-8fac-8c6ea368bd38 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:01.973478 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a89e955-1506-464a-8fac-8c6ea368bd38 None admin] PATH_INFO: `/v3/users` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:01.974525 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a89e955-1506-464a-8fac-8c6ea368bd38 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:41:01.975014 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a89e955-1506-464a-8fac-8c6ea368bd38 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:01.976861 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc171f7-df70-4ecd-bb03-bf8878712ae5 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:01.977476 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a89e955-1506-464a-8fac-8c6ea368bd38 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:02.004170 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 474/941] 10.222.0.67 () {56 vars in 1149 bytes} [Thu Jul 14 17:41:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:41:02.005916 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a89e955-1506-464a-8fac-8c6ea368bd38 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:02.016562 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32d9b4f-f73c-4112-8a25-96544395b1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:02.017503 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32d9b4f-f73c-4112-8a25-96544395b1cb None admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:02.017927 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32d9b4f-f73c-4112-8a25-96544395b1cb None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:02.018309 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32d9b4f-f73c-4112-8a25-96544395b1cb None admin] PATH_INFO: `/v3/projects` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:02.019141 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32d9b4f-f73c-4112-8a25-96544395b1cb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:02.020811 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32d9b4f-f73c-4112-8a25-96544395b1cb None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:02.022464 dv-cinder-849890-1-smb devstack@keystone.service[86772]: WARNING keystone.server.flask.common [None req-b32d9b4f-f73c-4112-8a25-96544395b1cb None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 14 17:41:02.043488 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.sql.core [None req-b32d9b4f-f73c-4112-8a25-96544395b1cb None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 14 17:41:02.043488 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 14 17:41:02.043488 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [parameters: {'id': '20ff253fd5fc42c99d89f5dbf95cfb3b', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 14 17:41:02.043488 dv-cinder-849890-1-smb devstack@keystone.service[86772]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86772) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 14 17:41:02.066908 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-b32d9b4f-f73c-4112-8a25-96544395b1cb None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 20ff253fd5fc42c99d89f5dbf95cfb3b.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 20ff253fd5fc42c99d89f5dbf95cfb3b. Jul 14 17:41:02.066908 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:41:02.066908 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 17:41:02.066908 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 14 17:41:02.066908 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 17:41:02.066908 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 14 17:41:02.066908 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 17:41:02.066908 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application result = self._query(query) Jul 14 17:41:02.066908 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 17:41:02.066908 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application conn.query(q) Jul 14 17:41:02.066908 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 17:41:02.066908 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 17:41:02.066908 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 17:41:02.067987 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application result.read() Jul 14 17:41:02.067987 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 17:41:02.067987 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 14 17:41:02.067987 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 17:41:02.067987 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 14 17:41:02.067987 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 17:41:02.067987 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 14 17:41:02.067987 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 17:41:02.067987 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 14 17:41:02.067987 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 14 17:41:02.067987 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:41:02.067987 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 14 17:41:02.067987 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:41:02.067987 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:41:02.067987 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 14 17:41:02.067987 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 14 17:41:02.067987 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 14 17:41:02.067987 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 14 17:41:02.068960 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 14 17:41:02.068960 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application next(self.gen) Jul 14 17:41:02.068960 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 14 17:41:02.068960 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application yield resource Jul 14 17:41:02.068960 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 14 17:41:02.068960 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application next(self.gen) Jul 14 17:41:02.068960 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 14 17:41:02.068960 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application self.session.rollback() Jul 14 17:41:02.068960 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 17:41:02.068960 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application self.force_reraise() Jul 14 17:41:02.068960 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 17:41:02.068960 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise self.value Jul 14 17:41:02.068960 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 14 17:41:02.068960 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 14 17:41:02.068960 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 14 17:41:02.068960 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application session.commit() Jul 14 17:41:02.068960 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 14 17:41:02.071133 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 14 17:41:02.071133 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 14 17:41:02.071133 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application self._prepare_impl() Jul 14 17:41:02.071133 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 14 17:41:02.071133 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application self.session.flush() Jul 14 17:41:02.071133 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 14 17:41:02.071133 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application self._flush(objects) Jul 14 17:41:02.071133 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 14 17:41:02.071133 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 14 17:41:02.071133 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 14 17:41:02.071133 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application compat.raise_( Jul 14 17:41:02.071133 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 17:41:02.071133 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception Jul 14 17:41:02.071133 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 14 17:41:02.071133 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application flush_context.execute() Jul 14 17:41:02.071133 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 14 17:41:02.071133 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rec.execute(self) Jul 14 17:41:02.073267 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 14 17:41:02.073267 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 14 17:41:02.073267 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 14 17:41:02.073267 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 14 17:41:02.073267 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 14 17:41:02.073267 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 14 17:41:02.073267 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 14 17:41:02.073267 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 14 17:41:02.073267 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 14 17:41:02.073267 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 14 17:41:02.073267 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 14 17:41:02.073267 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 14 17:41:02.073267 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 14 17:41:02.073267 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 14 17:41:02.073267 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 14 17:41:02.075611 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 14 17:41:02.075611 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 17:41:02.075611 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception Jul 14 17:41:02.075611 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 17:41:02.075611 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 14 17:41:02.075611 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 17:41:02.075611 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 14 17:41:02.075611 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 17:41:02.075611 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application result = self._query(query) Jul 14 17:41:02.075611 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 17:41:02.075611 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application conn.query(q) Jul 14 17:41:02.075611 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 17:41:02.075611 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 17:41:02.075611 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 17:41:02.075611 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application result.read() Jul 14 17:41:02.075611 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 17:41:02.075611 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 14 17:41:02.077512 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 17:41:02.077512 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 14 17:41:02.077512 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 17:41:02.077512 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 14 17:41:02.077512 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 17:41:02.077512 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 14 17:41:02.077512 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 14 17:41:02.077512 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 14 17:41:02.077512 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [parameters: {'id': '20ff253fd5fc42c99d89f5dbf95cfb3b', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 14 17:41:02.077512 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 14 17:41:02.077512 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:41:02.077512 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 17:41:02.077512 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:41:02.077512 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:41:02.077512 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 14 17:41:02.079298 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 14 17:41:02.079298 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 14 17:41:02.079298 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 14 17:41:02.079298 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 14 17:41:02.079298 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:41:02.079298 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 17:41:02.079298 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:41:02.079298 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:41:02.079298 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:41:02.079298 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:41:02.079298 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:41:02.079298 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:41:02.079298 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:41:02.079298 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:41:02.079298 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:41:02.079298 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:41:02.079298 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:41:02.083401 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:41:02.083401 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 14 17:41:02.083401 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 14 17:41:02.083401 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:41:02.083401 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:41:02.083401 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 14 17:41:02.083401 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 14 17:41:02.083401 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 20ff253fd5fc42c99d89f5dbf95cfb3b. Jul 14 17:41:02.083401 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:41:02.083401 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 468/942] 10.222.0.67 () {60 vars in 1140 bytes} [Thu Jul 14 17:41:01 2022] POST /identity/v3/projects => generated 262 bytes in 214 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:41:02.083401 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32d9b4f-f73c-4112-8a25-96544395b1cb None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:02.125604 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:02.139099 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:02.157837 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a89e955-1506-464a-8fac-8c6ea368bd38 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:02.211921 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32d9b4f-f73c-4112-8a25-96544395b1cb None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:02.219248 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f829b66-68f6-48bb-b46b-b2c136521418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:02.220345 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f829b66-68f6-48bb-b46b-b2c136521418 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:02.220779 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f829b66-68f6-48bb-b46b-b2c136521418 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:02.221203 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f829b66-68f6-48bb-b46b-b2c136521418 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:02.237870 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f829b66-68f6-48bb-b46b-b2c136521418 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:02.240204 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f829b66-68f6-48bb-b46b-b2c136521418 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:02.252861 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc636b02-f271-4b93-a2e0-efd74521fa31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:02.253896 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc636b02-f271-4b93-a2e0-efd74521fa31 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:02.254441 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc636b02-f271-4b93-a2e0-efd74521fa31 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:02.254632 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc636b02-f271-4b93-a2e0-efd74521fa31 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:02.262671 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc636b02-f271-4b93-a2e0-efd74521fa31 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:02.264510 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc636b02-f271-4b93-a2e0-efd74521fa31 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:02.266051 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-3f829b66-68f6-48bb-b46b-b2c136521418 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:41:02.266051 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:41:02.266051 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:41:02.266051 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:41:02.266051 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:41:02.266051 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:41:02.266051 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:41:02.266051 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:41:02.266051 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:41:02.266051 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:41:02.266051 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:41:02.266051 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:41:02.266051 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:41:02.266051 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:41:02.266051 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:41:02.267141 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:41:02.267141 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:41:02.267141 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:41:02.267141 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:41:02.267141 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:41:02.267141 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:41:02.267141 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:41:02.267141 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:41:02.267141 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:41:02.267141 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:41:02.267141 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:41:02.267141 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:41:02.267141 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:41:02.267141 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:41:02.267141 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:41:02.267141 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:41:02.267141 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:41:02.268267 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:41:02.268267 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:41:02.268267 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:41:02.268267 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:41:02.271033 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 475/943] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:41:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:41:02.279866 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f829b66-68f6-48bb-b46b-b2c136521418 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:02.288131 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-dc636b02-f271-4b93-a2e0-efd74521fa31 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:41:02.288131 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:41:02.288131 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:41:02.288131 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:41:02.288131 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:41:02.288131 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:41:02.288131 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:41:02.288131 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:41:02.288131 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:41:02.288131 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:41:02.288131 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:41:02.288131 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:41:02.288131 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 17:41:02.288131 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 17:41:02.288131 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 17:41:02.290139 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 17:41:02.290139 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:41:02.290139 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:41:02.290139 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:41:02.290139 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:41:02.290139 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:41:02.290139 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:41:02.290139 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:41:02.290139 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:41:02.290139 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:41:02.290139 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:41:02.290139 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:41:02.290139 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:41:02.290139 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:41:02.290139 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:41:02.290139 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:41:02.290139 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:41:02.292005 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 17:41:02.292005 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 17:41:02.292005 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 17:41:02.292005 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 17:41:02.292005 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 17:41:02.292005 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 17:41:02.292005 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:41:02.292005 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:41:02.293813 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 469/944] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 14 17:41:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 17:41:02.295225 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc636b02-f271-4b93-a2e0-efd74521fa31 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:02.405753 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f829b66-68f6-48bb-b46b-b2c136521418 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:02.425145 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:02.433780 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc636b02-f271-4b93-a2e0-efd74521fa31 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:02.455548 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f69565-5f40-479f-bb2e-46b121ded755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:02.456393 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f69565-5f40-479f-bb2e-46b121ded755 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:02.456807 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f69565-5f40-479f-bb2e-46b121ded755 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:02.457178 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f69565-5f40-479f-bb2e-46b121ded755 None admin] PATH_INFO: `/v3/domains` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:02.458120 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f69565-5f40-479f-bb2e-46b121ded755 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:41:02.458465 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f69565-5f40-479f-bb2e-46b121ded755 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:02.459956 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f69565-5f40-479f-bb2e-46b121ded755 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:02.470278 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:02.480053 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 476/945] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 14 17:41:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:41:02.481333 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f69565-5f40-479f-bb2e-46b121ded755 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:02.490268 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e219b6-49e9-4fa6-b3b8-4ce493865f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:02.491187 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e219b6-49e9-4fa6-b3b8-4ce493865f17 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:02.491634 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e219b6-49e9-4fa6-b3b8-4ce493865f17 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:02.492769 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e219b6-49e9-4fa6-b3b8-4ce493865f17 None admin] PATH_INFO: `/v3/projects` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:02.493729 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e219b6-49e9-4fa6-b3b8-4ce493865f17 None admin] RBAC: Adding query filter params (name=service) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:41:02.494471 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e219b6-49e9-4fa6-b3b8-4ce493865f17 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:02.497035 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e219b6-49e9-4fa6-b3b8-4ce493865f17 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:02.528243 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 470/946] 10.222.0.67 () {56 vars in 1112 bytes} [Thu Jul 14 17:41:02 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:41:02.612529 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f69565-5f40-479f-bb2e-46b121ded755 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:02.654614 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7dde59-8504-4149-9467-68c8c1993ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:02.655824 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7dde59-8504-4149-9467-68c8c1993ebb None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:02.656327 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7dde59-8504-4149-9467-68c8c1993ebb None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:02.656808 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7dde59-8504-4149-9467-68c8c1993ebb None admin] PATH_INFO: `/v3/projects/service` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:02.665976 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7dde59-8504-4149-9467-68c8c1993ebb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:02.667900 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7dde59-8504-4149-9467-68c8c1993ebb None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:02.684870 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-1f7dde59-8504-4149-9467-68c8c1993ebb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:41:02.684870 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:41:02.684870 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:41:02.684870 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:41:02.684870 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:41:02.684870 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:41:02.684870 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:41:02.684870 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:41:02.684870 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:41:02.684870 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:41:02.684870 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:41:02.684870 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:41:02.684870 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 17:41:02.684870 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 17:41:02.684870 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 17:41:02.686334 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 17:41:02.686334 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:41:02.686334 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:41:02.686334 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:41:02.686334 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:41:02.686334 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:41:02.686334 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:41:02.686334 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:41:02.686334 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:41:02.686334 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:41:02.686334 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:41:02.686334 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:41:02.686334 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:41:02.686334 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:41:02.686334 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:41:02.686334 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:41:02.686334 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:41:02.687265 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 17:41:02.687265 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 17:41:02.687265 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 17:41:02.687265 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 17:41:02.687265 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 17:41:02.687265 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 17:41:02.687265 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:41:02.687265 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:41:02.689998 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 477/947] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 14 17:41:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 17:41:02.697110 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e219b6-49e9-4fa6-b3b8-4ce493865f17 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:02.827664 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e219b6-49e9-4fa6-b3b8-4ce493865f17 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:02.868599 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37029f5-3508-4220-8beb-6bf9c05fec9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:02.869617 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37029f5-3508-4220-8beb-6bf9c05fec9c None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:02.869902 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37029f5-3508-4220-8beb-6bf9c05fec9c None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:02.870224 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37029f5-3508-4220-8beb-6bf9c05fec9c None admin] PATH_INFO: `/v3/projects` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:02.871025 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37029f5-3508-4220-8beb-6bf9c05fec9c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:41:02.871335 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37029f5-3508-4220-8beb-6bf9c05fec9c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:02.872783 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37029f5-3508-4220-8beb-6bf9c05fec9c None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:02.891278 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 471/948] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 14 17:41:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:41:02.893283 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7dde59-8504-4149-9467-68c8c1993ebb None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:02.966645 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:02.972212 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ae7f8-86b8-4cdb-a99a-fbfd8b244204 None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:02.972685 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ae7f8-86b8-4cdb-a99a-fbfd8b244204 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:02.973146 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ae7f8-86b8-4cdb-a99a-fbfd8b244204 None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:02.976072 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 472/949] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:41:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 17:41:02.985145 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8fcfb-dd22-440a-aa3e-385ceb3907ef None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:02.985676 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8fcfb-dd22-440a-aa3e-385ceb3907ef None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:02.986178 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8fcfb-dd22-440a-aa3e-385ceb3907ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:03.008704 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-09b8fcfb-dd22-440a-aa3e-385ceb3907ef None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:41:03.010331 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-09b8fcfb-dd22-440a-aa3e-385ceb3907ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:41:03.023870 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:03.034830 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7dde59-8504-4149-9467-68c8c1993ebb None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:03.107168 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb88603-12b7-4d49-84e4-819f06a55433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:03.108693 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb88603-12b7-4d49-84e4-819f06a55433 None admin] REQUEST_METHOD: `PUT` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:03.109158 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb88603-12b7-4d49-84e4-819f06a55433 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:03.109656 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb88603-12b7-4d49-84e4-819f06a55433 None admin] PATH_INFO: `/v3/projects/39a570421bb64fac8b1a0129f1bcc7d9/users/45542602225b452fa323f5499c1843ec/roles/4a2ee10af7ed4ffab3293e28d925b9ab` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:03.114501 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb88603-12b7-4d49-84e4-819f06a55433 None admin] RBAC: Authorizing `identity:create_grant(project_id=39a570421bb64fac8b1a0129f1bcc7d9, user_id=45542602225b452fa323f5499c1843ec, role_id=4a2ee10af7ed4ffab3293e28d925b9ab)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:03.117998 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb88603-12b7-4d49-84e4-819f06a55433 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:03.141879 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 473/950] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:41:02 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 17:41:03.150237 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 478/951] 10.222.0.67 () {58 vars in 1439 bytes} [Thu Jul 14 17:41:02 2022] PUT /identity/v3/projects/39a570421bb64fac8b1a0129f1bcc7d9/users/45542602225b452fa323f5499c1843ec/roles/4a2ee10af7ed4ffab3293e28d925b9ab => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 17:41:03.178925 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b8fcfb-dd22-440a-aa3e-385ceb3907ef None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:03.373951 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b8fcfb-dd22-440a-aa3e-385ceb3907ef None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:03.415631 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81c566c-7390-4cfe-8aff-52de463f9683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:03.416447 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81c566c-7390-4cfe-8aff-52de463f9683 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:03.416762 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81c566c-7390-4cfe-8aff-52de463f9683 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:03.417040 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81c566c-7390-4cfe-8aff-52de463f9683 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:03.417800 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81c566c-7390-4cfe-8aff-52de463f9683 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:03.419357 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81c566c-7390-4cfe-8aff-52de463f9683 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:03.436485 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-d81c566c-7390-4cfe-8aff-52de463f9683 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 17:41:03.436485 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:41:03.436485 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 17:41:03.436485 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 17:41:03.436485 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 17:41:03.436485 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 17:41:03.436485 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 17:41:03.436485 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 17:41:03.436485 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 17:41:03.436485 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:41:03.436485 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 17:41:03.436485 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:41:03.436485 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:41:03.436485 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:41:03.436485 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:41:03.436485 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:41:03.436485 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:41:03.437608 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:41:03.437608 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:41:03.437608 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:41:03.437608 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:41:03.437608 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:41:03.437608 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:41:03.437608 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 17:41:03.437608 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 17:41:03.437608 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 17:41:03.437608 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 17:41:03.437608 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:41:03.437608 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:41:03.437608 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:41:03.437608 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:41:03.437608 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:41:03.437608 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:41:03.438528 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:41:03.438528 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:41:03.438528 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:41:03.438528 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:41:03.438528 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:41:03.438528 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:41:03.438528 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:41:03.438528 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:41:03.438528 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:41:03.438528 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:41:03.438528 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 17:41:03.438528 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 17:41:03.438528 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 17:41:03.438528 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:41:03.438528 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 474/952] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 14 17:41:03 2022] GET /identity/v3/services/compute => generated 88 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:41:03.448378 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb88603-12b7-4d49-84e4-819f06a55433 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:03.579159 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb88603-12b7-4d49-84e4-819f06a55433 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:03.609363 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:03.633955 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c76e46b-f788-4916-867c-319e8587d810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:03.635268 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c76e46b-f788-4916-867c-319e8587d810 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:03.635823 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c76e46b-f788-4916-867c-319e8587d810 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:03.636322 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c76e46b-f788-4916-867c-319e8587d810 None admin] PATH_INFO: `/v3/services` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:03.637328 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c76e46b-f788-4916-867c-319e8587d810 None admin] RBAC: Adding query filter params (name=compute) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:41:03.637957 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c76e46b-f788-4916-867c-319e8587d810 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:03.639692 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c76e46b-f788-4916-867c-319e8587d810 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:03.647096 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 479/953] 10.222.0.67 () {56 vars in 1112 bytes} [Thu Jul 14 17:41:03 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:41:03.657152 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81c566c-7390-4cfe-8aff-52de463f9683 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:03.674080 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:03.787662 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81c566c-7390-4cfe-8aff-52de463f9683 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:03.818390 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878881ea-65bf-4312-8efb-02bb557df7b9 None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:03.819431 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878881ea-65bf-4312-8efb-02bb557df7b9 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:03.820001 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878881ea-65bf-4312-8efb-02bb557df7b9 None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:03.822353 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 480/954] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:41:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 17:41:03.828597 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6010dd67-f01f-4392-888f-ec0cfb4fb0ad None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:03.829234 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6010dd67-f01f-4392-888f-ec0cfb4fb0ad None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:03.829747 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6010dd67-f01f-4392-888f-ec0cfb4fb0ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:03.832332 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c87cad5-46cd-4d04-ac1a-a612d63e39f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:03.833043 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c87cad5-46cd-4d04-ac1a-a612d63e39f3 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:03.833362 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c87cad5-46cd-4d04-ac1a-a612d63e39f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:03.833699 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c87cad5-46cd-4d04-ac1a-a612d63e39f3 None admin] PATH_INFO: `/v3/services` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:03.834554 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c87cad5-46cd-4d04-ac1a-a612d63e39f3 None admin] RBAC: Adding query filter params (type=compute) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:41:03.834893 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c87cad5-46cd-4d04-ac1a-a612d63e39f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:03.837086 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c87cad5-46cd-4d04-ac1a-a612d63e39f3 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:03.843787 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 475/955] 10.222.0.67 () {56 vars in 1112 bytes} [Thu Jul 14 17:41:03 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:41:03.852947 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-6010dd67-f01f-4392-888f-ec0cfb4fb0ad None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:41:03.854893 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-6010dd67-f01f-4392-888f-ec0cfb4fb0ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:41:03.951729 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 481/956] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:41:03 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 17:41:03.975815 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c87cad5-46cd-4d04-ac1a-a612d63e39f3 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:04.067255 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:04.104198 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c87cad5-46cd-4d04-ac1a-a612d63e39f3 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:04.145879 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c136b95a-799c-4043-b207-09710598e8bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:04.147239 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c136b95a-799c-4043-b207-09710598e8bd None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:04.147774 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c136b95a-799c-4043-b207-09710598e8bd None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:04.148935 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c136b95a-799c-4043-b207-09710598e8bd None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:04.149916 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c136b95a-799c-4043-b207-09710598e8bd None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:04.151765 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c136b95a-799c-4043-b207-09710598e8bd None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:04.165865 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-c136b95a-799c-4043-b207-09710598e8bd None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 17:41:04.165865 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:41:04.165865 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 17:41:04.165865 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 17:41:04.165865 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 17:41:04.165865 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 17:41:04.165865 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 17:41:04.165865 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 17:41:04.165865 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 17:41:04.165865 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:41:04.165865 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 17:41:04.165865 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:41:04.165865 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:41:04.165865 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:41:04.165865 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:41:04.165865 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:41:04.165865 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:41:04.167258 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:41:04.167258 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:41:04.167258 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:41:04.167258 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:41:04.167258 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:41:04.167258 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:41:04.167258 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 17:41:04.167258 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 17:41:04.167258 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 17:41:04.167258 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 17:41:04.167258 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:41:04.167258 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:41:04.167258 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:41:04.167258 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:41:04.167258 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:41:04.167258 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:41:04.168185 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:41:04.168185 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:41:04.168185 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:41:04.168185 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:41:04.168185 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:41:04.168185 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:41:04.168185 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:41:04.168185 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:41:04.168185 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:41:04.168185 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:41:04.168185 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 17:41:04.168185 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 17:41:04.168185 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 17:41:04.168185 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:41:04.171746 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 476/957] 10.222.0.67 () {56 vars in 1126 bytes} [Thu Jul 14 17:41:03 2022] GET /identity/v3/services/object-store => generated 93 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:41:04.178139 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6010dd67-f01f-4392-888f-ec0cfb4fb0ad None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:04.302558 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6010dd67-f01f-4392-888f-ec0cfb4fb0ad None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:04.318886 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:04.343315 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790940f8-2eaf-4e68-b22e-204f3cddc2d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:04.344074 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790940f8-2eaf-4e68-b22e-204f3cddc2d5 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:04.344367 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790940f8-2eaf-4e68-b22e-204f3cddc2d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:04.344634 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790940f8-2eaf-4e68-b22e-204f3cddc2d5 None admin] PATH_INFO: `/v3/services` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:04.345437 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790940f8-2eaf-4e68-b22e-204f3cddc2d5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:41:04.345780 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790940f8-2eaf-4e68-b22e-204f3cddc2d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:04.347392 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790940f8-2eaf-4e68-b22e-204f3cddc2d5 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:04.353552 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 482/958] 10.222.0.67 () {56 vars in 1122 bytes} [Thu Jul 14 17:41:04 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:41:04.361098 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c136b95a-799c-4043-b207-09710598e8bd None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:04.525693 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c136b95a-799c-4043-b207-09710598e8bd None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:04.565732 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e9d3e7-a065-4fee-a30a-db967423b18b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:04.566355 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e9d3e7-a065-4fee-a30a-db967423b18b None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:04.566675 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e9d3e7-a065-4fee-a30a-db967423b18b None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:04.566961 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e9d3e7-a065-4fee-a30a-db967423b18b None admin] PATH_INFO: `/v3/services` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:04.567726 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e9d3e7-a065-4fee-a30a-db967423b18b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:41:04.568076 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e9d3e7-a065-4fee-a30a-db967423b18b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:04.569578 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e9d3e7-a065-4fee-a30a-db967423b18b None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:04.572626 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:04.576840 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 477/959] 10.222.0.67 () {56 vars in 1122 bytes} [Thu Jul 14 17:41:04 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:41:04.583446 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790940f8-2eaf-4e68-b22e-204f3cddc2d5 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:04.707117 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790940f8-2eaf-4e68-b22e-204f3cddc2d5 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:04.750016 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf27810-12c5-444c-98e4-764cf43c488b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:04.750754 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf27810-12c5-444c-98e4-764cf43c488b None admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:04.751068 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf27810-12c5-444c-98e4-764cf43c488b None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:04.751398 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf27810-12c5-444c-98e4-764cf43c488b None admin] PATH_INFO: `/v3/endpoints` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:04.752181 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf27810-12c5-444c-98e4-764cf43c488b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:04.753688 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf27810-12c5-444c-98e4-764cf43c488b None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:04.780557 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 483/960] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 14 17:41:04 2022] POST /identity/v3/endpoints => generated 349 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 17:41:05.065973 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64607925-7e19-4b46-b175-9761d1877ca6 None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:05.066692 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64607925-7e19-4b46-b175-9761d1877ca6 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:05.066692 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64607925-7e19-4b46-b175-9761d1877ca6 None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:05.068542 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 478/961] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:41:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:41:05.074704 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec9fde0-0e06-4ec9-925f-6f3fe907f835 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:05.075493 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec9fde0-0e06-4ec9-925f-6f3fe907f835 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:05.075493 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec9fde0-0e06-4ec9-925f-6f3fe907f835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:05.097383 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-5ec9fde0-0e06-4ec9-925f-6f3fe907f835 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:41:05.099424 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-5ec9fde0-0e06-4ec9-925f-6f3fe907f835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:41:05.150208 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:05.215333 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 484/962] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:41:05 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 17:41:05.249927 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64607925-7e19-4b46-b175-9761d1877ca6 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:05.432803 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64607925-7e19-4b46-b175-9761d1877ca6 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:05.504563 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9da13a7-399a-4060-a985-692bd6e5131e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:05.506209 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9da13a7-399a-4060-a985-692bd6e5131e None admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:05.506878 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9da13a7-399a-4060-a985-692bd6e5131e None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:05.508066 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9da13a7-399a-4060-a985-692bd6e5131e None admin] PATH_INFO: `/v3/users` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:05.509735 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9da13a7-399a-4060-a985-692bd6e5131e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:05.512555 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9da13a7-399a-4060-a985-692bd6e5131e None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:05.537725 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.sql.core [None req-d9da13a7-399a-4060-a985-692bd6e5131e None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 14 17:41:05.537725 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 14 17:41:05.537725 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [parameters: {'user_id': '77a5971269784edaaa9902795a51cfaf', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 14 17:41:05.537725 dv-cinder-849890-1-smb devstack@keystone.service[86772]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86772) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 14 17:41:05.555242 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-d9da13a7-399a-4060-a985-692bd6e5131e None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 14 17:41:05.555242 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:41:05.555242 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 17:41:05.555242 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 14 17:41:05.555242 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 17:41:05.555242 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 14 17:41:05.555242 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 17:41:05.555242 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application result = self._query(query) Jul 14 17:41:05.555242 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 17:41:05.555242 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application conn.query(q) Jul 14 17:41:05.555242 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 17:41:05.555242 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 17:41:05.555242 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 17:41:05.555242 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application result.read() Jul 14 17:41:05.555242 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 17:41:05.556961 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 14 17:41:05.556961 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 17:41:05.556961 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 14 17:41:05.556961 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 17:41:05.556961 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 14 17:41:05.556961 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 17:41:05.556961 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 14 17:41:05.556961 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 14 17:41:05.556961 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:41:05.556961 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 14 17:41:05.556961 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:41:05.556961 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:41:05.556961 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 14 17:41:05.556961 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 14 17:41:05.556961 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 14 17:41:05.556961 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 14 17:41:05.556961 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 14 17:41:05.556961 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application next(self.gen) Jul 14 17:41:05.558524 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 14 17:41:05.558524 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application yield resource Jul 14 17:41:05.558524 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 14 17:41:05.558524 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application next(self.gen) Jul 14 17:41:05.558524 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 14 17:41:05.558524 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application self.session.rollback() Jul 14 17:41:05.558524 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 17:41:05.558524 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application self.force_reraise() Jul 14 17:41:05.558524 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 17:41:05.558524 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise self.value Jul 14 17:41:05.558524 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 14 17:41:05.558524 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 14 17:41:05.558524 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 14 17:41:05.558524 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application session.commit() Jul 14 17:41:05.558524 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 14 17:41:05.558524 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 14 17:41:05.558524 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 14 17:41:05.560139 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application self._prepare_impl() Jul 14 17:41:05.560139 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 14 17:41:05.560139 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application self.session.flush() Jul 14 17:41:05.560139 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 14 17:41:05.560139 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application self._flush(objects) Jul 14 17:41:05.560139 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 14 17:41:05.560139 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 14 17:41:05.560139 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 14 17:41:05.560139 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application compat.raise_( Jul 14 17:41:05.560139 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 17:41:05.560139 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception Jul 14 17:41:05.560139 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 14 17:41:05.560139 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application flush_context.execute() Jul 14 17:41:05.560139 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 14 17:41:05.560139 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rec.execute(self) Jul 14 17:41:05.560139 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 14 17:41:05.560139 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 14 17:41:05.561971 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 14 17:41:05.561971 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 14 17:41:05.561971 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 14 17:41:05.561971 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 14 17:41:05.561971 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 14 17:41:05.561971 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 14 17:41:05.561971 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 14 17:41:05.561971 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 14 17:41:05.561971 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 14 17:41:05.561971 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 14 17:41:05.561971 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 14 17:41:05.561971 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 14 17:41:05.561971 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 14 17:41:05.561971 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 14 17:41:05.561971 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 17:41:05.561971 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception Jul 14 17:41:05.564010 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 17:41:05.564010 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 14 17:41:05.564010 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 17:41:05.564010 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 14 17:41:05.564010 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 17:41:05.564010 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application result = self._query(query) Jul 14 17:41:05.564010 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 17:41:05.564010 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application conn.query(q) Jul 14 17:41:05.564010 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 17:41:05.564010 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 17:41:05.564010 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 17:41:05.564010 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application result.read() Jul 14 17:41:05.564010 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 17:41:05.564010 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 14 17:41:05.564010 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 17:41:05.564010 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 14 17:41:05.565744 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 17:41:05.565744 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 14 17:41:05.565744 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 17:41:05.565744 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 14 17:41:05.565744 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 14 17:41:05.565744 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 14 17:41:05.565744 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [parameters: {'user_id': '77a5971269784edaaa9902795a51cfaf', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 14 17:41:05.565744 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 14 17:41:05.565744 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:41:05.565744 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 17:41:05.565744 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:41:05.565744 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:41:05.565744 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:41:05.565744 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:41:05.565744 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:41:05.566802 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:41:05.566802 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:41:05.566802 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:41:05.566802 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:41:05.566802 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:41:05.566802 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:41:05.566802 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:41:05.566802 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 14 17:41:05.566802 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 14 17:41:05.566802 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:41:05.566802 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:41:05.566802 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 17:41:05.566802 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:41:05.566802 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 17:41:05.566802 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:41:05.566802 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 14 17:41:05.566802 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 14 17:41:05.574408 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 14 17:41:05.574408 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 14 17:41:05.574408 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 14 17:41:05.574408 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 14 17:41:05.574408 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 14 17:41:05.574408 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:41:05.574408 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 479/963] 10.222.0.67 () {60 vars in 1131 bytes} [Thu Jul 14 17:41:05 2022] POST /identity/v3/users => generated 160 bytes in 310 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:41:05.575748 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec9fde0-0e06-4ec9-925f-6f3fe907f835 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:05.716946 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec9fde0-0e06-4ec9-925f-6f3fe907f835 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:05.757421 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f6465d-a678-4097-a789-55b490831f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:05.758360 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f6465d-a678-4097-a789-55b490831f18 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:05.758732 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f6465d-a678-4097-a789-55b490831f18 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:05.759014 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f6465d-a678-4097-a789-55b490831f18 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:05.767833 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f6465d-a678-4097-a789-55b490831f18 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:05.769488 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f6465d-a678-4097-a789-55b490831f18 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:05.786327 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-93f6465d-a678-4097-a789-55b490831f18 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 17:41:05.786327 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:41:05.786327 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:41:05.786327 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:41:05.786327 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:41:05.786327 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:41:05.786327 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:41:05.786327 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:41:05.786327 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:41:05.786327 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:41:05.786327 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:41:05.786327 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:41:05.786327 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 17:41:05.786327 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 17:41:05.786327 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 17:41:05.786327 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 17:41:05.788387 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:41:05.788387 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:41:05.788387 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 17:41:05.788387 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:41:05.788387 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 17:41:05.788387 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:41:05.788387 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:41:05.788387 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:41:05.788387 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:41:05.788387 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:41:05.788387 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:41:05.788387 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:41:05.788387 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:41:05.788387 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:41:05.788387 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:41:05.788387 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:41:05.788387 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:41:05.788387 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:41:05.790591 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:41:05.790591 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:41:05.790591 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 17:41:05.790591 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 17:41:05.790591 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 17:41:05.790591 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 17:41:05.790591 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 17:41:05.790591 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 17:41:05.790591 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 17:41:05.790591 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:41:05.790591 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 485/964] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 14 17:41:05 2022] GET /identity/v3/users/cinder => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:41:05.798489 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9da13a7-399a-4060-a985-692bd6e5131e None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:05.916193 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:05.974885 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9da13a7-399a-4060-a985-692bd6e5131e None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:06.041015 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80983556-b7b3-4fff-aa02-fc234496eaf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:06.042191 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80983556-b7b3-4fff-aa02-fc234496eaf6 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:06.042685 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80983556-b7b3-4fff-aa02-fc234496eaf6 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:06.043256 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80983556-b7b3-4fff-aa02-fc234496eaf6 None admin] PATH_INFO: `/v3/users` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:06.044970 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80983556-b7b3-4fff-aa02-fc234496eaf6 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:41:06.045516 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80983556-b7b3-4fff-aa02-fc234496eaf6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:06.048652 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80983556-b7b3-4fff-aa02-fc234496eaf6 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:06.058939 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57de003c-d369-49d4-961c-775a7e42450d None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:06.059270 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57de003c-d369-49d4-961c-775a7e42450d None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:06.059501 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57de003c-d369-49d4-961c-775a7e42450d None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:06.062875 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 486/965] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:41:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 17:41:06.068227 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2309d4-44f3-4cc7-90b2-7cea5d1e5518 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:06.068511 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2309d4-44f3-4cc7-90b2-7cea5d1e5518 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:06.068792 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2309d4-44f3-4cc7-90b2-7cea5d1e5518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:06.089339 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-cc2309d4-44f3-4cc7-90b2-7cea5d1e5518 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:41:06.090901 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-cc2309d4-44f3-4cc7-90b2-7cea5d1e5518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:41:06.118106 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:06.129863 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 480/966] 10.222.0.67 () {56 vars in 1101 bytes} [Thu Jul 14 17:41:05 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:41:06.181687 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 487/967] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:41:06 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 17:41:06.201513 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2309d4-44f3-4cc7-90b2-7cea5d1e5518 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:06.201738 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de55391-d05c-4c98-8617-ec1080498df7 None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:06.202137 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de55391-d05c-4c98-8617-ec1080498df7 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:06.202621 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de55391-d05c-4c98-8617-ec1080498df7 None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:06.205901 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 481/968] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:41:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:41:06.211997 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c3bce2-9511-4759-84c3-7527a8e5c7c5 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:06.212648 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c3bce2-9511-4759-84c3-7527a8e5c7c5 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:06.213131 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c3bce2-9511-4759-84c3-7527a8e5c7c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:06.235237 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-88c3bce2-9511-4759-84c3-7527a8e5c7c5 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:41:06.237216 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-88c3bce2-9511-4759-84c3-7527a8e5c7c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:41:06.329239 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2309d4-44f3-4cc7-90b2-7cea5d1e5518 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:06.329727 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 482/969] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:41:06 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 17:41:06.349107 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c3bce2-9511-4759-84c3-7527a8e5c7c5 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:06.400440 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1b314e-688a-427a-b22f-4c1187221039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:06.401756 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1b314e-688a-427a-b22f-4c1187221039 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:06.402190 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1b314e-688a-427a-b22f-4c1187221039 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:06.402621 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1b314e-688a-427a-b22f-4c1187221039 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:06.414953 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:06.425180 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1b314e-688a-427a-b22f-4c1187221039 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:41:06.444816 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-2f1b314e-688a-427a-b22f-4c1187221039 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 17:41:06.444816 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:41:06.444816 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:41:06.444816 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:41:06.444816 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:41:06.444816 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:41:06.444816 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:41:06.444816 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:41:06.444816 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:41:06.444816 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:41:06.444816 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:41:06.444816 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:41:06.444816 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:41:06.444816 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:41:06.444816 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:41:06.444816 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:41:06.446487 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:41:06.446487 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:41:06.446487 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:41:06.446487 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:41:06.446487 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:41:06.446487 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:41:06.446487 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:41:06.446487 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:41:06.446487 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:41:06.446487 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:41:06.446487 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:41:06.446487 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:41:06.446487 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:41:06.446487 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:41:06.446487 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:41:06.446487 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:41:06.447383 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:41:06.447383 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:41:06.447383 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:41:06.447383 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:41:06.447383 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:41:06.447383 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:41:06.447383 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:41:06.447383 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:41:06.447383 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:41:06.447383 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:41:06.447383 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 17:41:06.447383 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:41:06.448055 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 488/970] 10.222.0.67 () {56 vars in 1120 bytes} [Thu Jul 14 17:41:06 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:41:06.455454 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1b314e-688a-427a-b22f-4c1187221039 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:06.486517 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:06.492689 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c3bce2-9511-4759-84c3-7527a8e5c7c5 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:06.564410 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c47a59-53fa-45c4-a727-0b320d8b35e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:06.565286 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c47a59-53fa-45c4-a727-0b320d8b35e3 None admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:06.565809 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c47a59-53fa-45c4-a727-0b320d8b35e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:06.566217 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c47a59-53fa-45c4-a727-0b320d8b35e3 None admin] PATH_INFO: `/v3/services` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:06.567168 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c47a59-53fa-45c4-a727-0b320d8b35e3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:06.568838 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c47a59-53fa-45c4-a727-0b320d8b35e3 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:06.589922 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 483/971] 10.222.0.67 () {60 vars in 1141 bytes} [Thu Jul 14 17:41:06 2022] POST /identity/v3/services => generated 242 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:41:06.607809 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1b314e-688a-427a-b22f-4c1187221039 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:06.665012 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c89a89-5ecb-4d7c-bd82-2feaedbaba85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:06.665967 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c89a89-5ecb-4d7c-bd82-2feaedbaba85 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:06.666385 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c89a89-5ecb-4d7c-bd82-2feaedbaba85 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:06.666801 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c89a89-5ecb-4d7c-bd82-2feaedbaba85 None admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:06.667733 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c89a89-5ecb-4d7c-bd82-2feaedbaba85 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:41:06.668225 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c89a89-5ecb-4d7c-bd82-2feaedbaba85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:06.669910 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c89a89-5ecb-4d7c-bd82-2feaedbaba85 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:06.685126 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 489/972] 10.222.0.67 () {56 vars in 1115 bytes} [Thu Jul 14 17:41:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:41:06.686902 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c47a59-53fa-45c4-a727-0b320d8b35e3 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:06.828949 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c47a59-53fa-45c4-a727-0b320d8b35e3 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:06.841398 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:06.870603 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579371dc-3d56-4ac0-b0c3-653076c413cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:06.871418 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579371dc-3d56-4ac0-b0c3-653076c413cb None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:06.871695 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579371dc-3d56-4ac0-b0c3-653076c413cb None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:06.871971 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579371dc-3d56-4ac0-b0c3-653076c413cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:06.884125 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579371dc-3d56-4ac0-b0c3-653076c413cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:06.885621 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579371dc-3d56-4ac0-b0c3-653076c413cb None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:06.905104 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-579371dc-3d56-4ac0-b0c3-653076c413cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:41:06.905104 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:41:06.905104 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:41:06.905104 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:41:06.905104 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:41:06.905104 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:41:06.905104 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:41:06.905104 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:41:06.905104 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:41:06.905104 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:41:06.905104 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:41:06.905104 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:41:06.905104 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:41:06.905104 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:41:06.905104 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:41:06.911344 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:41:06.911344 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:41:06.911344 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:41:06.911344 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:41:06.911344 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:41:06.911344 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:41:06.911344 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:41:06.911344 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:41:06.911344 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:41:06.911344 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:41:06.911344 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:41:06.911344 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:41:06.911344 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:41:06.911344 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:41:06.911344 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:41:06.911344 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:41:06.911344 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:41:06.913561 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:41:06.913561 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:41:06.913561 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:41:06.913561 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:41:06.913561 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 484/973] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:41:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:41:06.919357 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c89a89-5ecb-4d7c-bd82-2feaedbaba85 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:07.010911 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:07.052527 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c89a89-5ecb-4d7c-bd82-2feaedbaba85 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:07.098754 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d46f4f-335e-4f11-879f-3cfd5251f21d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:07.099638 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d46f4f-335e-4f11-879f-3cfd5251f21d None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:07.099791 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d46f4f-335e-4f11-879f-3cfd5251f21d None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:07.100184 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d46f4f-335e-4f11-879f-3cfd5251f21d None admin] PATH_INFO: `/v3/domains` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:07.100897 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d46f4f-335e-4f11-879f-3cfd5251f21d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:41:07.101228 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d46f4f-335e-4f11-879f-3cfd5251f21d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:07.103606 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d46f4f-335e-4f11-879f-3cfd5251f21d None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:07.124750 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 490/974] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 14 17:41:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:41:07.131989 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579371dc-3d56-4ac0-b0c3-653076c413cb None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:07.299176 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579371dc-3d56-4ac0-b0c3-653076c413cb None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:07.357068 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb7fcaf-a4b0-4902-876f-68b51768b68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:07.358482 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb7fcaf-a4b0-4902-876f-68b51768b68d None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:07.358964 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb7fcaf-a4b0-4902-876f-68b51768b68d None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:07.359404 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb7fcaf-a4b0-4902-876f-68b51768b68d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:07.373722 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb7fcaf-a4b0-4902-876f-68b51768b68d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:07.375909 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb7fcaf-a4b0-4902-876f-68b51768b68d None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:07.403469 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-dfb7fcaf-a4b0-4902-876f-68b51768b68d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 17:41:07.403469 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:41:07.403469 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:41:07.403469 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:41:07.403469 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:41:07.403469 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:41:07.403469 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:41:07.403469 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:41:07.403469 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:41:07.403469 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:41:07.403469 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:41:07.403469 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:41:07.403469 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 17:41:07.403469 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 17:41:07.403469 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 17:41:07.403469 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 17:41:07.405368 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:41:07.405368 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:41:07.405368 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 17:41:07.405368 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:41:07.405368 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 17:41:07.405368 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:41:07.405368 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:41:07.405368 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:41:07.405368 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:41:07.405368 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:41:07.405368 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:41:07.405368 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:41:07.405368 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:41:07.405368 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:41:07.405368 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:41:07.405368 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:41:07.405368 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:41:07.405368 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:41:07.408087 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:41:07.408087 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:41:07.408087 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 17:41:07.408087 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 17:41:07.408087 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 17:41:07.408087 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 17:41:07.408087 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 17:41:07.408087 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 17:41:07.408087 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 17:41:07.408087 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:41:07.414649 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 485/975] 10.222.0.67 () {56 vars in 1117 bytes} [Thu Jul 14 17:41:07 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:41:07.415015 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d46f4f-335e-4f11-879f-3cfd5251f21d None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:07.494425 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a31ef-eb57-437a-9949-eba06848f056 None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:07.495107 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a31ef-eb57-437a-9949-eba06848f056 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:07.495515 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a31ef-eb57-437a-9949-eba06848f056 None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:07.497961 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 486/976] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:41:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:41:07.506586 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e92e94-16ec-4cfb-9659-e77bcd8c78e0 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:07.507112 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e92e94-16ec-4cfb-9659-e77bcd8c78e0 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:07.507675 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e92e94-16ec-4cfb-9659-e77bcd8c78e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:07.534424 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-69e92e94-16ec-4cfb-9659-e77bcd8c78e0 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:41:07.536034 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-69e92e94-16ec-4cfb-9659-e77bcd8c78e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:41:07.559879 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:07.585715 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d46f4f-335e-4f11-879f-3cfd5251f21d None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:07.633844 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:07.637601 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 487/977] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:41:07 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 17:41:07.654723 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c85d58-aa75-40fc-9b15-c2ff128a4078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:07.656049 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c85d58-aa75-40fc-9b15-c2ff128a4078 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:07.656625 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c85d58-aa75-40fc-9b15-c2ff128a4078 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:07.657193 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c85d58-aa75-40fc-9b15-c2ff128a4078 None admin] PATH_INFO: `/v3/users` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:07.658985 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c85d58-aa75-40fc-9b15-c2ff128a4078 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:41:07.659613 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c85d58-aa75-40fc-9b15-c2ff128a4078 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:07.662443 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c85d58-aa75-40fc-9b15-c2ff128a4078 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:07.672502 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e92e94-16ec-4cfb-9659-e77bcd8c78e0 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:07.687789 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 491/978] 10.222.0.67 () {56 vars in 1149 bytes} [Thu Jul 14 17:41:07 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:41:07.693598 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c85d58-aa75-40fc-9b15-c2ff128a4078 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:07.832745 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c85d58-aa75-40fc-9b15-c2ff128a4078 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:07.869183 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e92e94-16ec-4cfb-9659-e77bcd8c78e0 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:07.880933 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adee2a82-3e60-4563-a865-733452cd398a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:07.881984 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adee2a82-3e60-4563-a865-733452cd398a None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:07.882516 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adee2a82-3e60-4563-a865-733452cd398a None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:07.882982 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adee2a82-3e60-4563-a865-733452cd398a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:07.941265 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d1eaa-6048-4681-abb9-2db426711729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:07.942942 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d1eaa-6048-4681-abb9-2db426711729 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:07.943437 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d1eaa-6048-4681-abb9-2db426711729 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:07.943978 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d1eaa-6048-4681-abb9-2db426711729 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:07.945367 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430d1eaa-6048-4681-abb9-2db426711729 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:07.948182 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430d1eaa-6048-4681-abb9-2db426711729 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:07.967389 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:07.975297 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-430d1eaa-6048-4681-abb9-2db426711729 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 17:41:07.975297 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:41:07.975297 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 17:41:07.975297 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 17:41:07.975297 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 17:41:07.975297 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 17:41:07.975297 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 17:41:07.975297 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 17:41:07.975297 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 17:41:07.975297 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:41:07.975297 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 17:41:07.975297 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:41:07.975297 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:41:07.975297 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:41:07.975297 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:41:07.975297 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:41:07.975297 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:41:07.977572 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:41:07.977572 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:41:07.977572 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:41:07.977572 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:41:07.977572 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:41:07.977572 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:41:07.977572 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 17:41:07.977572 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 17:41:07.977572 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 17:41:07.977572 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 17:41:07.977572 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:41:07.977572 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:41:07.977572 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:41:07.977572 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:41:07.977572 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:41:07.977572 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:41:07.979131 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:41:07.979131 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:41:07.979131 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:41:07.979131 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:41:07.979131 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:41:07.979131 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:41:07.979131 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:41:07.979131 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:41:07.979131 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:41:07.979131 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:41:07.979131 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 17:41:07.979131 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 17:41:07.979131 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 17:41:07.979131 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:41:07.979131 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 488/979] 10.222.0.67 () {56 vars in 1126 bytes} [Thu Jul 14 17:41:07 2022] GET /identity/v3/services/object-store => generated 93 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 17:41:07.984956 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d1eaa-6048-4681-abb9-2db426711729 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:07.995516 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adee2a82-3e60-4563-a865-733452cd398a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:07.998245 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adee2a82-3e60-4563-a865-733452cd398a None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:08.017412 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:08.142465 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d1eaa-6048-4681-abb9-2db426711729 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:08.158893 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 492/980] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 14 17:41:07 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 14 17:41:08.165768 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adee2a82-3e60-4563-a865-733452cd398a None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:08.195127 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d2efc2-5586-4b10-948c-6abfb929e5af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:08.196094 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d2efc2-5586-4b10-948c-6abfb929e5af None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:08.196256 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d2efc2-5586-4b10-948c-6abfb929e5af None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:08.196587 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d2efc2-5586-4b10-948c-6abfb929e5af None admin] PATH_INFO: `/v3/services` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:08.197282 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d2efc2-5586-4b10-948c-6abfb929e5af None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:41:08.197685 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d2efc2-5586-4b10-948c-6abfb929e5af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:08.199010 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d2efc2-5586-4b10-948c-6abfb929e5af None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:08.204919 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 489/981] 10.222.0.67 () {56 vars in 1122 bytes} [Thu Jul 14 17:41:07 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:41:08.214536 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d2efc2-5586-4b10-948c-6abfb929e5af None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:08.289643 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:08.316981 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adee2a82-3e60-4563-a865-733452cd398a None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:08.354591 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:08.378125 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50565ff-9564-4cc4-ba32-6f37e2833330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:08.378959 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50565ff-9564-4cc4-ba32-6f37e2833330 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:08.379240 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50565ff-9564-4cc4-ba32-6f37e2833330 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:08.379517 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50565ff-9564-4cc4-ba32-6f37e2833330 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:08.396424 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d2efc2-5586-4b10-948c-6abfb929e5af None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:08.397460 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50565ff-9564-4cc4-ba32-6f37e2833330 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:08.400764 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50565ff-9564-4cc4-ba32-6f37e2833330 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:08.434346 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-a50565ff-9564-4cc4-ba32-6f37e2833330 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:41:08.434346 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:41:08.434346 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:41:08.434346 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:41:08.434346 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:41:08.434346 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:41:08.434346 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:41:08.434346 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:41:08.434346 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:41:08.434346 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:41:08.434346 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:41:08.434346 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:41:08.434346 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:41:08.434346 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:41:08.434346 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:41:08.435591 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:41:08.435591 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:41:08.435591 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:41:08.435591 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:41:08.435591 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:41:08.435591 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:41:08.435591 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:41:08.435591 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:41:08.435591 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:41:08.435591 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:41:08.435591 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:41:08.435591 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:41:08.435591 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:41:08.435591 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:41:08.435591 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:41:08.435591 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:41:08.435591 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:41:08.436766 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:41:08.436766 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:41:08.436766 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:41:08.436766 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:41:08.437011 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 493/982] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:41:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 17:41:08.441286 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5922afb0-e859-441b-b1f3-ba16d8101a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:08.442901 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50565ff-9564-4cc4-ba32-6f37e2833330 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:08.444615 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5922afb0-e859-441b-b1f3-ba16d8101a40 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:08.445824 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5922afb0-e859-441b-b1f3-ba16d8101a40 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:08.446263 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5922afb0-e859-441b-b1f3-ba16d8101a40 None admin] PATH_INFO: `/v3/services` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:08.447599 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5922afb0-e859-441b-b1f3-ba16d8101a40 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:41:08.448139 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5922afb0-e859-441b-b1f3-ba16d8101a40 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:08.450706 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5922afb0-e859-441b-b1f3-ba16d8101a40 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:08.464188 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 490/983] 10.222.0.67 () {56 vars in 1122 bytes} [Thu Jul 14 17:41:08 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:41:08.471987 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5922afb0-e859-441b-b1f3-ba16d8101a40 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:08.604815 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50565ff-9564-4cc4-ba32-6f37e2833330 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:08.663278 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5922afb0-e859-441b-b1f3-ba16d8101a40 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:08.667427 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925cfbfc-6e83-4b30-bd55-0753430d157a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:08.668112 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925cfbfc-6e83-4b30-bd55-0753430d157a None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:08.668390 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925cfbfc-6e83-4b30-bd55-0753430d157a None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:08.668653 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925cfbfc-6e83-4b30-bd55-0753430d157a None admin] PATH_INFO: `/v3/domains` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:08.669408 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925cfbfc-6e83-4b30-bd55-0753430d157a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:41:08.669742 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925cfbfc-6e83-4b30-bd55-0753430d157a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:08.671166 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925cfbfc-6e83-4b30-bd55-0753430d157a None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:08.680837 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:08.689592 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 494/984] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 14 17:41:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:41:08.696993 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925cfbfc-6e83-4b30-bd55-0753430d157a None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:08.730718 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310314dc-72e2-4c2c-8be0-8436689b9f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:08.731844 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310314dc-72e2-4c2c-8be0-8436689b9f29 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:08.732291 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310314dc-72e2-4c2c-8be0-8436689b9f29 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:08.732724 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310314dc-72e2-4c2c-8be0-8436689b9f29 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:08.734179 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310314dc-72e2-4c2c-8be0-8436689b9f29 None admin] RBAC: Adding query filter params (interface=admin, service_id=f917ec9f3c59498d9b819929a72b60ec, region_id=RegionOne) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:41:08.734682 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310314dc-72e2-4c2c-8be0-8436689b9f29 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:08.737254 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310314dc-72e2-4c2c-8be0-8436689b9f29 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:08.749592 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 491/985] 10.222.0.67 () {56 vars in 1249 bytes} [Thu Jul 14 17:41:08 2022] GET /identity/v3/endpoints?service_id=f917ec9f3c59498d9b819929a72b60ec&interface=admin®ion_id=RegionOne => generated 193 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:41:08.755477 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310314dc-72e2-4c2c-8be0-8436689b9f29 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:08.780214 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:08.872537 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925cfbfc-6e83-4b30-bd55-0753430d157a None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:08.921791 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310314dc-72e2-4c2c-8be0-8436689b9f29 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:08.946942 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f3d43b-8863-4ba4-a2c4-5e45a6d66f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:08.947970 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f3d43b-8863-4ba4-a2c4-5e45a6d66f97 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:08.948357 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f3d43b-8863-4ba4-a2c4-5e45a6d66f97 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:08.948515 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f3d43b-8863-4ba4-a2c4-5e45a6d66f97 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:08.958373 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f3d43b-8863-4ba4-a2c4-5e45a6d66f97 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:08.959859 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f3d43b-8863-4ba4-a2c4-5e45a6d66f97 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:08.976582 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-15f3d43b-8863-4ba4-a2c4-5e45a6d66f97 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:41:08.976582 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:41:08.976582 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:41:08.976582 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:41:08.976582 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:41:08.976582 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:41:08.976582 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:41:08.976582 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:41:08.976582 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:41:08.976582 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:41:08.976582 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:41:08.976582 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:41:08.976582 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 17:41:08.976582 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 17:41:08.976582 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 17:41:08.978589 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 17:41:08.978589 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:41:08.978589 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:41:08.978589 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:41:08.978589 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:41:08.978589 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:41:08.978589 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:41:08.978589 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:41:08.978589 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:41:08.978589 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:41:08.978589 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:41:08.978589 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:41:08.978589 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:41:08.978589 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:41:08.978589 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:41:08.978589 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:41:08.978589 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:41:08.980709 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 17:41:08.980709 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 17:41:08.980709 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 17:41:08.980709 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 17:41:08.980709 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 17:41:08.980709 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 17:41:08.980709 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:41:08.980709 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:41:08.980709 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 495/986] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 14 17:41:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:41:08.980709 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55d25f-2593-4bec-b53a-0fa415fb013d None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:08.980709 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55d25f-2593-4bec-b53a-0fa415fb013d None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:08.982448 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55d25f-2593-4bec-b53a-0fa415fb013d None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:08.982448 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 496/987] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:41:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:41:08.986521 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c55d25f-2593-4bec-b53a-0fa415fb013d None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:08.995016 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefa3b74-a43f-4ee8-a378-be4a6d75b1b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:08.995838 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefa3b74-a43f-4ee8-a378-be4a6d75b1b8 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:08.996234 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefa3b74-a43f-4ee8-a378-be4a6d75b1b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:08.996726 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefa3b74-a43f-4ee8-a378-be4a6d75b1b8 None admin] PATH_INFO: `/v3/services` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:08.998325 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefa3b74-a43f-4ee8-a378-be4a6d75b1b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:09.000522 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefa3b74-a43f-4ee8-a378-be4a6d75b1b8 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:09.008832 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 492/988] 10.222.0.67 () {56 vars in 1087 bytes} [Thu Jul 14 17:41:08 2022] GET /identity/v3/services => generated 1727 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 17:41:09.010260 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54854ece-9595-4b4d-97e3-7bac44e36ff6 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:09.010549 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54854ece-9595-4b4d-97e3-7bac44e36ff6 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:09.010993 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54854ece-9595-4b4d-97e3-7bac44e36ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:09.037304 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-54854ece-9595-4b4d-97e3-7bac44e36ff6 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:41:09.038655 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-54854ece-9595-4b4d-97e3-7bac44e36ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:41:09.110328 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:09.157582 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 493/989] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:41:09 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 17:41:09.179949 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c55d25f-2593-4bec-b53a-0fa415fb013d None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:09.197445 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54854ece-9595-4b4d-97e3-7bac44e36ff6 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:09.200776 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:09.231506 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e241f197-71ca-426f-aa20-89e10db3f0f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:09.232197 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e241f197-71ca-426f-aa20-89e10db3f0f9 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:09.232542 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e241f197-71ca-426f-aa20-89e10db3f0f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:09.232821 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e241f197-71ca-426f-aa20-89e10db3f0f9 None admin] PATH_INFO: `/v3/projects` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:09.233713 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e241f197-71ca-426f-aa20-89e10db3f0f9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:41:09.234026 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e241f197-71ca-426f-aa20-89e10db3f0f9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:09.235509 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e241f197-71ca-426f-aa20-89e10db3f0f9 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:09.250269 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 497/990] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 14 17:41:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:41:09.258100 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e241f197-71ca-426f-aa20-89e10db3f0f9 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:09.364589 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e241f197-71ca-426f-aa20-89e10db3f0f9 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:09.383485 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:09.404261 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e2933a-4dc8-42cf-9633-193df3a4d441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:09.404514 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54854ece-9595-4b4d-97e3-7bac44e36ff6 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:09.404931 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e2933a-4dc8-42cf-9633-193df3a4d441 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:09.405211 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e2933a-4dc8-42cf-9633-193df3a4d441 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:09.405485 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e2933a-4dc8-42cf-9633-193df3a4d441 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:09.406580 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e2933a-4dc8-42cf-9633-193df3a4d441 None admin] RBAC: Adding query filter params (role.id=4a2ee10af7ed4ffab3293e28d925b9ab, scope.project.id=39a570421bb64fac8b1a0129f1bcc7d9, user.id=45542602225b452fa323f5499c1843ec) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:41:09.407030 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e2933a-4dc8-42cf-9633-193df3a4d441 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:09.408415 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e2933a-4dc8-42cf-9633-193df3a4d441 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:09.425578 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 498/991] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 14 17:41:09 2022] GET /identity/v3/role_assignments?user.id=45542602225b452fa323f5499c1843ec&scope.project.id=39a570421bb64fac8b1a0129f1bcc7d9&role.id=4a2ee10af7ed4ffab3293e28d925b9ab => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:41:09.473926 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e69c752-b485-48e2-ad7d-21c99726af53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:09.474849 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e69c752-b485-48e2-ad7d-21c99726af53 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:09.475124 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e69c752-b485-48e2-ad7d-21c99726af53 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:09.475455 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e69c752-b485-48e2-ad7d-21c99726af53 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:09.476841 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e69c752-b485-48e2-ad7d-21c99726af53 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:09.478745 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e69c752-b485-48e2-ad7d-21c99726af53 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:09.494102 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-0e69c752-b485-48e2-ad7d-21c99726af53 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 17:41:09.494102 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:41:09.494102 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 17:41:09.494102 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 17:41:09.494102 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 17:41:09.494102 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 17:41:09.494102 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 17:41:09.494102 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 17:41:09.494102 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 17:41:09.494102 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:41:09.494102 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 17:41:09.494102 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:41:09.494102 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:41:09.494102 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:41:09.494102 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:41:09.494102 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:41:09.494102 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:41:09.497918 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:41:09.497918 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:41:09.497918 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:41:09.497918 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:41:09.497918 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:41:09.497918 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:41:09.497918 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 17:41:09.497918 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 17:41:09.497918 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 17:41:09.497918 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 17:41:09.497918 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:41:09.497918 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:41:09.497918 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:41:09.497918 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:41:09.497918 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:41:09.497918 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:41:09.498868 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:41:09.498868 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:41:09.498868 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:41:09.498868 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:41:09.498868 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:41:09.498868 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:41:09.498868 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:41:09.498868 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:41:09.498868 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:41:09.498868 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:41:09.498868 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 17:41:09.498868 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 17:41:09.498868 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 17:41:09.498868 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:41:09.498868 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 494/992] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 14 17:41:09 2022] GET /identity/v3/services/compute => generated 88 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:41:09.505428 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e2933a-4dc8-42cf-9633-193df3a4d441 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:09.640306 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e2933a-4dc8-42cf-9633-193df3a4d441 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:09.680857 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76657dc-83b4-41c9-859c-d75e2f41dfaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:09.681564 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76657dc-83b4-41c9-859c-d75e2f41dfaf None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:09.681858 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76657dc-83b4-41c9-859c-d75e2f41dfaf None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:09.682140 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76657dc-83b4-41c9-859c-d75e2f41dfaf None admin] PATH_INFO: `/v3/services` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:09.682866 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76657dc-83b4-41c9-859c-d75e2f41dfaf None admin] RBAC: Adding query filter params (name=compute) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:41:09.683254 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76657dc-83b4-41c9-859c-d75e2f41dfaf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:09.684657 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76657dc-83b4-41c9-859c-d75e2f41dfaf None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:09.690502 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 499/993] 10.222.0.67 () {56 vars in 1112 bytes} [Thu Jul 14 17:41:09 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:41:09.696897 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e69c752-b485-48e2-ad7d-21c99726af53 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:09.787592 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:09.834591 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e69c752-b485-48e2-ad7d-21c99726af53 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:09.874234 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6690cb8-3414-4e1e-8899-f6742a35ae5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:09.875320 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6690cb8-3414-4e1e-8899-f6742a35ae5b None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:09.875609 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6690cb8-3414-4e1e-8899-f6742a35ae5b None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:09.875888 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6690cb8-3414-4e1e-8899-f6742a35ae5b None admin] PATH_INFO: `/v3/services` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:09.876656 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6690cb8-3414-4e1e-8899-f6742a35ae5b None admin] RBAC: Adding query filter params (type=compute) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:41:09.876963 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6690cb8-3414-4e1e-8899-f6742a35ae5b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:09.878368 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6690cb8-3414-4e1e-8899-f6742a35ae5b None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:09.884578 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 495/994] 10.222.0.67 () {56 vars in 1112 bytes} [Thu Jul 14 17:41:09 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:41:09.890679 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76657dc-83b4-41c9-859c-d75e2f41dfaf None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:09.952483 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:10.018934 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76657dc-83b4-41c9-859c-d75e2f41dfaf None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:10.058408 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ca6a3d-d507-41d0-b380-01daba8859ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:10.058994 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ca6a3d-d507-41d0-b380-01daba8859ae None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:10.059272 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ca6a3d-d507-41d0-b380-01daba8859ae None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:10.059547 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ca6a3d-d507-41d0-b380-01daba8859ae None admin] PATH_INFO: `/v3/endpoints` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:10.060347 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ca6a3d-d507-41d0-b380-01daba8859ae None admin] RBAC: Adding query filter params (interface=public, service_id=989b7248c9804acc84896e99908ee981, region_id=RegionOne) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:41:10.060659 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ca6a3d-d507-41d0-b380-01daba8859ae None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:10.062068 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ca6a3d-d507-41d0-b380-01daba8859ae None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:10.068117 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 500/995] 10.222.0.67 () {56 vars in 1251 bytes} [Thu Jul 14 17:41:09 2022] GET /identity/v3/endpoints?service_id=989b7248c9804acc84896e99908ee981&interface=public®ion_id=RegionOne => generated 194 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:41:10.074212 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6690cb8-3414-4e1e-8899-f6742a35ae5b None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:10.192496 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6690cb8-3414-4e1e-8899-f6742a35ae5b None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:10.228221 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:10.235609 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa268b94-d433-4aa1-b888-f40558f7026d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:10.236717 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa268b94-d433-4aa1-b888-f40558f7026d None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:10.237195 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa268b94-d433-4aa1-b888-f40558f7026d None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:10.237694 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa268b94-d433-4aa1-b888-f40558f7026d None admin] PATH_INFO: `/v3/services` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:10.238608 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa268b94-d433-4aa1-b888-f40558f7026d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:10.240307 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa268b94-d433-4aa1-b888-f40558f7026d None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:10.248695 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 496/996] 10.222.0.67 () {56 vars in 1087 bytes} [Thu Jul 14 17:41:10 2022] GET /identity/v3/services => generated 1727 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:41:11.676916 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e9b06-2adf-4c41-8aa0-71b8b3d39afa None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:11.677438 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e9b06-2adf-4c41-8aa0-71b8b3d39afa None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:11.677993 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e9b06-2adf-4c41-8aa0-71b8b3d39afa None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:11.680042 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 501/997] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:41:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:41:11.685960 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1086af-a815-4124-a378-bf584204fc82 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:11.686578 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1086af-a815-4124-a378-bf584204fc82 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:11.686578 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1086af-a815-4124-a378-bf584204fc82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:11.706915 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-ab1086af-a815-4124-a378-bf584204fc82 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:41:11.708239 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-ab1086af-a815-4124-a378-bf584204fc82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:41:11.794841 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 497/998] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:41:11 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 17:41:11.818961 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384e9b06-2adf-4c41-8aa0-71b8b3d39afa None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:11.879283 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd12594-1c2e-4512-8761-1172bbe51cea None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:11.879890 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd12594-1c2e-4512-8761-1172bbe51cea None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:11.880223 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd12594-1c2e-4512-8761-1172bbe51cea None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:11.882749 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 498/999] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:41:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 17:41:11.889012 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd16362-ae0f-4151-9e94-844ec073ee71 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:11.889448 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd16362-ae0f-4151-9e94-844ec073ee71 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:11.889925 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd16362-ae0f-4151-9e94-844ec073ee71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:11.914807 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-4bd16362-ae0f-4151-9e94-844ec073ee71 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:41:11.917098 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-4bd16362-ae0f-4151-9e94-844ec073ee71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:41:11.948759 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384e9b06-2adf-4c41-8aa0-71b8b3d39afa None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:11.966419 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:12.013802 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e68cda-d567-473a-83ac-2d0b6e6bce4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:12.014553 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e68cda-d567-473a-83ac-2d0b6e6bce4f None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:12.014838 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e68cda-d567-473a-83ac-2d0b6e6bce4f None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:12.015117 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e68cda-d567-473a-83ac-2d0b6e6bce4f None admin] PATH_INFO: `/v3/services/image` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:12.015807 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e68cda-d567-473a-83ac-2d0b6e6bce4f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:12.017310 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e68cda-d567-473a-83ac-2d0b6e6bce4f None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:12.031255 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 499/1000] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:41:11 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 17:41:12.032233 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-a1e68cda-d567-473a-83ac-2d0b6e6bce4f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 17:41:12.032233 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:41:12.032233 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 17:41:12.032233 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 17:41:12.032233 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 17:41:12.032233 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 17:41:12.032233 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 17:41:12.032233 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 17:41:12.032233 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 17:41:12.032233 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:41:12.032233 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 17:41:12.032233 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:41:12.032233 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:41:12.032233 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:41:12.032233 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:41:12.032233 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:41:12.032233 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:41:12.033262 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:41:12.033262 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:41:12.033262 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:41:12.033262 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:41:12.033262 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:41:12.033262 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:41:12.033262 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 17:41:12.033262 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 17:41:12.033262 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 17:41:12.033262 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 17:41:12.033262 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:41:12.033262 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:41:12.033262 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:41:12.033262 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:41:12.033262 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:41:12.033262 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:41:12.034395 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:41:12.034395 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:41:12.034395 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:41:12.034395 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:41:12.034395 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:41:12.034395 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:41:12.034395 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:41:12.034395 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:41:12.034395 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:41:12.034395 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:41:12.034395 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 17:41:12.034395 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 17:41:12.034395 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 17:41:12.034395 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:41:12.037691 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 502/1001] 10.222.0.67 () {56 vars in 1105 bytes} [Thu Jul 14 17:41:11 2022] GET /identity/v3/services/image => generated 86 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 17:41:12.042543 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd16362-ae0f-4151-9e94-844ec073ee71 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:12.055142 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e68cda-d567-473a-83ac-2d0b6e6bce4f None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:12.117748 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:12.178233 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd16362-ae0f-4151-9e94-844ec073ee71 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:12.193820 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e68cda-d567-473a-83ac-2d0b6e6bce4f None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:12.237732 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65aa057-97e6-4ad2-96d7-5eaf49d5f15b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:12.238421 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65aa057-97e6-4ad2-96d7-5eaf49d5f15b None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:12.238705 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65aa057-97e6-4ad2-96d7-5eaf49d5f15b None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:12.238989 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65aa057-97e6-4ad2-96d7-5eaf49d5f15b None admin] PATH_INFO: `/v3/services` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:12.239715 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65aa057-97e6-4ad2-96d7-5eaf49d5f15b None admin] RBAC: Adding query filter params (name=image) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:41:12.240076 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65aa057-97e6-4ad2-96d7-5eaf49d5f15b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:12.241399 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65aa057-97e6-4ad2-96d7-5eaf49d5f15b None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:12.243450 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49baa9f8-d130-4f79-976e-dd089feccebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:12.245148 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49baa9f8-d130-4f79-976e-dd089feccebd None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:12.245703 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49baa9f8-d130-4f79-976e-dd089feccebd None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:12.246229 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49baa9f8-d130-4f79-976e-dd089feccebd None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:12.247514 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49baa9f8-d130-4f79-976e-dd089feccebd None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:12.248762 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 500/1002] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:41:12 2022] GET /identity/v3/services?name=image => generated 122 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:41:12.250010 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49baa9f8-d130-4f79-976e-dd089feccebd None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:12.255085 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65aa057-97e6-4ad2-96d7-5eaf49d5f15b None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:12.282833 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-49baa9f8-d130-4f79-976e-dd089feccebd None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 17:41:12.282833 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:41:12.282833 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 17:41:12.282833 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 17:41:12.282833 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 17:41:12.282833 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 17:41:12.282833 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 17:41:12.282833 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 17:41:12.282833 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 17:41:12.282833 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:41:12.282833 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 17:41:12.282833 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:41:12.282833 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:41:12.282833 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:41:12.282833 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:41:12.282833 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:41:12.282833 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:41:12.283954 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:41:12.283954 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:41:12.283954 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:41:12.283954 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:41:12.283954 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:41:12.283954 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:41:12.283954 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 17:41:12.283954 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 17:41:12.283954 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 17:41:12.283954 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 17:41:12.283954 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:41:12.283954 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:41:12.283954 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:41:12.283954 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:41:12.283954 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:41:12.283954 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:41:12.284837 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:41:12.284837 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:41:12.284837 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:41:12.284837 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:41:12.284837 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:41:12.284837 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:41:12.284837 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:41:12.284837 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:41:12.284837 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:41:12.284837 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:41:12.284837 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 17:41:12.284837 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 17:41:12.284837 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 17:41:12.284837 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:41:12.284837 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 503/1003] 10.222.0.67 () {56 vars in 1126 bytes} [Thu Jul 14 17:41:12 2022] GET /identity/v3/services/object-store => generated 93 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 17:41:12.291400 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49baa9f8-d130-4f79-976e-dd089feccebd None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:12.350770 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:12.415981 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65aa057-97e6-4ad2-96d7-5eaf49d5f15b None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:12.447320 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:12.448198 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49baa9f8-d130-4f79-976e-dd089feccebd None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:12.475110 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcaec77-ff40-4ad9-adb9-491e0658b6dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:12.475877 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcaec77-ff40-4ad9-adb9-491e0658b6dc None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:12.476261 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcaec77-ff40-4ad9-adb9-491e0658b6dc None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:12.477071 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcaec77-ff40-4ad9-adb9-491e0658b6dc None admin] PATH_INFO: `/v3/services` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:12.477900 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcaec77-ff40-4ad9-adb9-491e0658b6dc None admin] RBAC: Adding query filter params (type=image) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:41:12.478244 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcaec77-ff40-4ad9-adb9-491e0658b6dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:12.479716 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcaec77-ff40-4ad9-adb9-491e0658b6dc None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:12.484855 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 501/1004] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:41:12 2022] GET /identity/v3/services?type=image => generated 122 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:41:12.486492 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52992d99-4534-4fdf-980b-78df54f21a82 None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:12.486983 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52992d99-4534-4fdf-980b-78df54f21a82 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:12.487267 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52992d99-4534-4fdf-980b-78df54f21a82 None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:12.488852 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 502/1005] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:41:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:41:12.497426 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244fd581-5f7b-466b-b45f-65120d538da6 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:12.498028 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244fd581-5f7b-466b-b45f-65120d538da6 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:12.498315 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244fd581-5f7b-466b-b45f-65120d538da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:12.500024 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae071153-a24c-4a6d-9a85-419842dac93b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:12.500725 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae071153-a24c-4a6d-9a85-419842dac93b None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:12.501083 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae071153-a24c-4a6d-9a85-419842dac93b None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:12.501333 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae071153-a24c-4a6d-9a85-419842dac93b None admin] PATH_INFO: `/v3/services` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:12.502124 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae071153-a24c-4a6d-9a85-419842dac93b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:41:12.502528 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae071153-a24c-4a6d-9a85-419842dac93b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:12.504193 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae071153-a24c-4a6d-9a85-419842dac93b None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:12.514240 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 504/1006] 10.222.0.67 () {56 vars in 1122 bytes} [Thu Jul 14 17:41:12 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:41:12.518953 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae071153-a24c-4a6d-9a85-419842dac93b None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:12.520690 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-244fd581-5f7b-466b-b45f-65120d538da6 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:41:12.522027 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-244fd581-5f7b-466b-b45f-65120d538da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:41:12.626081 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 503/1007] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:41:12 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 17:41:12.645117 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244fd581-5f7b-466b-b45f-65120d538da6 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:12.671845 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae071153-a24c-4a6d-9a85-419842dac93b None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:12.674390 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:12.723345 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecec427-080b-419d-92a6-85bff8004b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:12.724060 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecec427-080b-419d-92a6-85bff8004b28 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:12.724346 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecec427-080b-419d-92a6-85bff8004b28 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:12.724687 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecec427-080b-419d-92a6-85bff8004b28 None admin] PATH_INFO: `/v3/services` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:12.725428 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecec427-080b-419d-92a6-85bff8004b28 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:41:12.725770 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecec427-080b-419d-92a6-85bff8004b28 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:12.728201 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecec427-080b-419d-92a6-85bff8004b28 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:12.741586 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 505/1008] 10.222.0.67 () {56 vars in 1122 bytes} [Thu Jul 14 17:41:12 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:41:12.745194 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecec427-080b-419d-92a6-85bff8004b28 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:12.834860 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244fd581-5f7b-466b-b45f-65120d538da6 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:12.855500 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:12.886063 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4177d95-6626-43b6-82a9-8f443d91c974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:12.887195 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4177d95-6626-43b6-82a9-8f443d91c974 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:12.887664 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4177d95-6626-43b6-82a9-8f443d91c974 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:12.888247 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4177d95-6626-43b6-82a9-8f443d91c974 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:12.888974 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4177d95-6626-43b6-82a9-8f443d91c974 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:12.890784 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecec427-080b-419d-92a6-85bff8004b28 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:12.891153 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4177d95-6626-43b6-82a9-8f443d91c974 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:12.908618 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-a4177d95-6626-43b6-82a9-8f443d91c974 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 17:41:12.908618 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:41:12.908618 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 17:41:12.908618 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 17:41:12.908618 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 17:41:12.908618 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 17:41:12.908618 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 17:41:12.908618 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 17:41:12.908618 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 17:41:12.908618 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:41:12.908618 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 17:41:12.908618 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:41:12.908618 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:41:12.908618 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:41:12.908618 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:41:12.908618 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:41:12.908618 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:41:12.910079 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:41:12.910079 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:41:12.910079 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:41:12.910079 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:41:12.910079 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:41:12.910079 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:41:12.910079 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 17:41:12.910079 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 17:41:12.910079 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 17:41:12.910079 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 17:41:12.910079 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:41:12.910079 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:41:12.910079 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:41:12.910079 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:41:12.910079 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:41:12.910079 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:41:12.911772 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:41:12.911772 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:41:12.911772 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:41:12.911772 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:41:12.911772 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:41:12.911772 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:41:12.911772 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:41:12.911772 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:41:12.911772 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:41:12.911772 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:41:12.911772 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 17:41:12.911772 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 17:41:12.911772 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 17:41:12.911772 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:41:12.911772 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 504/1009] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 14 17:41:12 2022] GET /identity/v3/services/compute => generated 88 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:41:12.916110 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4177d95-6626-43b6-82a9-8f443d91c974 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:12.939533 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0680d36b-ea75-41fe-be09-b04615371e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:12.940212 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0680d36b-ea75-41fe-be09-b04615371e8d None admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:12.940493 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0680d36b-ea75-41fe-be09-b04615371e8d None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:12.940771 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0680d36b-ea75-41fe-be09-b04615371e8d None admin] PATH_INFO: `/v3/endpoints` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:12.941580 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0680d36b-ea75-41fe-be09-b04615371e8d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:12.942965 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0680d36b-ea75-41fe-be09-b04615371e8d None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:12.966869 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 506/1010] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 14 17:41:12 2022] POST /identity/v3/endpoints => generated 325 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:41:13.057700 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4177d95-6626-43b6-82a9-8f443d91c974 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:13.112204 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ad34b9-adea-49f0-8422-4fadf78477cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:13.112929 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ad34b9-adea-49f0-8422-4fadf78477cf None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:13.113190 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ad34b9-adea-49f0-8422-4fadf78477cf None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:13.113511 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ad34b9-adea-49f0-8422-4fadf78477cf None admin] PATH_INFO: `/v3/services` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:13.114403 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ad34b9-adea-49f0-8422-4fadf78477cf None admin] RBAC: Adding query filter params (name=compute) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:41:13.114715 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ad34b9-adea-49f0-8422-4fadf78477cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:13.116407 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ad34b9-adea-49f0-8422-4fadf78477cf None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:13.129685 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 505/1011] 10.222.0.67 () {56 vars in 1112 bytes} [Thu Jul 14 17:41:12 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:41:13.132030 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0680d36b-ea75-41fe-be09-b04615371e8d None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:13.181610 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:13.305670 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0680d36b-ea75-41fe-be09-b04615371e8d None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:13.367014 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f722f14-8fd6-48c7-91ca-ba46101f7a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:13.368744 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f722f14-8fd6-48c7-91ca-ba46101f7a0c None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:13.369248 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f722f14-8fd6-48c7-91ca-ba46101f7a0c None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:13.369735 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f722f14-8fd6-48c7-91ca-ba46101f7a0c None admin] PATH_INFO: `/v3/services` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:13.371214 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f722f14-8fd6-48c7-91ca-ba46101f7a0c None admin] RBAC: Adding query filter params (type=compute) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:41:13.371649 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f722f14-8fd6-48c7-91ca-ba46101f7a0c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:13.373880 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f722f14-8fd6-48c7-91ca-ba46101f7a0c None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:13.389624 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 507/1012] 10.222.0.67 () {56 vars in 1112 bytes} [Thu Jul 14 17:41:13 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:41:13.393602 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ad34b9-adea-49f0-8422-4fadf78477cf None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:13.441108 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:13.570812 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ad34b9-adea-49f0-8422-4fadf78477cf None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:13.631777 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04453494-a414-4ac8-8455-9098156dae9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:13.632983 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04453494-a414-4ac8-8455-9098156dae9c None admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:13.633491 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04453494-a414-4ac8-8455-9098156dae9c None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:13.634032 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04453494-a414-4ac8-8455-9098156dae9c None admin] PATH_INFO: `/v3/endpoints` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:13.635445 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04453494-a414-4ac8-8455-9098156dae9c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:13.637949 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04453494-a414-4ac8-8455-9098156dae9c None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:13.677573 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 506/1013] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 14 17:41:13 2022] POST /identity/v3/endpoints => generated 334 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 17:41:14.701236 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e407f471-d31c-4dff-83d8-ac836d3fab69 None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:14.701838 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e407f471-d31c-4dff-83d8-ac836d3fab69 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:14.702168 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e407f471-d31c-4dff-83d8-ac836d3fab69 None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:14.704724 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 508/1014] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:41:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:41:14.710555 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528427f1-9cef-430e-a2b7-da9e89f3ba32 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:14.711349 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528427f1-9cef-430e-a2b7-da9e89f3ba32 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:14.711349 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528427f1-9cef-430e-a2b7-da9e89f3ba32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:14.733374 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-528427f1-9cef-430e-a2b7-da9e89f3ba32 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:41:14.734910 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-528427f1-9cef-430e-a2b7-da9e89f3ba32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:41:14.825573 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 507/1015] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:41:14 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 17:41:14.851039 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e407f471-d31c-4dff-83d8-ac836d3fab69 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:14.966309 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:14.980518 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e407f471-d31c-4dff-83d8-ac836d3fab69 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:15.035631 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856123ee-6431-4425-9d3a-37c949a59009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:15.036686 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856123ee-6431-4425-9d3a-37c949a59009 None admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:15.037187 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856123ee-6431-4425-9d3a-37c949a59009 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:15.037718 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856123ee-6431-4425-9d3a-37c949a59009 None admin] PATH_INFO: `/v3/services` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:15.039933 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856123ee-6431-4425-9d3a-37c949a59009 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:15.041487 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856123ee-6431-4425-9d3a-37c949a59009 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:15.073567 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 509/1016] 10.222.0.67 () {60 vars in 1141 bytes} [Thu Jul 14 17:41:14 2022] POST /identity/v3/services => generated 242 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:41:15.198677 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea2ac3b-0ad0-4ff9-aabb-82fa36a11d11 None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:15.199044 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea2ac3b-0ad0-4ff9-aabb-82fa36a11d11 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:15.199277 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea2ac3b-0ad0-4ff9-aabb-82fa36a11d11 None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:15.200797 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 508/1017] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:41:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:41:15.207828 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20b6d83-8898-4b54-9029-8263d10a23d9 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:15.208443 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20b6d83-8898-4b54-9029-8263d10a23d9 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:15.208921 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20b6d83-8898-4b54-9029-8263d10a23d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:15.230000 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-e20b6d83-8898-4b54-9029-8263d10a23d9 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:41:15.231255 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-e20b6d83-8898-4b54-9029-8263d10a23d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:41:15.345658 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 510/1018] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:41:15 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 17:41:15.366493 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea2ac3b-0ad0-4ff9-aabb-82fa36a11d11 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:15.392304 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:15.511833 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea2ac3b-0ad0-4ff9-aabb-82fa36a11d11 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:15.557985 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c43e76-dc71-4ecd-a6a9-0d92cf8e77e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:15.558903 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c43e76-dc71-4ecd-a6a9-0d92cf8e77e9 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:15.559209 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c43e76-dc71-4ecd-a6a9-0d92cf8e77e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:15.559488 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c43e76-dc71-4ecd-a6a9-0d92cf8e77e9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:15.560822 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c43e76-dc71-4ecd-a6a9-0d92cf8e77e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:15.562381 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c43e76-dc71-4ecd-a6a9-0d92cf8e77e9 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:15.564356 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 509/1019] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:41:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:41:15.570862 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20b6d83-8898-4b54-9029-8263d10a23d9 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:15.664059 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:15.694908 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20b6d83-8898-4b54-9029-8263d10a23d9 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:15.737707 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbdf99f-35f5-4d56-9a7f-4d300a92b513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:15.738725 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbdf99f-35f5-4d56-9a7f-4d300a92b513 None admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:15.738725 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbdf99f-35f5-4d56-9a7f-4d300a92b513 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:15.738943 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbdf99f-35f5-4d56-9a7f-4d300a92b513 None admin] PATH_INFO: `/v3/projects` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:15.739655 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbdf99f-35f5-4d56-9a7f-4d300a92b513 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:15.741273 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbdf99f-35f5-4d56-9a7f-4d300a92b513 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:15.789563 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 511/1020] 10.222.0.67 () {60 vars in 1141 bytes} [Thu Jul 14 17:41:15 2022] POST /identity/v3/projects => generated 311 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:41:16.082822 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f983d191-aa52-45bf-ae73-7f20ff61beec None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:16.083316 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f983d191-aa52-45bf-ae73-7f20ff61beec None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:16.083701 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f983d191-aa52-45bf-ae73-7f20ff61beec None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:16.086318 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 510/1021] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:41:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:41:16.091944 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c1386b-d997-4009-92bc-d95cd40d664b None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:16.092240 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c1386b-d997-4009-92bc-d95cd40d664b None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:16.092530 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c1386b-d997-4009-92bc-d95cd40d664b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:16.111515 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-85c1386b-d997-4009-92bc-d95cd40d664b None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:41:16.112655 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-85c1386b-d997-4009-92bc-d95cd40d664b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:41:16.197100 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 512/1022] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:41:16 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 17:41:16.222224 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f983d191-aa52-45bf-ae73-7f20ff61beec None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:16.336084 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:16.356009 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f983d191-aa52-45bf-ae73-7f20ff61beec None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:16.398096 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bacd7af-94c7-47e9-afdc-b7bbe3509c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:16.399862 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bacd7af-94c7-47e9-afdc-b7bbe3509c56 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:16.400239 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bacd7af-94c7-47e9-afdc-b7bbe3509c56 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:16.400617 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bacd7af-94c7-47e9-afdc-b7bbe3509c56 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:16.420594 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bacd7af-94c7-47e9-afdc-b7bbe3509c56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:41:16.429298 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-0bacd7af-94c7-47e9-afdc-b7bbe3509c56 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 17:41:16.429298 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:41:16.429298 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:41:16.429298 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:41:16.429298 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:41:16.429298 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:41:16.429298 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:41:16.429298 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:41:16.429298 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:41:16.429298 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:41:16.429298 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:41:16.429298 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:41:16.429298 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:41:16.429298 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:41:16.429298 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:41:16.429298 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:41:16.430418 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:41:16.430418 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:41:16.430418 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:41:16.430418 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:41:16.430418 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:41:16.430418 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:41:16.430418 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:41:16.430418 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:41:16.430418 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:41:16.430418 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:41:16.430418 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:41:16.430418 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:41:16.430418 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:41:16.430418 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:41:16.430418 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:41:16.430418 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:41:16.431375 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:41:16.431375 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:41:16.431375 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:41:16.431375 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:41:16.431375 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:41:16.431375 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:41:16.431375 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:41:16.431375 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:41:16.431375 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:41:16.431375 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:41:16.431375 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 17:41:16.431375 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:41:16.433717 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 511/1023] 10.222.0.67 () {56 vars in 1120 bytes} [Thu Jul 14 17:41:16 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:41:16.437068 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c1386b-d997-4009-92bc-d95cd40d664b None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:16.506532 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:16.564614 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c1386b-d997-4009-92bc-d95cd40d664b None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:16.620564 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0a1122-6bdb-4025-92b9-3deae59b5f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:16.621697 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a1122-6bdb-4025-92b9-3deae59b5f29 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:16.621991 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a1122-6bdb-4025-92b9-3deae59b5f29 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:16.622273 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a1122-6bdb-4025-92b9-3deae59b5f29 None admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:16.623053 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0a1122-6bdb-4025-92b9-3deae59b5f29 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:41:16.623436 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0a1122-6bdb-4025-92b9-3deae59b5f29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:16.625188 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0a1122-6bdb-4025-92b9-3deae59b5f29 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:16.635601 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 513/1024] 10.222.0.67 () {56 vars in 1115 bytes} [Thu Jul 14 17:41:16 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:41:16.641117 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bacd7af-94c7-47e9-afdc-b7bbe3509c56 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:16.771125 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bacd7af-94c7-47e9-afdc-b7bbe3509c56 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:16.820056 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48083eec-2627-4c2f-b23e-562e008ff40a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:16.821377 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48083eec-2627-4c2f-b23e-562e008ff40a None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:16.821704 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48083eec-2627-4c2f-b23e-562e008ff40a None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:16.821982 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48083eec-2627-4c2f-b23e-562e008ff40a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:16.833889 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48083eec-2627-4c2f-b23e-562e008ff40a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:16.835354 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48083eec-2627-4c2f-b23e-562e008ff40a None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:16.842967 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:16.856469 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-48083eec-2627-4c2f-b23e-562e008ff40a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:41:16.856469 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:41:16.856469 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:41:16.856469 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:41:16.856469 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:41:16.856469 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:41:16.856469 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:41:16.856469 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:41:16.856469 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:41:16.856469 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:41:16.856469 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:41:16.856469 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:41:16.856469 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:41:16.856469 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:41:16.856469 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:41:16.858197 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:41:16.858197 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:41:16.858197 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:41:16.858197 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:41:16.858197 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:41:16.858197 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:41:16.858197 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:41:16.858197 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:41:16.858197 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:41:16.858197 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:41:16.858197 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:41:16.858197 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:41:16.858197 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:41:16.858197 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:41:16.858197 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:41:16.858197 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:41:16.858197 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:41:16.859808 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:41:16.859808 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:41:16.859808 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:41:16.859808 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:41:16.862538 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 512/1025] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:41:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 17:41:16.870847 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0a1122-6bdb-4025-92b9-3deae59b5f29 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:17.042772 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0a1122-6bdb-4025-92b9-3deae59b5f29 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:17.078415 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:17.104821 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a2b5fd-aefe-450e-861b-697f109dc817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:17.106028 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a2b5fd-aefe-450e-861b-697f109dc817 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:17.106531 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a2b5fd-aefe-450e-861b-697f109dc817 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:17.107014 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a2b5fd-aefe-450e-861b-697f109dc817 None admin] PATH_INFO: `/v3/domains` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:17.108450 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a2b5fd-aefe-450e-861b-697f109dc817 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:41:17.108852 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a2b5fd-aefe-450e-861b-697f109dc817 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:17.111312 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a2b5fd-aefe-450e-861b-697f109dc817 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:17.129891 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 514/1026] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 14 17:41:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:41:17.136444 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48083eec-2627-4c2f-b23e-562e008ff40a None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:17.261801 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c88f95-9154-4f45-af43-18efd48104ee None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:17.262133 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c88f95-9154-4f45-af43-18efd48104ee None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:17.262361 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c88f95-9154-4f45-af43-18efd48104ee None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:17.262590 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48083eec-2627-4c2f-b23e-562e008ff40a None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:17.264022 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 515/1027] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:41:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 17:41:17.269382 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf4a14f-a21e-4fa3-aa0f-309dac8c25b8 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:17.269717 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf4a14f-a21e-4fa3-aa0f-309dac8c25b8 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:17.269964 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf4a14f-a21e-4fa3-aa0f-309dac8c25b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:17.287723 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-8cf4a14f-a21e-4fa3-aa0f-309dac8c25b8 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:41:17.288932 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-8cf4a14f-a21e-4fa3-aa0f-309dac8c25b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:41:17.313142 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeb7eff-a02a-4001-9329-f1dd2eaef2cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:17.314262 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeb7eff-a02a-4001-9329-f1dd2eaef2cf None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:17.314705 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeb7eff-a02a-4001-9329-f1dd2eaef2cf None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:17.314979 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeb7eff-a02a-4001-9329-f1dd2eaef2cf None admin] PATH_INFO: `/v3/users/nova` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:17.323766 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeb7eff-a02a-4001-9329-f1dd2eaef2cf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:17.325211 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeb7eff-a02a-4001-9329-f1dd2eaef2cf None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:17.341687 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-daeb7eff-a02a-4001-9329-f1dd2eaef2cf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 17:41:17.341687 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:41:17.341687 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:41:17.341687 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:41:17.341687 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:41:17.341687 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:41:17.341687 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:41:17.341687 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:41:17.341687 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:41:17.341687 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:41:17.341687 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:41:17.341687 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:41:17.341687 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 17:41:17.341687 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 17:41:17.341687 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 17:41:17.341687 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 17:41:17.342773 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:41:17.342773 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:41:17.342773 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 17:41:17.342773 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:41:17.342773 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 17:41:17.342773 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:41:17.342773 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:41:17.342773 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:41:17.342773 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:41:17.342773 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:41:17.342773 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:41:17.342773 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:41:17.342773 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:41:17.342773 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:41:17.342773 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:41:17.342773 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:41:17.342773 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:41:17.342773 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:41:17.343838 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:41:17.343838 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:41:17.343838 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 17:41:17.343838 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 17:41:17.343838 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 17:41:17.343838 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 17:41:17.343838 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 17:41:17.343838 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 17:41:17.343838 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 17:41:17.343838 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:41:17.343838 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 513/1028] 10.222.0.67 () {56 vars in 1093 bytes} [Thu Jul 14 17:41:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:41:17.348954 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeb7eff-a02a-4001-9329-f1dd2eaef2cf None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:17.369052 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 516/1029] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:41:17 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 17:41:17.392208 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf4a14f-a21e-4fa3-aa0f-309dac8c25b8 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:17.420541 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:17.475917 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeb7eff-a02a-4001-9329-f1dd2eaef2cf None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:17.530849 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dbe597-2bb8-4032-8e97-c8bb1ec7e109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:17.531348 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf4a14f-a21e-4fa3-aa0f-309dac8c25b8 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:17.531831 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dbe597-2bb8-4032-8e97-c8bb1ec7e109 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:17.532232 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dbe597-2bb8-4032-8e97-c8bb1ec7e109 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:17.532693 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dbe597-2bb8-4032-8e97-c8bb1ec7e109 None admin] PATH_INFO: `/v3/users` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:17.533973 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dbe597-2bb8-4032-8e97-c8bb1ec7e109 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:41:17.534510 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dbe597-2bb8-4032-8e97-c8bb1ec7e109 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:17.536280 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dbe597-2bb8-4032-8e97-c8bb1ec7e109 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:17.552260 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:17.561947 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 514/1030] 10.222.0.67 () {56 vars in 1133 bytes} [Thu Jul 14 17:41:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:41:17.564392 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dbe597-2bb8-4032-8e97-c8bb1ec7e109 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:17.596766 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862949da-b7d1-4d30-a521-6834a5230155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:17.598028 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862949da-b7d1-4d30-a521-6834a5230155 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:17.598717 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862949da-b7d1-4d30-a521-6834a5230155 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:17.599363 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862949da-b7d1-4d30-a521-6834a5230155 None admin] PATH_INFO: `/v3/services/image` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:17.600930 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862949da-b7d1-4d30-a521-6834a5230155 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:17.603270 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862949da-b7d1-4d30-a521-6834a5230155 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:17.617439 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-862949da-b7d1-4d30-a521-6834a5230155 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 17:41:17.617439 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:41:17.617439 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 17:41:17.617439 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 17:41:17.617439 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 17:41:17.617439 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 17:41:17.617439 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 17:41:17.617439 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 17:41:17.617439 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 17:41:17.617439 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:41:17.617439 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 17:41:17.617439 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:41:17.617439 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:41:17.617439 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:41:17.617439 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:41:17.617439 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:41:17.617439 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:41:17.618729 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:41:17.618729 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:41:17.618729 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:41:17.618729 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:41:17.618729 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:41:17.618729 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:41:17.618729 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 17:41:17.618729 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 17:41:17.618729 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 17:41:17.618729 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 17:41:17.618729 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:41:17.618729 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:41:17.618729 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:41:17.618729 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:41:17.618729 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:41:17.618729 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:41:17.620767 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:41:17.620767 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:41:17.620767 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:41:17.620767 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:41:17.620767 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:41:17.620767 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:41:17.620767 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:41:17.620767 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:41:17.620767 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:41:17.620767 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:41:17.620767 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 17:41:17.620767 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 17:41:17.620767 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 17:41:17.620767 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:41:17.620767 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 517/1031] 10.222.0.67 () {56 vars in 1105 bytes} [Thu Jul 14 17:41:17 2022] GET /identity/v3/services/image => generated 86 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 17:41:17.628181 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862949da-b7d1-4d30-a521-6834a5230155 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:17.695085 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dbe597-2bb8-4032-8e97-c8bb1ec7e109 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:17.715571 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:17.741010 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d81bd7f-6d44-49e8-8cc4-eb2f836df202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:17.741815 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d81bd7f-6d44-49e8-8cc4-eb2f836df202 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:17.742826 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d81bd7f-6d44-49e8-8cc4-eb2f836df202 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:17.743417 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d81bd7f-6d44-49e8-8cc4-eb2f836df202 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:17.764961 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862949da-b7d1-4d30-a521-6834a5230155 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:17.818995 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dabd987-8ca2-4e1f-937a-77f3c488a70d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:17.819795 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dabd987-8ca2-4e1f-937a-77f3c488a70d None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:17.820113 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dabd987-8ca2-4e1f-937a-77f3c488a70d None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:17.820610 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dabd987-8ca2-4e1f-937a-77f3c488a70d None admin] PATH_INFO: `/v3/services` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:17.822012 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dabd987-8ca2-4e1f-937a-77f3c488a70d None admin] RBAC: Adding query filter params (name=image) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:41:17.822559 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dabd987-8ca2-4e1f-937a-77f3c488a70d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:17.825115 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dabd987-8ca2-4e1f-937a-77f3c488a70d None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:17.840162 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d81bd7f-6d44-49e8-8cc4-eb2f836df202 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:17.841596 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 518/1032] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:41:17 2022] GET /identity/v3/services?name=image => generated 122 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:41:17.841920 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d81bd7f-6d44-49e8-8cc4-eb2f836df202 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:17.843697 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dabd987-8ca2-4e1f-937a-77f3c488a70d None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:17.903844 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:17.982692 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dabd987-8ca2-4e1f-937a-77f3c488a70d None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:17.989079 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 515/1033] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 14 17:41:17 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 14 17:41:18.002223 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d81bd7f-6d44-49e8-8cc4-eb2f836df202 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:18.022174 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:18.023380 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c16bb79-2bfe-4205-9339-29c9aa8d7482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:18.024947 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c16bb79-2bfe-4205-9339-29c9aa8d7482 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:18.025270 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c16bb79-2bfe-4205-9339-29c9aa8d7482 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:18.025376 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c16bb79-2bfe-4205-9339-29c9aa8d7482 None admin] PATH_INFO: `/v3/services` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:18.026141 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c16bb79-2bfe-4205-9339-29c9aa8d7482 None admin] RBAC: Adding query filter params (type=image) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:41:18.026436 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c16bb79-2bfe-4205-9339-29c9aa8d7482 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:18.027823 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c16bb79-2bfe-4205-9339-29c9aa8d7482 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:18.039011 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 519/1034] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:41:17 2022] GET /identity/v3/services?type=image => generated 350 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:41:18.041040 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c16bb79-2bfe-4205-9339-29c9aa8d7482 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:18.135647 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d81bd7f-6d44-49e8-8cc4-eb2f836df202 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:18.163990 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c16bb79-2bfe-4205-9339-29c9aa8d7482 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:18.165893 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:18.173925 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2148bc3f-259b-4ee4-86da-2cf63c10f8cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:18.174802 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2148bc3f-259b-4ee4-86da-2cf63c10f8cb None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:18.175090 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2148bc3f-259b-4ee4-86da-2cf63c10f8cb None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:18.175439 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2148bc3f-259b-4ee4-86da-2cf63c10f8cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:18.187888 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2148bc3f-259b-4ee4-86da-2cf63c10f8cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:18.189350 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2148bc3f-259b-4ee4-86da-2cf63c10f8cb None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:18.206817 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18a9668-9da5-423d-9342-fd9e8b9e052a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:18.207479 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18a9668-9da5-423d-9342-fd9e8b9e052a None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:18.207826 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18a9668-9da5-423d-9342-fd9e8b9e052a None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:18.208166 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18a9668-9da5-423d-9342-fd9e8b9e052a None admin] PATH_INFO: `/v3/endpoints` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:18.209063 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18a9668-9da5-423d-9342-fd9e8b9e052a None admin] RBAC: Adding query filter params (interface=public, service_id=5716c02909ee4fbc8c9418a4fccf37f4, region_id=RegionOne) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:41:18.209396 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18a9668-9da5-423d-9342-fd9e8b9e052a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:18.209851 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-2148bc3f-259b-4ee4-86da-2cf63c10f8cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:41:18.209851 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:41:18.209851 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:41:18.209851 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:41:18.209851 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:41:18.209851 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:41:18.209851 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:41:18.209851 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:41:18.209851 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:41:18.209851 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:41:18.209851 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:41:18.209851 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:41:18.209851 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:41:18.209851 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:41:18.209851 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:41:18.211158 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:41:18.211158 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:41:18.211158 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:41:18.211158 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:41:18.211158 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:41:18.211158 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:41:18.211158 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:41:18.211158 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:41:18.211158 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:41:18.211158 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:41:18.211158 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:41:18.211158 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:41:18.211158 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:41:18.211158 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:41:18.211158 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:41:18.211158 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:41:18.211158 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:41:18.213274 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:41:18.213274 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:41:18.213274 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:41:18.213274 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:41:18.213573 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18a9668-9da5-423d-9342-fd9e8b9e052a None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:18.213669 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 516/1035] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:41:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:41:18.213669 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec5c03b-f41a-4992-905b-776613702696 None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:18.213669 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec5c03b-f41a-4992-905b-776613702696 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:18.213669 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec5c03b-f41a-4992-905b-776613702696 None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:18.215448 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 517/1036] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:41:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:41:18.220072 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec5c03b-f41a-4992-905b-776613702696 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:18.220794 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 520/1037] 10.222.0.67 () {56 vars in 1251 bytes} [Thu Jul 14 17:41:18 2022] GET /identity/v3/endpoints?service_id=5716c02909ee4fbc8c9418a4fccf37f4&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:41:18.223537 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe701dac-ecad-4934-8551-07f57c3c9bae None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:18.224044 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe701dac-ecad-4934-8551-07f57c3c9bae None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:18.225958 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe701dac-ecad-4934-8551-07f57c3c9bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:18.248838 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-fe701dac-ecad-4934-8551-07f57c3c9bae None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:41:18.249993 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-fe701dac-ecad-4934-8551-07f57c3c9bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:41:18.301240 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:18.325247 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 521/1038] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:41:18 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 17:41:18.326356 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe701dac-ecad-4934-8551-07f57c3c9bae None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:18.344144 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec5c03b-f41a-4992-905b-776613702696 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:18.392226 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee09115-edb2-40e3-8690-dea0b995b704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:18.392896 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee09115-edb2-40e3-8690-dea0b995b704 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:18.393468 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee09115-edb2-40e3-8690-dea0b995b704 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:18.393468 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee09115-edb2-40e3-8690-dea0b995b704 None admin] PATH_INFO: `/v3/domains` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:18.394200 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee09115-edb2-40e3-8690-dea0b995b704 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:41:18.394509 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee09115-edb2-40e3-8690-dea0b995b704 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:18.395909 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee09115-edb2-40e3-8690-dea0b995b704 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:18.408616 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 518/1039] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 14 17:41:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:41:18.409904 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee09115-edb2-40e3-8690-dea0b995b704 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:18.460233 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:18.469569 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe701dac-ecad-4934-8551-07f57c3c9bae None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:18.517443 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30044578-d10a-407b-b5a9-5a5e2f5c8ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:18.518149 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30044578-d10a-407b-b5a9-5a5e2f5c8ebe None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:18.518474 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30044578-d10a-407b-b5a9-5a5e2f5c8ebe None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:18.518788 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30044578-d10a-407b-b5a9-5a5e2f5c8ebe None admin] PATH_INFO: `/v3/services` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:18.519618 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30044578-d10a-407b-b5a9-5a5e2f5c8ebe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:18.521394 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30044578-d10a-407b-b5a9-5a5e2f5c8ebe None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:18.526236 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee09115-edb2-40e3-8690-dea0b995b704 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:18.528323 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 522/1040] 10.222.0.67 () {56 vars in 1087 bytes} [Thu Jul 14 17:41:18 2022] GET /identity/v3/services => generated 1957 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:41:18.529231 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30044578-d10a-407b-b5a9-5a5e2f5c8ebe None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:18.577317 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:18.587396 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeec58d-9852-4b30-88b1-7437aacad176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:18.588237 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeec58d-9852-4b30-88b1-7437aacad176 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:18.588552 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeec58d-9852-4b30-88b1-7437aacad176 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:18.588818 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeec58d-9852-4b30-88b1-7437aacad176 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:18.590405 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeec58d-9852-4b30-88b1-7437aacad176 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:18.592067 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeec58d-9852-4b30-88b1-7437aacad176 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:18.594019 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 519/1041] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:41:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:41:18.600340 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeec58d-9852-4b30-88b1-7437aacad176 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:18.690803 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30044578-d10a-407b-b5a9-5a5e2f5c8ebe None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:18.745020 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeec58d-9852-4b30-88b1-7437aacad176 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:18.745480 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14eb9f3-5012-42b7-bb8f-b6d4c514d73b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:18.746148 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14eb9f3-5012-42b7-bb8f-b6d4c514d73b None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:18.746429 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14eb9f3-5012-42b7-bb8f-b6d4c514d73b None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:18.746693 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14eb9f3-5012-42b7-bb8f-b6d4c514d73b None admin] PATH_INFO: `/v3/projects/service` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:18.754506 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14eb9f3-5012-42b7-bb8f-b6d4c514d73b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:18.755979 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14eb9f3-5012-42b7-bb8f-b6d4c514d73b None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:18.771939 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-f14eb9f3-5012-42b7-bb8f-b6d4c514d73b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:41:18.771939 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:41:18.771939 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:41:18.771939 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:41:18.771939 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:41:18.771939 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:41:18.771939 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:41:18.771939 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:41:18.771939 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:41:18.771939 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:41:18.771939 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:41:18.771939 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:41:18.771939 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 17:41:18.771939 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 17:41:18.771939 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 17:41:18.773014 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 17:41:18.773014 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:41:18.773014 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:41:18.773014 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:41:18.773014 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:41:18.773014 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:41:18.773014 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:41:18.773014 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:41:18.773014 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:41:18.773014 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:41:18.773014 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:41:18.773014 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:41:18.773014 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:41:18.773014 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:41:18.773014 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:41:18.773014 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:41:18.773014 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:41:18.775065 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 17:41:18.775065 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 17:41:18.775065 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 17:41:18.775065 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 17:41:18.775065 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 17:41:18.775065 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 17:41:18.775065 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:41:18.775065 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:41:18.775065 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 523/1042] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 14 17:41:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:41:18.780265 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14eb9f3-5012-42b7-bb8f-b6d4c514d73b None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:18.805188 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5f8f6f-8c43-46dc-810b-26175420ff4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:18.806359 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f8f6f-8c43-46dc-810b-26175420ff4f None admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:18.806895 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f8f6f-8c43-46dc-810b-26175420ff4f None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:18.807409 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f8f6f-8c43-46dc-810b-26175420ff4f None admin] PATH_INFO: `/v3/users` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:18.808885 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5f8f6f-8c43-46dc-810b-26175420ff4f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:18.811255 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5f8f6f-8c43-46dc-810b-26175420ff4f None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:18.819028 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:18.833765 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 520/1043] 10.222.0.67 () {60 vars in 1132 bytes} [Thu Jul 14 17:41:18 2022] POST /identity/v3/users => generated 285 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:41:18.940172 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14eb9f3-5012-42b7-bb8f-b6d4c514d73b None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:18.988415 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c403b8-ac21-41fc-b08d-42cc20d3d34c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:18.989503 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c403b8-ac21-41fc-b08d-42cc20d3d34c None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:18.990048 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c403b8-ac21-41fc-b08d-42cc20d3d34c None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:18.990550 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c403b8-ac21-41fc-b08d-42cc20d3d34c None admin] PATH_INFO: `/v3/projects` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:18.992005 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c403b8-ac21-41fc-b08d-42cc20d3d34c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:41:18.992606 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c403b8-ac21-41fc-b08d-42cc20d3d34c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:18.995629 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c403b8-ac21-41fc-b08d-42cc20d3d34c None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:19.017656 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 524/1044] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 14 17:41:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:41:19.024843 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5f8f6f-8c43-46dc-810b-26175420ff4f None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:19.102392 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:19.176449 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5f8f6f-8c43-46dc-810b-26175420ff4f None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:19.237743 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f7561c-6331-4ce9-a503-01b4ea088bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:19.238546 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f7561c-6331-4ce9-a503-01b4ea088bc7 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:19.238935 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f7561c-6331-4ce9-a503-01b4ea088bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:19.239335 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f7561c-6331-4ce9-a503-01b4ea088bc7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:19.240702 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f7561c-6331-4ce9-a503-01b4ea088bc7 None admin] RBAC: Adding query filter params (role.id=4a2ee10af7ed4ffab3293e28d925b9ab, scope.project.id=39a570421bb64fac8b1a0129f1bcc7d9, user.id=41b893bdf4ec474dbfa819c22fc29ce9) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:41:19.241250 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f7561c-6331-4ce9-a503-01b4ea088bc7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:19.244578 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f7561c-6331-4ce9-a503-01b4ea088bc7 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:19.253376 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 521/1045] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 14 17:41:19 2022] GET /identity/v3/role_assignments?user.id=41b893bdf4ec474dbfa819c22fc29ce9&scope.project.id=39a570421bb64fac8b1a0129f1bcc7d9&role.id=4a2ee10af7ed4ffab3293e28d925b9ab => generated 259 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:41:20.824661 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ab1d9-0646-4d3e-abd2-7f22cb0e6719 None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:20.825254 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ab1d9-0646-4d3e-abd2-7f22cb0e6719 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:20.825254 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ab1d9-0646-4d3e-abd2-7f22cb0e6719 None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:20.826649 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 525/1046] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:41:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 17:41:20.831989 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960d99d2-3caf-4c14-9ba9-22805077554c None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:20.832515 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960d99d2-3caf-4c14-9ba9-22805077554c None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:20.832515 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960d99d2-3caf-4c14-9ba9-22805077554c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:20.850470 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-960d99d2-3caf-4c14-9ba9-22805077554c None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:41:20.852214 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-960d99d2-3caf-4c14-9ba9-22805077554c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:41:20.933315 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 522/1047] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:41:20 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 17:41:20.957141 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2ab1d9-0646-4d3e-abd2-7f22cb0e6719 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:21.036840 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4712bb3a-2a36-4317-a679-02fa34be0314 None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:21.037125 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4712bb3a-2a36-4317-a679-02fa34be0314 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:21.037401 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4712bb3a-2a36-4317-a679-02fa34be0314 None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:21.038819 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 523/1048] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:41:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:41:21.044543 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a4d5a-54ab-4a3a-a461-b7347bc63fde None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:21.044830 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a4d5a-54ab-4a3a-a461-b7347bc63fde None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:21.045110 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a4d5a-54ab-4a3a-a461-b7347bc63fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:21.063669 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-ba0a4d5a-54ab-4a3a-a461-b7347bc63fde None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:41:21.064849 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-ba0a4d5a-54ab-4a3a-a461-b7347bc63fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:41:21.077849 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:21.115180 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2ab1d9-0646-4d3e-abd2-7f22cb0e6719 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:21.122457 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:21.154207 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 524/1049] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:41:21 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 17:41:21.173999 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6640a3-fe0d-4cbc-b901-d2ea6421c5ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:21.175120 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6640a3-fe0d-4cbc-b901-d2ea6421c5ca None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:21.175578 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6640a3-fe0d-4cbc-b901-d2ea6421c5ca None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:21.176025 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6640a3-fe0d-4cbc-b901-d2ea6421c5ca None admin] PATH_INFO: `/v3/services/image` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:21.177068 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6640a3-fe0d-4cbc-b901-d2ea6421c5ca None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:21.177555 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0a4d5a-54ab-4a3a-a461-b7347bc63fde None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:21.178906 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6640a3-fe0d-4cbc-b901-d2ea6421c5ca None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:21.201461 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-de6640a3-fe0d-4cbc-b901-d2ea6421c5ca None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 17:41:21.201461 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:41:21.201461 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 17:41:21.201461 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 17:41:21.201461 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 17:41:21.201461 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 17:41:21.201461 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 17:41:21.201461 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 17:41:21.201461 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 17:41:21.201461 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:41:21.201461 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 17:41:21.201461 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:41:21.201461 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:41:21.201461 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:41:21.201461 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:41:21.201461 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:41:21.201461 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:41:21.202781 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:41:21.202781 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:41:21.202781 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:41:21.202781 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:41:21.202781 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:41:21.202781 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:41:21.202781 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 17:41:21.202781 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 17:41:21.202781 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 17:41:21.202781 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 17:41:21.202781 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:41:21.202781 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:41:21.202781 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:41:21.202781 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:41:21.202781 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:41:21.202781 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:41:21.203706 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:41:21.203706 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:41:21.203706 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:41:21.203706 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:41:21.203706 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:41:21.203706 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:41:21.203706 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:41:21.203706 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:41:21.203706 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:41:21.203706 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:41:21.203706 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 17:41:21.203706 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 17:41:21.203706 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 17:41:21.203706 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:41:21.203706 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 526/1050] 10.222.0.67 () {56 vars in 1105 bytes} [Thu Jul 14 17:41:20 2022] GET /identity/v3/services/image => generated 86 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:41:21.209755 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6640a3-fe0d-4cbc-b901-d2ea6421c5ca None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:21.303752 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0a4d5a-54ab-4a3a-a461-b7347bc63fde None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:21.326479 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6640a3-fe0d-4cbc-b901-d2ea6421c5ca None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:21.349548 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a658c3-c6e1-4f8e-9319-6ca690dadf10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:21.350394 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a658c3-c6e1-4f8e-9319-6ca690dadf10 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:21.350661 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a658c3-c6e1-4f8e-9319-6ca690dadf10 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:21.350939 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a658c3-c6e1-4f8e-9319-6ca690dadf10 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:21.362609 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de17b48-6d6d-48a0-adc8-86c240a96895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:21.363291 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de17b48-6d6d-48a0-adc8-86c240a96895 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:21.363572 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de17b48-6d6d-48a0-adc8-86c240a96895 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:21.363850 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de17b48-6d6d-48a0-adc8-86c240a96895 None admin] PATH_INFO: `/v3/services` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:21.364579 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de17b48-6d6d-48a0-adc8-86c240a96895 None admin] RBAC: Adding query filter params (name=image) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:41:21.364886 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de17b48-6d6d-48a0-adc8-86c240a96895 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:21.365002 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a658c3-c6e1-4f8e-9319-6ca690dadf10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:41:21.366302 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de17b48-6d6d-48a0-adc8-86c240a96895 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:21.377433 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 527/1051] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:41:21 2022] GET /identity/v3/services?name=image => generated 122 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:41:21.377846 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-b2a658c3-c6e1-4f8e-9319-6ca690dadf10 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 17:41:21.377846 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:41:21.377846 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:41:21.377846 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:41:21.377846 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:41:21.377846 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:41:21.377846 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:41:21.377846 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:41:21.377846 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:41:21.377846 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:41:21.377846 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:41:21.377846 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:41:21.377846 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:41:21.377846 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:41:21.377846 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:41:21.377846 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:41:21.378790 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:41:21.378790 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:41:21.378790 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:41:21.378790 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:41:21.378790 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:41:21.378790 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:41:21.378790 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:41:21.378790 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:41:21.378790 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:41:21.378790 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:41:21.378790 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:41:21.378790 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:41:21.378790 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:41:21.378790 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:41:21.378790 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:41:21.378790 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:41:21.380236 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:41:21.380236 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:41:21.380236 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:41:21.380236 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:41:21.380236 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:41:21.380236 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:41:21.380236 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:41:21.380236 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:41:21.380236 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:41:21.380236 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:41:21.380236 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 17:41:21.380236 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:41:21.380236 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 525/1052] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 14 17:41:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:41:21.381013 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de17b48-6d6d-48a0-adc8-86c240a96895 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:21.381518 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a658c3-c6e1-4f8e-9319-6ca690dadf10 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:21.392844 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:21.423454 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:21.506545 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a658c3-c6e1-4f8e-9319-6ca690dadf10 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:21.510014 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de17b48-6d6d-48a0-adc8-86c240a96895 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:21.545857 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbda308c-a58d-4f74-b8a4-d7ad47a34385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:21.546123 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460a8028-79fe-43f5-9515-5a180e6389fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:21.546523 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a8028-79fe-43f5-9515-5a180e6389fc None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:21.546641 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda308c-a58d-4f74-b8a4-d7ad47a34385 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:21.546803 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a8028-79fe-43f5-9515-5a180e6389fc None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:21.546960 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda308c-a58d-4f74-b8a4-d7ad47a34385 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:21.547087 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a8028-79fe-43f5-9515-5a180e6389fc None admin] PATH_INFO: `/v3/services` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:21.547268 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda308c-a58d-4f74-b8a4-d7ad47a34385 None admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:21.547774 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460a8028-79fe-43f5-9515-5a180e6389fc None admin] RBAC: Adding query filter params (type=image) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:41:21.548075 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460a8028-79fe-43f5-9515-5a180e6389fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:21.548177 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbda308c-a58d-4f74-b8a4-d7ad47a34385 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:41:21.548475 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbda308c-a58d-4f74-b8a4-d7ad47a34385 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:21.549450 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460a8028-79fe-43f5-9515-5a180e6389fc None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:21.549894 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbda308c-a58d-4f74-b8a4-d7ad47a34385 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:21.560141 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 528/1053] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:41:21 2022] GET /identity/v3/services?type=image => generated 350 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:41:21.560141 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76381c6-9d6a-424e-817d-c63b6a06d449 None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:21.560141 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76381c6-9d6a-424e-817d-c63b6a06d449 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:21.560141 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76381c6-9d6a-424e-817d-c63b6a06d449 None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:21.560141 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 529/1054] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:41:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:41:21.561103 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 526/1055] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 14 17:41:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:41:21.561181 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76381c6-9d6a-424e-817d-c63b6a06d449 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:21.565519 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbda308c-a58d-4f74-b8a4-d7ad47a34385 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:21.640054 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:21.676476 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:21.678834 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76381c6-9d6a-424e-817d-c63b6a06d449 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:21.683294 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbda308c-a58d-4f74-b8a4-d7ad47a34385 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:21.715106 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bda2aa0-f0af-454d-bc97-888a38b8095e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:21.715775 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bda2aa0-f0af-454d-bc97-888a38b8095e None admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:21.716060 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bda2aa0-f0af-454d-bc97-888a38b8095e None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:21.716339 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bda2aa0-f0af-454d-bc97-888a38b8095e None admin] PATH_INFO: `/v3/endpoints` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:21.717090 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bda2aa0-f0af-454d-bc97-888a38b8095e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:21.718507 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bda2aa0-f0af-454d-bc97-888a38b8095e None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:21.722135 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877a8e3e-f757-4d81-bc84-b5c77d9cc736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:21.723108 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a8e3e-f757-4d81-bc84-b5c77d9cc736 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:21.723385 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a8e3e-f757-4d81-bc84-b5c77d9cc736 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:21.723660 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a8e3e-f757-4d81-bc84-b5c77d9cc736 None admin] PATH_INFO: `/v3/users/a601bca360614794844f5e5d80866d40` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:21.740780 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877a8e3e-f757-4d81-bc84-b5c77d9cc736 None admin] RBAC: Authorizing `identity:get_user(user_id=a601bca360614794844f5e5d80866d40)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:21.741582 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 530/1056] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 14 17:41:21 2022] POST /identity/v3/endpoints => generated 327 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:41:21.742519 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877a8e3e-f757-4d81-bc84-b5c77d9cc736 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:21.742855 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ee2910-3748-4ede-99ed-0a2719501cd9 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:21.743251 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ee2910-3748-4ede-99ed-0a2719501cd9 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:21.743514 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ee2910-3748-4ede-99ed-0a2719501cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:21.752085 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 527/1057] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 14 17:41:21 2022] GET /identity/v3/users/a601bca360614794844f5e5d80866d40 => generated 285 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:41:21.755458 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877a8e3e-f757-4d81-bc84-b5c77d9cc736 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:21.778660 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-86ee2910-3748-4ede-99ed-0a2719501cd9 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:41:21.779704 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-86ee2910-3748-4ede-99ed-0a2719501cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:41:21.888119 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877a8e3e-f757-4d81-bc84-b5c77d9cc736 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:21.913667 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 531/1058] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:41:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 17:41:21.936356 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ee2910-3748-4ede-99ed-0a2719501cd9 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:21.943077 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf5dbc8-ecd3-40aa-8141-297dcefea417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:21.944548 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5dbc8-ecd3-40aa-8141-297dcefea417 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:21.945064 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5dbc8-ecd3-40aa-8141-297dcefea417 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:21.945649 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5dbc8-ecd3-40aa-8141-297dcefea417 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:21.989878 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:22.019138 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:22.049618 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf5dbc8-ecd3-40aa-8141-297dcefea417 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:22.051401 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf5dbc8-ecd3-40aa-8141-297dcefea417 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:22.080399 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ee2910-3748-4ede-99ed-0a2719501cd9 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:22.122288 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7f6c93-0d6a-4e03-9cf8-af291c0821f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:22.123259 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f6c93-0d6a-4e03-9cf8-af291c0821f5 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:22.123759 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f6c93-0d6a-4e03-9cf8-af291c0821f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:22.123878 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f6c93-0d6a-4e03-9cf8-af291c0821f5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:22.140026 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7f6c93-0d6a-4e03-9cf8-af291c0821f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:41:22.152257 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-5d7f6c93-0d6a-4e03-9cf8-af291c0821f5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 17:41:22.152257 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:41:22.152257 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:41:22.152257 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:41:22.152257 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:41:22.152257 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:41:22.152257 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:41:22.152257 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:41:22.152257 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:41:22.152257 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:41:22.152257 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:41:22.152257 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:41:22.152257 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:41:22.152257 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:41:22.152257 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:41:22.152257 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:41:22.153296 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:41:22.153296 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:41:22.153296 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:41:22.153296 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:41:22.153296 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:41:22.153296 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:41:22.153296 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:41:22.153296 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:41:22.153296 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:41:22.153296 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:41:22.153296 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:41:22.153296 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:41:22.153296 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:41:22.153296 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:41:22.153296 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:41:22.153296 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:41:22.154191 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:41:22.154191 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:41:22.154191 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:41:22.154191 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:41:22.154191 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:41:22.154191 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:41:22.154191 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:41:22.154191 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:41:22.154191 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:41:22.154191 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:41:22.154191 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 17:41:22.154191 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:41:22.154191 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 532/1059] 10.222.0.67 () {56 vars in 1120 bytes} [Thu Jul 14 17:41:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 17:41:22.162625 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7f6c93-0d6a-4e03-9cf8-af291c0821f5 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:22.210382 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 528/1060] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 14 17:41:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 14 17:41:22.214872 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf5dbc8-ecd3-40aa-8141-297dcefea417 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:22.295073 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:22.300967 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7f6c93-0d6a-4e03-9cf8-af291c0821f5 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:22.318303 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:22.354138 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf5dbc8-ecd3-40aa-8141-297dcefea417 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:22.362859 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b995bc-9095-4a0a-8678-6ab5a8e10f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:22.363695 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b995bc-9095-4a0a-8678-6ab5a8e10f4f None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:22.364032 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b995bc-9095-4a0a-8678-6ab5a8e10f4f None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:22.364331 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b995bc-9095-4a0a-8678-6ab5a8e10f4f None admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:22.365357 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b995bc-9095-4a0a-8678-6ab5a8e10f4f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:41:22.365782 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b995bc-9095-4a0a-8678-6ab5a8e10f4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:22.367996 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b995bc-9095-4a0a-8678-6ab5a8e10f4f None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:22.384990 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 533/1061] 10.222.0.67 () {56 vars in 1115 bytes} [Thu Jul 14 17:41:22 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:41:22.386968 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b995bc-9095-4a0a-8678-6ab5a8e10f4f None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:22.399947 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f081d7-22a6-4a03-a6d3-4898d98755c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:22.400826 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f081d7-22a6-4a03-a6d3-4898d98755c8 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:22.401108 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f081d7-22a6-4a03-a6d3-4898d98755c8 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:22.401382 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f081d7-22a6-4a03-a6d3-4898d98755c8 None admin] PATH_INFO: `/v3/projects/e4fda5c0f3254787895d944262ca58ff` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:22.402629 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f081d7-22a6-4a03-a6d3-4898d98755c8 None admin] RBAC: Authorizing `identity:get_project(project_id=e4fda5c0f3254787895d944262ca58ff)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:22.404068 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f081d7-22a6-4a03-a6d3-4898d98755c8 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:22.406488 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 529/1062] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 14 17:41:22 2022] GET /identity/v3/projects/e4fda5c0f3254787895d944262ca58ff => generated 311 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:41:22.413182 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f081d7-22a6-4a03-a6d3-4898d98755c8 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:22.523261 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b995bc-9095-4a0a-8678-6ab5a8e10f4f None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:22.544605 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f081d7-22a6-4a03-a6d3-4898d98755c8 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:22.566435 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe3772c-1495-47d6-87ee-9db7f6a81cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:22.567666 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe3772c-1495-47d6-87ee-9db7f6a81cb9 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:22.567953 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe3772c-1495-47d6-87ee-9db7f6a81cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:22.568230 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe3772c-1495-47d6-87ee-9db7f6a81cb9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:22.577882 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:22.583091 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe3772c-1495-47d6-87ee-9db7f6a81cb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:22.585027 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe3772c-1495-47d6-87ee-9db7f6a81cb9 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:22.604040 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153bf06c-5ae1-4f66-8554-13f9a4651d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:22.605200 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153bf06c-5ae1-4f66-8554-13f9a4651d27 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:22.605368 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-fbe3772c-1495-47d6-87ee-9db7f6a81cb9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:41:22.605368 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:41:22.605368 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:41:22.605368 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:41:22.605368 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:41:22.605368 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:41:22.605368 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:41:22.605368 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:41:22.605368 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:41:22.605368 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:41:22.605368 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:41:22.605368 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:41:22.605368 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:41:22.605368 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:41:22.605368 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:41:22.612291 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:41:22.612291 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:41:22.612291 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:41:22.612291 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:41:22.612291 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:41:22.612291 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:41:22.612291 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:41:22.612291 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:41:22.612291 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:41:22.612291 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:41:22.612291 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:41:22.612291 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:41:22.612291 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:41:22.612291 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:41:22.612291 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:41:22.612291 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:41:22.612291 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:41:22.614814 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:41:22.614814 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:41:22.614814 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:41:22.614814 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:41:22.615359 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153bf06c-5ae1-4f66-8554-13f9a4651d27 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:22.615359 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153bf06c-5ae1-4f66-8554-13f9a4651d27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:22.615648 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 534/1063] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:41:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 17:41:22.615787 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153bf06c-5ae1-4f66-8554-13f9a4651d27 None admin] RBAC: Adding query filter params (role.id=4651a1cc7b4d4ab7a7a9ca1e77e58e71, scope.project.id=e4fda5c0f3254787895d944262ca58ff, user.id=a601bca360614794844f5e5d80866d40) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:41:22.615787 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153bf06c-5ae1-4f66-8554-13f9a4651d27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:22.615787 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153bf06c-5ae1-4f66-8554-13f9a4651d27 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:22.616708 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe3772c-1495-47d6-87ee-9db7f6a81cb9 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:22.619434 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 530/1064] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 14 17:41:22 2022] GET /identity/v3/role_assignments?user.id=a601bca360614794844f5e5d80866d40&scope.project.id=e4fda5c0f3254787895d944262ca58ff&role.id=4651a1cc7b4d4ab7a7a9ca1e77e58e71 => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:41:22.651366 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:22.744064 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe3772c-1495-47d6-87ee-9db7f6a81cb9 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:22.798896 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4fd2f9-6f4d-42a5-8cc6-400c470f7107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:22.799605 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4fd2f9-6f4d-42a5-8cc6-400c470f7107 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:22.800121 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4fd2f9-6f4d-42a5-8cc6-400c470f7107 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:22.800597 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4fd2f9-6f4d-42a5-8cc6-400c470f7107 None admin] PATH_INFO: `/v3/domains` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:22.801983 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4fd2f9-6f4d-42a5-8cc6-400c470f7107 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:41:22.802507 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4fd2f9-6f4d-42a5-8cc6-400c470f7107 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:22.804175 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4fd2f9-6f4d-42a5-8cc6-400c470f7107 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:22.825513 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 535/1065] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 14 17:41:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:41:22.834756 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153bf06c-5ae1-4f66-8554-13f9a4651d27 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:22.965263 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153bf06c-5ae1-4f66-8554-13f9a4651d27 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:23.014149 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf1d195-bf7d-4242-a2d0-d1b34a4137b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:23.014850 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf1d195-bf7d-4242-a2d0-d1b34a4137b1 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:23.015130 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf1d195-bf7d-4242-a2d0-d1b34a4137b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:23.015414 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf1d195-bf7d-4242-a2d0-d1b34a4137b1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:23.025217 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf1d195-bf7d-4242-a2d0-d1b34a4137b1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:23.026729 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf1d195-bf7d-4242-a2d0-d1b34a4137b1 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:23.043087 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-fdf1d195-bf7d-4242-a2d0-d1b34a4137b1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 17:41:23.043087 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:41:23.043087 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:41:23.043087 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:41:23.043087 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:41:23.043087 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:41:23.043087 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:41:23.043087 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:41:23.043087 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:41:23.043087 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:41:23.043087 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:41:23.043087 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:41:23.043087 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 17:41:23.043087 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 17:41:23.043087 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 17:41:23.043087 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 17:41:23.044208 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:41:23.044208 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:41:23.044208 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 17:41:23.044208 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:41:23.044208 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 17:41:23.044208 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:41:23.044208 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:41:23.044208 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:41:23.044208 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:41:23.044208 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:41:23.044208 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:41:23.044208 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:41:23.044208 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:41:23.044208 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:41:23.044208 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:41:23.044208 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:41:23.044208 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:41:23.044208 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:41:23.045227 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:41:23.045227 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:41:23.045227 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 17:41:23.045227 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 17:41:23.045227 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 17:41:23.045227 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 17:41:23.045227 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 17:41:23.045227 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 17:41:23.045227 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 17:41:23.045227 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:41:23.049582 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 531/1066] 10.222.0.67 () {56 vars in 1093 bytes} [Thu Jul 14 17:41:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:41:23.050696 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4fd2f9-6f4d-42a5-8cc6-400c470f7107 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:23.185903 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:23.200808 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4fd2f9-6f4d-42a5-8cc6-400c470f7107 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:23.241845 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3aeb7e-7016-407b-8cc5-db59f0805ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:23.242745 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3aeb7e-7016-407b-8cc5-db59f0805ca6 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:23.243185 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3aeb7e-7016-407b-8cc5-db59f0805ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:23.243645 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3aeb7e-7016-407b-8cc5-db59f0805ca6 None admin] PATH_INFO: `/v3/users` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:23.244696 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3aeb7e-7016-407b-8cc5-db59f0805ca6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:41:23.245175 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3aeb7e-7016-407b-8cc5-db59f0805ca6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:23.247090 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3aeb7e-7016-407b-8cc5-db59f0805ca6 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:23.266813 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 536/1067] 10.222.0.67 () {56 vars in 1133 bytes} [Thu Jul 14 17:41:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:41:23.272139 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf1d195-bf7d-4242-a2d0-d1b34a4137b1 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:23.326889 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:23.391883 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf1d195-bf7d-4242-a2d0-d1b34a4137b1 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:23.438689 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be9620-efa0-4dfd-9e75-f361fc9d6fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:23.439522 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be9620-efa0-4dfd-9e75-f361fc9d6fb7 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:23.439802 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be9620-efa0-4dfd-9e75-f361fc9d6fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:23.440102 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be9620-efa0-4dfd-9e75-f361fc9d6fb7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:23.457003 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4be9620-efa0-4dfd-9e75-f361fc9d6fb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:23.457003 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4be9620-efa0-4dfd-9e75-f361fc9d6fb7 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:23.477707 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-c4be9620-efa0-4dfd-9e75-f361fc9d6fb7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:41:23.477707 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:41:23.477707 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:41:23.477707 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:41:23.477707 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:41:23.477707 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:41:23.477707 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:41:23.477707 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:41:23.477707 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:41:23.477707 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:41:23.477707 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:41:23.477707 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:41:23.477707 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:41:23.477707 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:41:23.477707 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:41:23.486319 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:41:23.486319 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:41:23.486319 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:41:23.486319 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:41:23.486319 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:41:23.486319 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:41:23.486319 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:41:23.486319 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:41:23.486319 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:41:23.486319 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:41:23.486319 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:41:23.486319 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:41:23.486319 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:41:23.486319 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:41:23.486319 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:41:23.486319 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:41:23.486319 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:41:23.488078 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:41:23.488078 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:41:23.488078 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:41:23.488078 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:41:23.488078 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 532/1068] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:41:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:41:23.491092 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3aeb7e-7016-407b-8cc5-db59f0805ca6 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:23.611261 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3aeb7e-7016-407b-8cc5-db59f0805ca6 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:23.656384 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51468528-a4ae-43bb-b0e7-f944ee983f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:23.657705 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51468528-a4ae-43bb-b0e7-f944ee983f60 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:23.658346 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51468528-a4ae-43bb-b0e7-f944ee983f60 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:23.659209 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51468528-a4ae-43bb-b0e7-f944ee983f60 None admin] PATH_INFO: `/v3/domains` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:23.660140 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51468528-a4ae-43bb-b0e7-f944ee983f60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:41:23.660500 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51468528-a4ae-43bb-b0e7-f944ee983f60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:23.662019 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51468528-a4ae-43bb-b0e7-f944ee983f60 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:23.676715 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 537/1069] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 14 17:41:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:41:23.683205 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be9620-efa0-4dfd-9e75-f361fc9d6fb7 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:23.827242 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:23.833071 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be9620-efa0-4dfd-9e75-f361fc9d6fb7 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:23.878167 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1a60f3-52a1-4a19-af0f-d2e74ff683c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:23.878875 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a60f3-52a1-4a19-af0f-d2e74ff683c8 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:23.879157 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a60f3-52a1-4a19-af0f-d2e74ff683c8 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:23.879475 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a60f3-52a1-4a19-af0f-d2e74ff683c8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:23.887619 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1a60f3-52a1-4a19-af0f-d2e74ff683c8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:23.888943 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1a60f3-52a1-4a19-af0f-d2e74ff683c8 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:23.905277 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-7b1a60f3-52a1-4a19-af0f-d2e74ff683c8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:41:23.905277 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:41:23.905277 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:41:23.905277 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:41:23.905277 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:41:23.905277 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:41:23.905277 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:41:23.905277 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:41:23.905277 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:41:23.905277 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:41:23.905277 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:41:23.905277 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:41:23.905277 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 17:41:23.905277 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 17:41:23.905277 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 17:41:23.906426 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 17:41:23.906426 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:41:23.906426 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:41:23.906426 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:41:23.906426 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:41:23.906426 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:41:23.906426 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:41:23.906426 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:41:23.906426 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:41:23.906426 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:41:23.906426 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:41:23.906426 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:41:23.906426 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:41:23.906426 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:41:23.906426 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:41:23.906426 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:41:23.906426 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:41:23.912931 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 17:41:23.912931 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 17:41:23.912931 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 17:41:23.912931 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 17:41:23.912931 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 17:41:23.912931 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 17:41:23.912931 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:41:23.912931 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:41:23.912931 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 533/1070] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 14 17:41:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:41:23.914269 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51468528-a4ae-43bb-b0e7-f944ee983f60 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:23.923878 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:23.963449 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02bf83e-a79d-41d5-b535-7d99b3626d82 None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:23.963887 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02bf83e-a79d-41d5-b535-7d99b3626d82 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:23.964179 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02bf83e-a79d-41d5-b535-7d99b3626d82 None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:23.966121 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 534/1071] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:41:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:41:23.973079 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d78d215-5155-494e-bf6d-3c21715d71bf None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:23.973369 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d78d215-5155-494e-bf6d-3c21715d71bf None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:23.973815 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d78d215-5155-494e-bf6d-3c21715d71bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:24.002885 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-5d78d215-5155-494e-bf6d-3c21715d71bf None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:41:24.004862 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-5d78d215-5155-494e-bf6d-3c21715d71bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:41:24.058324 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51468528-a4ae-43bb-b0e7-f944ee983f60 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:24.093074 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 535/1072] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:41:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 17:41:24.100093 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eebb9e1-3df1-41a2-bc3c-4c0b56535598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:24.100770 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eebb9e1-3df1-41a2-bc3c-4c0b56535598 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:24.101050 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eebb9e1-3df1-41a2-bc3c-4c0b56535598 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:24.101326 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eebb9e1-3df1-41a2-bc3c-4c0b56535598 None admin] PATH_INFO: `/v3/projects` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:24.102824 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eebb9e1-3df1-41a2-bc3c-4c0b56535598 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:41:24.103131 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eebb9e1-3df1-41a2-bc3c-4c0b56535598 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:24.104578 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eebb9e1-3df1-41a2-bc3c-4c0b56535598 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:24.116031 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d78d215-5155-494e-bf6d-3c21715d71bf None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:24.131750 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 538/1073] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 14 17:41:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:41:24.133321 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eebb9e1-3df1-41a2-bc3c-4c0b56535598 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:24.216262 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:24.243834 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:24.260860 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eebb9e1-3df1-41a2-bc3c-4c0b56535598 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:24.261223 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d78d215-5155-494e-bf6d-3c21715d71bf None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:24.303104 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ae283a-afc4-42e5-a54a-ead9add23d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:24.303999 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae283a-afc4-42e5-a54a-ead9add23d53 None admin] REQUEST_METHOD: `PUT` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:24.304388 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae283a-afc4-42e5-a54a-ead9add23d53 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:24.304620 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae283a-afc4-42e5-a54a-ead9add23d53 None admin] PATH_INFO: `/v3/projects/39a570421bb64fac8b1a0129f1bcc7d9/users/41b893bdf4ec474dbfa819c22fc29ce9/roles/4a2ee10af7ed4ffab3293e28d925b9ab` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:24.307519 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02d767b-6d70-401e-93cb-f44184962390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:24.307707 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ae283a-afc4-42e5-a54a-ead9add23d53 None admin] RBAC: Authorizing `identity:create_grant(project_id=39a570421bb64fac8b1a0129f1bcc7d9, user_id=41b893bdf4ec474dbfa819c22fc29ce9, role_id=4a2ee10af7ed4ffab3293e28d925b9ab)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:24.308208 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02d767b-6d70-401e-93cb-f44184962390 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:24.308491 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02d767b-6d70-401e-93cb-f44184962390 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:24.308775 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02d767b-6d70-401e-93cb-f44184962390 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:24.309048 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ae283a-afc4-42e5-a54a-ead9add23d53 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:24.332998 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 539/1074] 10.222.0.67 () {58 vars in 1439 bytes} [Thu Jul 14 17:41:24 2022] PUT /identity/v3/projects/39a570421bb64fac8b1a0129f1bcc7d9/users/41b893bdf4ec474dbfa819c22fc29ce9/roles/4a2ee10af7ed4ffab3293e28d925b9ab => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 17:41:24.411577 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02d767b-6d70-401e-93cb-f44184962390 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:24.412994 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02d767b-6d70-401e-93cb-f44184962390 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:24.555050 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:24.570860 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 536/1075] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 14 17:41:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 14 17:41:24.578536 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ae283a-afc4-42e5-a54a-ead9add23d53 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:24.731081 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ae283a-afc4-42e5-a54a-ead9add23d53 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:24.772400 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:24.785699 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2621e033-ea66-472d-8e86-230e8c7f5a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:24.786541 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2621e033-ea66-472d-8e86-230e8c7f5a07 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:24.786854 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2621e033-ea66-472d-8e86-230e8c7f5a07 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:24.787151 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2621e033-ea66-472d-8e86-230e8c7f5a07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:24.800567 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2621e033-ea66-472d-8e86-230e8c7f5a07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:24.802067 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2621e033-ea66-472d-8e86-230e8c7f5a07 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:24.821327 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-2621e033-ea66-472d-8e86-230e8c7f5a07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:41:24.821327 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:41:24.821327 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:41:24.821327 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:41:24.821327 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:41:24.821327 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:41:24.821327 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:41:24.821327 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:41:24.821327 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:41:24.821327 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:41:24.821327 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:41:24.821327 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:41:24.821327 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:41:24.821327 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:41:24.821327 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:41:24.823122 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:41:24.823122 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:41:24.823122 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:41:24.823122 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:41:24.823122 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:41:24.823122 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:41:24.823122 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:41:24.823122 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:41:24.823122 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:41:24.823122 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:41:24.823122 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:41:24.823122 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:41:24.823122 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:41:24.823122 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:41:24.823122 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:41:24.823122 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:41:24.823122 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:41:24.824505 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:41:24.824505 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:41:24.824505 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:41:24.824505 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:41:24.824505 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 540/1076] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:41:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 17:41:24.831945 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02d767b-6d70-401e-93cb-f44184962390 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:24.867228 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe310be7-b674-40c2-800c-1dee78644c7c None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:24.867529 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe310be7-b674-40c2-800c-1dee78644c7c None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:24.867883 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe310be7-b674-40c2-800c-1dee78644c7c None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:24.873583 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 541/1077] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:41:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 17:41:24.877883 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a32ad-da24-4896-948d-3c98576e4413 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:24.878540 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a32ad-da24-4896-948d-3c98576e4413 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:24.879036 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a32ad-da24-4896-948d-3c98576e4413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:24.905325 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-a30a32ad-da24-4896-948d-3c98576e4413 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:41:24.906673 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-a30a32ad-da24-4896-948d-3c98576e4413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:41:24.982946 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02d767b-6d70-401e-93cb-f44184962390 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:25.004541 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 542/1078] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:41:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 17:41:25.028501 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30a32ad-da24-4896-948d-3c98576e4413 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:25.032137 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a438f92f-777d-4256-a7e1-5d567156036f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:25.033134 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a438f92f-777d-4256-a7e1-5d567156036f None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:25.033605 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a438f92f-777d-4256-a7e1-5d567156036f None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:25.033988 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a438f92f-777d-4256-a7e1-5d567156036f None admin] PATH_INFO: `/v3/domains` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:25.034995 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a438f92f-777d-4256-a7e1-5d567156036f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:41:25.035489 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a438f92f-777d-4256-a7e1-5d567156036f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:25.037456 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a438f92f-777d-4256-a7e1-5d567156036f None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:25.061575 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 537/1079] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 14 17:41:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:41:25.196382 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30a32ad-da24-4896-948d-3c98576e4413 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:25.212545 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:25.247354 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcefd7f0-3e69-42b5-a181-de2cacce9bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:25.248180 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcefd7f0-3e69-42b5-a181-de2cacce9bac None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:25.248559 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcefd7f0-3e69-42b5-a181-de2cacce9bac None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:25.248842 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcefd7f0-3e69-42b5-a181-de2cacce9bac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:25.261086 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcefd7f0-3e69-42b5-a181-de2cacce9bac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:41:25.268784 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-dcefd7f0-3e69-42b5-a181-de2cacce9bac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 17:41:25.268784 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:41:25.268784 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:41:25.268784 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:41:25.268784 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:41:25.268784 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:41:25.268784 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:41:25.268784 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:41:25.268784 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:41:25.268784 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:41:25.268784 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:41:25.268784 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:41:25.268784 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:41:25.268784 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:41:25.268784 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:41:25.268784 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:41:25.270489 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:41:25.270489 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:41:25.270489 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:41:25.270489 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:41:25.270489 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:41:25.270489 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:41:25.270489 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:41:25.270489 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:41:25.270489 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:41:25.270489 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:41:25.270489 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:41:25.270489 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:41:25.270489 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:41:25.270489 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:41:25.270489 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:41:25.270489 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:41:25.273002 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:41:25.273002 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:41:25.273002 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:41:25.273002 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:41:25.273002 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:41:25.273002 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:41:25.273002 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:41:25.273002 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:41:25.273002 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:41:25.273002 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:41:25.273002 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 17:41:25.273002 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:41:25.273002 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 543/1080] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 14 17:41:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 17:41:25.277954 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a438f92f-777d-4256-a7e1-5d567156036f None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:25.351985 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:25.411880 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a438f92f-777d-4256-a7e1-5d567156036f None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:25.460230 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60ba31e-3fa8-4c6d-bc8c-6e0bb9a5858e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:25.460761 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60ba31e-3fa8-4c6d-bc8c-6e0bb9a5858e None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:25.461046 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60ba31e-3fa8-4c6d-bc8c-6e0bb9a5858e None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:25.461369 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60ba31e-3fa8-4c6d-bc8c-6e0bb9a5858e None admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:25.462224 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60ba31e-3fa8-4c6d-bc8c-6e0bb9a5858e None admin] RBAC: Adding query filter params (name=admin) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:41:25.462749 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60ba31e-3fa8-4c6d-bc8c-6e0bb9a5858e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:25.464614 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60ba31e-3fa8-4c6d-bc8c-6e0bb9a5858e None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:25.482124 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 538/1081] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 14 17:41:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:41:25.484667 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcefd7f0-3e69-42b5-a181-de2cacce9bac None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:25.603143 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcefd7f0-3e69-42b5-a181-de2cacce9bac None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:25.644459 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a545a823-3653-4970-9e75-db742aa5c8d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:25.645837 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a545a823-3653-4970-9e75-db742aa5c8d0 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:25.646167 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a545a823-3653-4970-9e75-db742aa5c8d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:25.646447 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a545a823-3653-4970-9e75-db742aa5c8d0 None admin] PATH_INFO: `/v3/users/a601bca360614794844f5e5d80866d40` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:25.647747 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a545a823-3653-4970-9e75-db742aa5c8d0 None admin] RBAC: Authorizing `identity:get_user(user_id=a601bca360614794844f5e5d80866d40)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:25.650053 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a545a823-3653-4970-9e75-db742aa5c8d0 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:25.652803 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 544/1082] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 14 17:41:25 2022] GET /identity/v3/users/a601bca360614794844f5e5d80866d40 => generated 285 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:41:25.658971 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60ba31e-3fa8-4c6d-bc8c-6e0bb9a5858e None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:25.816411 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60ba31e-3fa8-4c6d-bc8c-6e0bb9a5858e None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:25.837033 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:25.861755 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9405b8a0-1c27-43e6-8f50-d12a40c9ebfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:25.862752 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9405b8a0-1c27-43e6-8f50-d12a40c9ebfe None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:25.863104 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9405b8a0-1c27-43e6-8f50-d12a40c9ebfe None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:25.863393 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9405b8a0-1c27-43e6-8f50-d12a40c9ebfe None admin] PATH_INFO: `/v3/projects/e4fda5c0f3254787895d944262ca58ff` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:25.864715 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9405b8a0-1c27-43e6-8f50-d12a40c9ebfe None admin] RBAC: Authorizing `identity:get_project(project_id=e4fda5c0f3254787895d944262ca58ff)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:25.866315 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9405b8a0-1c27-43e6-8f50-d12a40c9ebfe None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:25.868732 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 539/1083] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 14 17:41:25 2022] GET /identity/v3/projects/e4fda5c0f3254787895d944262ca58ff => generated 311 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:41:25.875979 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a545a823-3653-4970-9e75-db742aa5c8d0 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:25.919393 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:26.000439 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a545a823-3653-4970-9e75-db742aa5c8d0 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:26.038723 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8f27af-0f31-4ccb-9b3f-b1b4eda3c609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:26.040211 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f27af-0f31-4ccb-9b3f-b1b4eda3c609 None admin] REQUEST_METHOD: `PUT` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:26.040506 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f27af-0f31-4ccb-9b3f-b1b4eda3c609 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:26.040799 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f27af-0f31-4ccb-9b3f-b1b4eda3c609 None admin] PATH_INFO: `/v3/projects/e4fda5c0f3254787895d944262ca58ff/users/a601bca360614794844f5e5d80866d40/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:26.043007 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8f27af-0f31-4ccb-9b3f-b1b4eda3c609 None admin] RBAC: Authorizing `identity:create_grant(project_id=e4fda5c0f3254787895d944262ca58ff, user_id=a601bca360614794844f5e5d80866d40, role_id=4651a1cc7b4d4ab7a7a9ca1e77e58e71)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:26.044539 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8f27af-0f31-4ccb-9b3f-b1b4eda3c609 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:26.060705 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 545/1084] 10.222.0.67 () {58 vars in 1439 bytes} [Thu Jul 14 17:41:25 2022] PUT /identity/v3/projects/e4fda5c0f3254787895d944262ca58ff/users/a601bca360614794844f5e5d80866d40/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 17:41:26.486273 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2b920d-739a-4fad-b775-1f646cd6b12a None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:26.486864 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2b920d-739a-4fad-b775-1f646cd6b12a None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:26.486864 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2b920d-739a-4fad-b775-1f646cd6b12a None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:26.488202 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 540/1085] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:41:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:41:26.494785 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad9eb81-dab3-4148-89df-59079fe4d0c6 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:26.495225 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad9eb81-dab3-4148-89df-59079fe4d0c6 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:26.495335 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad9eb81-dab3-4148-89df-59079fe4d0c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:26.514809 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-cad9eb81-dab3-4148-89df-59079fe4d0c6 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:41:26.516419 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-cad9eb81-dab3-4148-89df-59079fe4d0c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:41:26.603088 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 546/1086] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:41:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 17:41:26.628347 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2b920d-739a-4fad-b775-1f646cd6b12a None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:26.739866 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2b920d-739a-4fad-b775-1f646cd6b12a None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:26.791511 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85a1a60-13f4-40ce-96ad-f8dafdd17e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:26.792626 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a1a60-13f4-40ce-96ad-f8dafdd17e93 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:26.792941 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a1a60-13f4-40ce-96ad-f8dafdd17e93 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:26.793376 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a1a60-13f4-40ce-96ad-f8dafdd17e93 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:26.808338 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85a1a60-13f4-40ce-96ad-f8dafdd17e93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:41:26.817370 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-d85a1a60-13f4-40ce-96ad-f8dafdd17e93 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 17:41:26.817370 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:41:26.817370 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:41:26.817370 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:41:26.817370 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:41:26.817370 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:41:26.817370 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:41:26.817370 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:41:26.817370 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:41:26.817370 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:41:26.817370 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:41:26.817370 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:41:26.817370 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:41:26.817370 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:41:26.817370 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:41:26.817370 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:41:26.818637 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:41:26.818637 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:41:26.818637 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:41:26.818637 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:41:26.818637 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:41:26.818637 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:41:26.818637 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:41:26.818637 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:41:26.818637 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:41:26.818637 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:41:26.818637 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:41:26.818637 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:41:26.818637 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:41:26.818637 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:41:26.818637 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:41:26.818637 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:41:26.826811 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:41:26.826811 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:41:26.826811 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:41:26.826811 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:41:26.826811 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:41:26.826811 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:41:26.826811 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:41:26.826811 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:41:26.826811 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:41:26.826811 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:41:26.826811 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 17:41:26.826811 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:41:26.826811 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 541/1087] 10.222.0.67 () {56 vars in 1120 bytes} [Thu Jul 14 17:41:26 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:41:26.829458 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad9eb81-dab3-4148-89df-59079fe4d0c6 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:26.862298 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:26.950559 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad9eb81-dab3-4148-89df-59079fe4d0c6 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:26.987976 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0882d4-f228-4a19-a821-b0cae2142231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:26.988973 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0882d4-f228-4a19-a821-b0cae2142231 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:26.990294 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0882d4-f228-4a19-a821-b0cae2142231 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:26.990712 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0882d4-f228-4a19-a821-b0cae2142231 None admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:26.991834 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0882d4-f228-4a19-a821-b0cae2142231 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:41:26.992335 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0882d4-f228-4a19-a821-b0cae2142231 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:26.995012 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0882d4-f228-4a19-a821-b0cae2142231 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:27.006989 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 547/1088] 10.222.0.67 () {56 vars in 1115 bytes} [Thu Jul 14 17:41:26 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:41:27.012710 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85a1a60-13f4-40ce-96ad-f8dafdd17e93 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:27.059956 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:27.129982 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85a1a60-13f4-40ce-96ad-f8dafdd17e93 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:27.170442 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e238150-b888-494c-956a-9c5fce6d11f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:27.171331 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e238150-b888-494c-956a-9c5fce6d11f6 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:27.171641 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e238150-b888-494c-956a-9c5fce6d11f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:27.171954 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e238150-b888-494c-956a-9c5fce6d11f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:27.184449 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e238150-b888-494c-956a-9c5fce6d11f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:27.186039 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e238150-b888-494c-956a-9c5fce6d11f6 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:27.205889 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-9e238150-b888-494c-956a-9c5fce6d11f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:41:27.205889 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:41:27.205889 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:41:27.205889 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:41:27.205889 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:41:27.205889 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:41:27.205889 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:41:27.205889 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:41:27.205889 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:41:27.205889 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:41:27.205889 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:41:27.205889 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:41:27.205889 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:41:27.205889 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:41:27.205889 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:41:27.207047 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:41:27.207047 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:41:27.207047 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:41:27.207047 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:41:27.207047 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:41:27.207047 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:41:27.207047 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:41:27.207047 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:41:27.207047 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:41:27.207047 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:41:27.207047 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:41:27.207047 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:41:27.207047 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:41:27.207047 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:41:27.207047 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:41:27.207047 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:41:27.207047 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:41:27.213427 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:41:27.213427 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:41:27.213427 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:41:27.213427 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:41:27.213427 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 542/1089] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:41:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:41:27.215341 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0882d4-f228-4a19-a821-b0cae2142231 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:27.318218 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:27.331681 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0882d4-f228-4a19-a821-b0cae2142231 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:27.368832 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e17dfb1-0edf-4e62-b84f-e57edb88ea9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:27.369513 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17dfb1-0edf-4e62-b84f-e57edb88ea9c None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:27.369825 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17dfb1-0edf-4e62-b84f-e57edb88ea9c None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:27.370096 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17dfb1-0edf-4e62-b84f-e57edb88ea9c None admin] PATH_INFO: `/v3/domains` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:27.371114 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e17dfb1-0edf-4e62-b84f-e57edb88ea9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:41:27.371432 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e17dfb1-0edf-4e62-b84f-e57edb88ea9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:27.372804 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e17dfb1-0edf-4e62-b84f-e57edb88ea9c None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:27.387771 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 548/1090] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 14 17:41:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:41:27.393546 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e238150-b888-494c-956a-9c5fce6d11f6 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:27.518444 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:27.538172 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e238150-b888-494c-956a-9c5fce6d11f6 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:27.574086 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc95730-ce93-4c31-8b4c-f4c95c7a7219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:27.574726 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc95730-ce93-4c31-8b4c-f4c95c7a7219 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:27.575005 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc95730-ce93-4c31-8b4c-f4c95c7a7219 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:27.575277 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc95730-ce93-4c31-8b4c-f4c95c7a7219 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:27.583323 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc95730-ce93-4c31-8b4c-f4c95c7a7219 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:27.584768 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc95730-ce93-4c31-8b4c-f4c95c7a7219 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:27.599321 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-2dc95730-ce93-4c31-8b4c-f4c95c7a7219 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 17:41:27.599321 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:41:27.599321 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:41:27.599321 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:41:27.599321 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:41:27.599321 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:41:27.599321 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:41:27.599321 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:41:27.599321 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:41:27.599321 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:41:27.599321 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:41:27.599321 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:41:27.599321 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 17:41:27.599321 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 17:41:27.599321 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 17:41:27.599321 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 17:41:27.600479 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:41:27.600479 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:41:27.600479 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 17:41:27.600479 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:41:27.600479 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 17:41:27.600479 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:41:27.600479 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:41:27.600479 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:41:27.600479 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:41:27.600479 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:41:27.600479 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:41:27.600479 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:41:27.600479 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:41:27.600479 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:41:27.600479 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:41:27.600479 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:41:27.600479 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:41:27.600479 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:41:27.602150 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:41:27.602150 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:41:27.602150 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 17:41:27.602150 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 17:41:27.602150 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 17:41:27.602150 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 17:41:27.602150 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 17:41:27.602150 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 17:41:27.602150 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 17:41:27.602150 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:41:27.602150 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 543/1091] 10.222.0.67 () {56 vars in 1093 bytes} [Thu Jul 14 17:41:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:41:27.606700 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e17dfb1-0edf-4e62-b84f-e57edb88ea9c None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:27.731653 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e17dfb1-0edf-4e62-b84f-e57edb88ea9c None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:27.777169 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b834f98-8375-4894-a018-baa9981a9c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:27.777877 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b834f98-8375-4894-a018-baa9981a9c39 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:27.778160 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b834f98-8375-4894-a018-baa9981a9c39 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:27.778434 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b834f98-8375-4894-a018-baa9981a9c39 None admin] PATH_INFO: `/v3/users` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:27.779292 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b834f98-8375-4894-a018-baa9981a9c39 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:41:27.779602 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b834f98-8375-4894-a018-baa9981a9c39 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:27.781125 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b834f98-8375-4894-a018-baa9981a9c39 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:27.808784 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 549/1092] 10.222.0.67 () {56 vars in 1133 bytes} [Thu Jul 14 17:41:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:41:27.810329 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc95730-ce93-4c31-8b4c-f4c95c7a7219 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:27.921153 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc95730-ce93-4c31-8b4c-f4c95c7a7219 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:27.968592 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c8a345-d472-4f0c-89fa-4776f8997f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:27.969698 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c8a345-d472-4f0c-89fa-4776f8997f10 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:27.969992 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c8a345-d472-4f0c-89fa-4776f8997f10 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:27.970272 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c8a345-d472-4f0c-89fa-4776f8997f10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:28.005639 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:28.073009 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c8a345-d472-4f0c-89fa-4776f8997f10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:28.074629 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c8a345-d472-4f0c-89fa-4776f8997f10 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:28.199373 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 544/1093] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 14 17:41:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 17:41:28.205637 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b834f98-8375-4894-a018-baa9981a9c39 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:28.215366 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:28.218941 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05d0cba-fe73-47a0-a49f-4f331d4acf56 None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:28.219902 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05d0cba-fe73-47a0-a49f-4f331d4acf56 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:28.220364 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05d0cba-fe73-47a0-a49f-4f331d4acf56 None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:28.222396 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 545/1094] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:41:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:41:28.228232 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b871e72-a92a-4a38-928b-276f8a24ba62 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:28.228528 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b871e72-a92a-4a38-928b-276f8a24ba62 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:28.228826 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b871e72-a92a-4a38-928b-276f8a24ba62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:28.248741 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-7b871e72-a92a-4a38-928b-276f8a24ba62 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:41:28.250272 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-7b871e72-a92a-4a38-928b-276f8a24ba62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:41:28.310001 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:28.322636 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b834f98-8375-4894-a018-baa9981a9c39 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:28.338877 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 546/1095] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:41:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 17:41:28.368199 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5d9eaa-7f40-47a1-a6c1-aba303e97c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:28.369156 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d9eaa-7f40-47a1-a6c1-aba303e97c01 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:28.369439 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d9eaa-7f40-47a1-a6c1-aba303e97c01 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:28.369779 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d9eaa-7f40-47a1-a6c1-aba303e97c01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:28.374034 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b871e72-a92a-4a38-928b-276f8a24ba62 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:28.382136 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5d9eaa-7f40-47a1-a6c1-aba303e97c01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:28.384462 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5d9eaa-7f40-47a1-a6c1-aba303e97c01 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:28.404806 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-4b5d9eaa-7f40-47a1-a6c1-aba303e97c01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:41:28.404806 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:41:28.404806 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:41:28.404806 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:41:28.404806 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:41:28.404806 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:41:28.404806 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:41:28.404806 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:41:28.404806 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:41:28.404806 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:41:28.404806 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:41:28.404806 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:41:28.404806 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:41:28.404806 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:41:28.404806 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:41:28.405893 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:41:28.405893 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:41:28.405893 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:41:28.405893 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:41:28.405893 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:41:28.405893 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:41:28.405893 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:41:28.405893 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:41:28.405893 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:41:28.405893 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:41:28.405893 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:41:28.405893 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:41:28.405893 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:41:28.405893 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:41:28.405893 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:41:28.405893 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:41:28.405893 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:41:28.407868 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:41:28.407868 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:41:28.407868 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:41:28.407868 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:41:28.407868 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 550/1096] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:41:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:41:28.412541 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5d9eaa-7f40-47a1-a6c1-aba303e97c01 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:28.502724 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:28.510538 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b871e72-a92a-4a38-928b-276f8a24ba62 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:28.550886 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ed691c-9bcd-4f8b-a313-5b622f0e7b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:28.551708 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ed691c-9bcd-4f8b-a313-5b622f0e7b8b None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:28.551978 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ed691c-9bcd-4f8b-a313-5b622f0e7b8b None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:28.552255 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ed691c-9bcd-4f8b-a313-5b622f0e7b8b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:28.559871 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5d9eaa-7f40-47a1-a6c1-aba303e97c01 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:28.563233 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ed691c-9bcd-4f8b-a313-5b622f0e7b8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:41:28.571663 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-c3ed691c-9bcd-4f8b-a313-5b622f0e7b8b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 17:41:28.571663 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:41:28.571663 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:41:28.571663 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:41:28.571663 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:41:28.571663 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:41:28.571663 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:41:28.571663 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:41:28.571663 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:41:28.571663 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:41:28.571663 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:41:28.571663 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:41:28.571663 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:41:28.571663 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:41:28.571663 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:41:28.571663 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:41:28.572748 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:41:28.572748 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:41:28.572748 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:41:28.572748 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:41:28.572748 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:41:28.572748 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:41:28.572748 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:41:28.572748 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:41:28.572748 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:41:28.572748 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:41:28.572748 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:41:28.572748 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:41:28.572748 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:41:28.572748 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:41:28.572748 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:41:28.572748 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:41:28.573669 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:41:28.573669 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:41:28.573669 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:41:28.573669 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:41:28.573669 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:41:28.573669 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:41:28.573669 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:41:28.573669 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:41:28.573669 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:41:28.573669 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:41:28.573669 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 17:41:28.573669 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:41:28.573669 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 547/1097] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 14 17:41:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 17:41:28.579454 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ed691c-9bcd-4f8b-a313-5b622f0e7b8b None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:28.597805 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36ca66f-be54-4263-a7ca-72efe457c8eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:28.598480 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ca66f-be54-4263-a7ca-72efe457c8eb None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:28.598790 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ca66f-be54-4263-a7ca-72efe457c8eb None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:28.599034 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ca66f-be54-4263-a7ca-72efe457c8eb None admin] PATH_INFO: `/v3/domains` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:28.599769 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36ca66f-be54-4263-a7ca-72efe457c8eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:41:28.600082 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36ca66f-be54-4263-a7ca-72efe457c8eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:28.601468 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36ca66f-be54-4263-a7ca-72efe457c8eb None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:28.613937 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 551/1098] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 14 17:41:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:41:28.619665 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36ca66f-be54-4263-a7ca-72efe457c8eb None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:28.627492 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:28.703187 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ed691c-9bcd-4f8b-a313-5b622f0e7b8b None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:28.739378 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36ca66f-be54-4263-a7ca-72efe457c8eb None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:28.739872 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b291aab-9dee-4bce-bee1-ebde2db2cdc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:28.740561 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b291aab-9dee-4bce-bee1-ebde2db2cdc0 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:28.740891 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b291aab-9dee-4bce-bee1-ebde2db2cdc0 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:28.741209 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b291aab-9dee-4bce-bee1-ebde2db2cdc0 None admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:28.742013 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b291aab-9dee-4bce-bee1-ebde2db2cdc0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:41:28.742344 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b291aab-9dee-4bce-bee1-ebde2db2cdc0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:28.743724 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b291aab-9dee-4bce-bee1-ebde2db2cdc0 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:28.753119 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 548/1099] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 14 17:41:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:41:28.759875 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:28.760517 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b291aab-9dee-4bce-bee1-ebde2db2cdc0 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:28.780988 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93c25d7-3abe-4b23-98f5-1f10b15b8c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:28.781818 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93c25d7-3abe-4b23-98f5-1f10b15b8c2f None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:28.782158 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93c25d7-3abe-4b23-98f5-1f10b15b8c2f None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:28.782446 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93c25d7-3abe-4b23-98f5-1f10b15b8c2f None admin] PATH_INFO: `/v3/projects/service` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:28.789414 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93c25d7-3abe-4b23-98f5-1f10b15b8c2f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:28.790964 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93c25d7-3abe-4b23-98f5-1f10b15b8c2f None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:28.806454 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-e93c25d7-3abe-4b23-98f5-1f10b15b8c2f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:41:28.806454 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:41:28.806454 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:41:28.806454 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:41:28.806454 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:41:28.806454 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:41:28.806454 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:41:28.806454 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:41:28.806454 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:41:28.806454 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:41:28.806454 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:41:28.806454 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:41:28.806454 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 17:41:28.806454 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 17:41:28.806454 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 17:41:28.807580 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 17:41:28.807580 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:41:28.807580 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:41:28.807580 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:41:28.807580 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:41:28.807580 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:41:28.807580 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:41:28.807580 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:41:28.807580 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:41:28.807580 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:41:28.807580 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:41:28.807580 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:41:28.807580 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:41:28.807580 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:41:28.807580 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:41:28.807580 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:41:28.807580 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:41:28.808995 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 17:41:28.808995 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 17:41:28.808995 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 17:41:28.808995 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 17:41:28.808995 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 17:41:28.808995 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 17:41:28.808995 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:41:28.808995 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:41:28.808995 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 552/1100] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 14 17:41:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 17:41:28.813688 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93c25d7-3abe-4b23-98f5-1f10b15b8c2f None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:28.875744 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b291aab-9dee-4bce-bee1-ebde2db2cdc0 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:28.878487 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:28.912248 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52c5e98-f4e5-4743-84ba-596dc4ee477b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:28.913161 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c5e98-f4e5-4743-84ba-596dc4ee477b None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:28.913449 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c5e98-f4e5-4743-84ba-596dc4ee477b None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:28.913745 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c5e98-f4e5-4743-84ba-596dc4ee477b None admin] PATH_INFO: `/v3/users/a601bca360614794844f5e5d80866d40` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:28.914976 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52c5e98-f4e5-4743-84ba-596dc4ee477b None admin] RBAC: Authorizing `identity:get_user(user_id=a601bca360614794844f5e5d80866d40)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:28.916414 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52c5e98-f4e5-4743-84ba-596dc4ee477b None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:28.918120 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 549/1101] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 14 17:41:28 2022] GET /identity/v3/users/a601bca360614794844f5e5d80866d40 => generated 285 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:41:28.923982 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52c5e98-f4e5-4743-84ba-596dc4ee477b None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:28.933716 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93c25d7-3abe-4b23-98f5-1f10b15b8c2f None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:28.972681 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d085ca-9b45-4b2d-a414-2f085cce59cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:28.973491 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d085ca-9b45-4b2d-a414-2f085cce59cd None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:28.973811 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d085ca-9b45-4b2d-a414-2f085cce59cd None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:28.974113 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d085ca-9b45-4b2d-a414-2f085cce59cd None admin] PATH_INFO: `/v3/projects` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:28.975094 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d085ca-9b45-4b2d-a414-2f085cce59cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:41:28.975422 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d085ca-9b45-4b2d-a414-2f085cce59cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:28.977148 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d085ca-9b45-4b2d-a414-2f085cce59cd None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:29.000401 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 553/1102] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 14 17:41:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:41:29.002179 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d085ca-9b45-4b2d-a414-2f085cce59cd None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:29.048184 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:29.048646 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52c5e98-f4e5-4743-84ba-596dc4ee477b None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:29.088634 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45efbf8-2037-4073-b69f-fb4784366e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:29.089555 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45efbf8-2037-4073-b69f-fb4784366e75 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:29.089966 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45efbf8-2037-4073-b69f-fb4784366e75 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:29.090337 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45efbf8-2037-4073-b69f-fb4784366e75 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:29.125495 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d085ca-9b45-4b2d-a414-2f085cce59cd None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:29.149993 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:29.163882 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e35ab9-9ced-4e9d-9ad5-0c9ab07be084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:29.165084 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e35ab9-9ced-4e9d-9ad5-0c9ab07be084 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:29.165388 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e35ab9-9ced-4e9d-9ad5-0c9ab07be084 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:29.165671 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e35ab9-9ced-4e9d-9ad5-0c9ab07be084 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:29.166555 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e35ab9-9ced-4e9d-9ad5-0c9ab07be084 None admin] RBAC: Adding query filter params (role.id=4a2ee10af7ed4ffab3293e28d925b9ab, scope.project.id=39a570421bb64fac8b1a0129f1bcc7d9, user.id=41b893bdf4ec474dbfa819c22fc29ce9) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:41:29.166823 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e35ab9-9ced-4e9d-9ad5-0c9ab07be084 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:29.168276 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e35ab9-9ced-4e9d-9ad5-0c9ab07be084 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:29.175559 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 554/1103] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 14 17:41:29 2022] GET /identity/v3/role_assignments?user.id=41b893bdf4ec474dbfa819c22fc29ce9&scope.project.id=39a570421bb64fac8b1a0129f1bcc7d9&role.id=4a2ee10af7ed4ffab3293e28d925b9ab => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:41:29.189982 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45efbf8-2037-4073-b69f-fb4784366e75 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:29.191627 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45efbf8-2037-4073-b69f-fb4784366e75 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:29.319079 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 550/1104] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 14 17:41:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 14 17:41:29.325690 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e35ab9-9ced-4e9d-9ad5-0c9ab07be084 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:29.450001 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e35ab9-9ced-4e9d-9ad5-0c9ab07be084 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:29.451715 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:29.490283 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7b0839-da21-42f8-8ef6-dce0cdbd1d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:29.491161 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7b0839-da21-42f8-8ef6-dce0cdbd1d2a None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:29.491573 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7b0839-da21-42f8-8ef6-dce0cdbd1d2a None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:29.491846 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7b0839-da21-42f8-8ef6-dce0cdbd1d2a None admin] PATH_INFO: `/v3/projects/e4fda5c0f3254787895d944262ca58ff` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:29.493309 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7b0839-da21-42f8-8ef6-dce0cdbd1d2a None admin] RBAC: Authorizing `identity:get_project(project_id=e4fda5c0f3254787895d944262ca58ff)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:29.495076 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7b0839-da21-42f8-8ef6-dce0cdbd1d2a None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:29.497465 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 555/1105] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 14 17:41:29 2022] GET /identity/v3/projects/e4fda5c0f3254787895d944262ca58ff => generated 311 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:41:29.504581 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45efbf8-2037-4073-b69f-fb4784366e75 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:29.601458 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:29.643564 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45efbf8-2037-4073-b69f-fb4784366e75 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:29.689707 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfb1f1f-cc9e-469a-be92-5c53d6100e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:29.690383 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfb1f1f-cc9e-469a-be92-5c53d6100e04 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:29.690665 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfb1f1f-cc9e-469a-be92-5c53d6100e04 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:29.690938 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfb1f1f-cc9e-469a-be92-5c53d6100e04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:29.691786 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfb1f1f-cc9e-469a-be92-5c53d6100e04 None admin] RBAC: Adding query filter params (role.id=4651a1cc7b4d4ab7a7a9ca1e77e58e71, scope.project.id=e4fda5c0f3254787895d944262ca58ff, user.id=a601bca360614794844f5e5d80866d40) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:41:29.692175 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfb1f1f-cc9e-469a-be92-5c53d6100e04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:29.693705 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfb1f1f-cc9e-469a-be92-5c53d6100e04 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:29.701134 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 551/1106] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 14 17:41:29 2022] GET /identity/v3/role_assignments?user.id=a601bca360614794844f5e5d80866d40&scope.project.id=e4fda5c0f3254787895d944262ca58ff&role.id=4651a1cc7b4d4ab7a7a9ca1e77e58e71 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:41:31.809361 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ecc500-87b1-48d0-aa80-783cd98c2f05 None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:31.809907 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ecc500-87b1-48d0-aa80-783cd98c2f05 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:31.809907 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ecc500-87b1-48d0-aa80-783cd98c2f05 None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:31.811248 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 556/1107] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:41:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:41:31.816533 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6004a5b-74af-49f6-be37-f8aed867ef42 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:31.816958 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6004a5b-74af-49f6-be37-f8aed867ef42 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:31.817070 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6004a5b-74af-49f6-be37-f8aed867ef42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:31.833909 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-a6004a5b-74af-49f6-be37-f8aed867ef42 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:41:31.835085 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-a6004a5b-74af-49f6-be37-f8aed867ef42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:41:31.899457 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 552/1108] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:41:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 17:41:31.923643 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ecc500-87b1-48d0-aa80-783cd98c2f05 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:32.022682 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ecc500-87b1-48d0-aa80-783cd98c2f05 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:32.054758 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988c8150-cdf6-433c-94b9-2452c20bb7b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:32.056066 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c8150-cdf6-433c-94b9-2452c20bb7b7 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:32.056347 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c8150-cdf6-433c-94b9-2452c20bb7b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:32.056622 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c8150-cdf6-433c-94b9-2452c20bb7b7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:32.057820 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988c8150-cdf6-433c-94b9-2452c20bb7b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:32.059260 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988c8150-cdf6-433c-94b9-2452c20bb7b7 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:32.060943 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 557/1109] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:41:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:41:32.066723 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6004a5b-74af-49f6-be37-f8aed867ef42 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:32.130866 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:32.166519 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6004a5b-74af-49f6-be37-f8aed867ef42 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:32.200763 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58caa6ab-afc7-4185-995a-db0305cba890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:32.201437 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58caa6ab-afc7-4185-995a-db0305cba890 None admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:32.201753 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58caa6ab-afc7-4185-995a-db0305cba890 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:32.202034 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58caa6ab-afc7-4185-995a-db0305cba890 None admin] PATH_INFO: `/v3/users` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:32.202749 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58caa6ab-afc7-4185-995a-db0305cba890 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:32.204175 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58caa6ab-afc7-4185-995a-db0305cba890 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:32.223616 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 553/1110] 10.222.0.67 () {60 vars in 1132 bytes} [Thu Jul 14 17:41:32 2022] POST /identity/v3/users => generated 286 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:41:34.315851 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebafd25-1d24-43fa-b103-151ba92ca55e None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:34.316418 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebafd25-1d24-43fa-b103-151ba92ca55e None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:34.316418 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebafd25-1d24-43fa-b103-151ba92ca55e None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:34.317807 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 558/1111] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:41:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:41:34.323045 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c63ec6-1506-4e1c-89f0-5dd739c0436f None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:34.323467 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c63ec6-1506-4e1c-89f0-5dd739c0436f None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:34.323606 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c63ec6-1506-4e1c-89f0-5dd739c0436f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:34.340407 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-a9c63ec6-1506-4e1c-89f0-5dd739c0436f None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:41:34.341620 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-a9c63ec6-1506-4e1c-89f0-5dd739c0436f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:41:34.407135 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 554/1112] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:41:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 17:41:34.429991 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebafd25-1d24-43fa-b103-151ba92ca55e None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:34.473084 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:34.533631 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebafd25-1d24-43fa-b103-151ba92ca55e None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:34.565728 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6803ab-6afc-4c60-a2a4-636ba0c0ebb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:34.566642 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6803ab-6afc-4c60-a2a4-636ba0c0ebb1 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:34.566864 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6803ab-6afc-4c60-a2a4-636ba0c0ebb1 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:34.567138 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6803ab-6afc-4c60-a2a4-636ba0c0ebb1 None admin] PATH_INFO: `/v3/roles/fa9b6b80eda3440ca058cb77bd7f8f5c` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:34.568606 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6803ab-6afc-4c60-a2a4-636ba0c0ebb1 None admin] RBAC: Authorizing `identity:get_role(role_id=fa9b6b80eda3440ca058cb77bd7f8f5c)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:34.570006 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6803ab-6afc-4c60-a2a4-636ba0c0ebb1 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:34.571898 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 559/1113] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 14 17:41:34 2022] GET /identity/v3/roles/fa9b6b80eda3440ca058cb77bd7f8f5c => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:41:34.577929 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c63ec6-1506-4e1c-89f0-5dd739c0436f None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:34.629096 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:34.676469 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c63ec6-1506-4e1c-89f0-5dd739c0436f None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:34.709991 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8005454c-cf34-492e-a446-785864cc5b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:34.710863 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8005454c-cf34-492e-a446-785864cc5b96 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:34.711148 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8005454c-cf34-492e-a446-785864cc5b96 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:34.711430 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8005454c-cf34-492e-a446-785864cc5b96 None admin] PATH_INFO: `/v3/users/36747c689a84434ebd3828baf7a18c33` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:34.725934 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8005454c-cf34-492e-a446-785864cc5b96 None admin] RBAC: Authorizing `identity:get_user(user_id=36747c689a84434ebd3828baf7a18c33)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:34.727442 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8005454c-cf34-492e-a446-785864cc5b96 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:34.729113 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 555/1114] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 14 17:41:34 2022] GET /identity/v3/users/36747c689a84434ebd3828baf7a18c33 => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:41:34.735519 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6803ab-6afc-4c60-a2a4-636ba0c0ebb1 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:34.836512 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6803ab-6afc-4c60-a2a4-636ba0c0ebb1 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:34.843031 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:34.872333 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69f71a9-d752-4a63-897c-8bf01c39c08d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:34.872973 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69f71a9-d752-4a63-897c-8bf01c39c08d None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:34.873256 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69f71a9-d752-4a63-897c-8bf01c39c08d None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:34.873548 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69f71a9-d752-4a63-897c-8bf01c39c08d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:34.937335 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69f71a9-d752-4a63-897c-8bf01c39c08d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:34.938803 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69f71a9-d752-4a63-897c-8bf01c39c08d None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:35.033621 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 560/1115] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 14 17:41:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 17:41:35.039533 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8005454c-cf34-492e-a446-785864cc5b96 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:35.140081 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8005454c-cf34-492e-a446-785864cc5b96 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:35.150933 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:35.174141 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c36d84-ac59-420f-91aa-4691547da387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:35.174998 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c36d84-ac59-420f-91aa-4691547da387 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:35.175281 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c36d84-ac59-420f-91aa-4691547da387 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:35.175557 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c36d84-ac59-420f-91aa-4691547da387 None admin] PATH_INFO: `/v3/projects/e4fda5c0f3254787895d944262ca58ff` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:35.176726 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c36d84-ac59-420f-91aa-4691547da387 None admin] RBAC: Authorizing `identity:get_project(project_id=e4fda5c0f3254787895d944262ca58ff)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:35.178195 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c36d84-ac59-420f-91aa-4691547da387 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:35.179878 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 556/1116] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 14 17:41:35 2022] GET /identity/v3/projects/e4fda5c0f3254787895d944262ca58ff => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:41:35.186659 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69f71a9-d752-4a63-897c-8bf01c39c08d None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:35.194630 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:35.282726 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69f71a9-d752-4a63-897c-8bf01c39c08d None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:35.315571 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3413c2bf-3131-46ae-8d37-62e929850890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:35.316211 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3413c2bf-3131-46ae-8d37-62e929850890 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:35.316738 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3413c2bf-3131-46ae-8d37-62e929850890 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:35.316738 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3413c2bf-3131-46ae-8d37-62e929850890 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:35.317576 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3413c2bf-3131-46ae-8d37-62e929850890 None admin] RBAC: Adding query filter params (role.id=fa9b6b80eda3440ca058cb77bd7f8f5c, scope.project.id=e4fda5c0f3254787895d944262ca58ff, user.id=36747c689a84434ebd3828baf7a18c33) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:41:35.317886 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3413c2bf-3131-46ae-8d37-62e929850890 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:35.319304 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3413c2bf-3131-46ae-8d37-62e929850890 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:35.324677 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 561/1117] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 14 17:41:35 2022] GET /identity/v3/role_assignments?user.id=36747c689a84434ebd3828baf7a18c33&scope.project.id=e4fda5c0f3254787895d944262ca58ff&role.id=fa9b6b80eda3440ca058cb77bd7f8f5c => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:41:37.336882 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8355927-abdc-4e1f-980b-a0fa218887fb None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:37.337451 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8355927-abdc-4e1f-980b-a0fa218887fb None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:37.337451 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8355927-abdc-4e1f-980b-a0fa218887fb None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:37.338839 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 557/1118] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:41:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:41:37.344046 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bfb7ec-c1c5-404a-9a64-5d8b406bd3d7 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:37.344634 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bfb7ec-c1c5-404a-9a64-5d8b406bd3d7 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:37.344634 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bfb7ec-c1c5-404a-9a64-5d8b406bd3d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:37.361391 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-80bfb7ec-c1c5-404a-9a64-5d8b406bd3d7 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:41:37.362563 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-80bfb7ec-c1c5-404a-9a64-5d8b406bd3d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:41:37.423352 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:37.428491 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 562/1119] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:41:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 17:41:37.451858 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8355927-abdc-4e1f-980b-a0fa218887fb None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:37.555328 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8355927-abdc-4e1f-980b-a0fa218887fb None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:37.589618 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc89a01f-1d94-4e7c-9e96-b28ffb3958ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:37.590389 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc89a01f-1d94-4e7c-9e96-b28ffb3958ac None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:37.590669 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc89a01f-1d94-4e7c-9e96-b28ffb3958ac None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:37.590944 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc89a01f-1d94-4e7c-9e96-b28ffb3958ac None admin] PATH_INFO: `/v3/roles/fa9b6b80eda3440ca058cb77bd7f8f5c` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:37.592407 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc89a01f-1d94-4e7c-9e96-b28ffb3958ac None admin] RBAC: Authorizing `identity:get_role(role_id=fa9b6b80eda3440ca058cb77bd7f8f5c)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:37.593791 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc89a01f-1d94-4e7c-9e96-b28ffb3958ac None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:37.595154 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 558/1120] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 14 17:41:37 2022] GET /identity/v3/roles/fa9b6b80eda3440ca058cb77bd7f8f5c => generated 223 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:41:37.601047 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bfb7ec-c1c5-404a-9a64-5d8b406bd3d7 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:37.704874 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bfb7ec-c1c5-404a-9a64-5d8b406bd3d7 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:37.738269 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8328fb02-dfc7-46c1-8310-358f03de756e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:37.739150 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8328fb02-dfc7-46c1-8310-358f03de756e None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:37.739431 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8328fb02-dfc7-46c1-8310-358f03de756e None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:37.739738 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8328fb02-dfc7-46c1-8310-358f03de756e None admin] PATH_INFO: `/v3/users/36747c689a84434ebd3828baf7a18c33` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:37.740972 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8328fb02-dfc7-46c1-8310-358f03de756e None admin] RBAC: Authorizing `identity:get_user(user_id=36747c689a84434ebd3828baf7a18c33)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:37.742465 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8328fb02-dfc7-46c1-8310-358f03de756e None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:37.744702 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 563/1121] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 14 17:41:37 2022] GET /identity/v3/users/36747c689a84434ebd3828baf7a18c33 => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:41:37.750946 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc89a01f-1d94-4e7c-9e96-b28ffb3958ac None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:37.799456 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:37.853923 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc89a01f-1d94-4e7c-9e96-b28ffb3958ac None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:37.886845 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a059396c-2097-4f57-8e89-f9fdb2fbcfcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:37.887701 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a059396c-2097-4f57-8e89-f9fdb2fbcfcd None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:37.887986 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a059396c-2097-4f57-8e89-f9fdb2fbcfcd None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:37.888262 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a059396c-2097-4f57-8e89-f9fdb2fbcfcd None admin] PATH_INFO: `/v3/projects/e4fda5c0f3254787895d944262ca58ff` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:37.889438 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a059396c-2097-4f57-8e89-f9fdb2fbcfcd None admin] RBAC: Authorizing `identity:get_project(project_id=e4fda5c0f3254787895d944262ca58ff)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:37.890906 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a059396c-2097-4f57-8e89-f9fdb2fbcfcd None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:37.892611 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 559/1122] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 14 17:41:37 2022] GET /identity/v3/projects/e4fda5c0f3254787895d944262ca58ff => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:41:37.898690 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8328fb02-dfc7-46c1-8310-358f03de756e None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:37.966081 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:38.000048 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8328fb02-dfc7-46c1-8310-358f03de756e None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:38.033800 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6bbe85-3eab-4877-aae8-85c9b8211d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:38.034688 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6bbe85-3eab-4877-aae8-85c9b8211d3b None admin] REQUEST_METHOD: `PUT` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:38.034969 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6bbe85-3eab-4877-aae8-85c9b8211d3b None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:38.035255 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6bbe85-3eab-4877-aae8-85c9b8211d3b None admin] PATH_INFO: `/v3/projects/e4fda5c0f3254787895d944262ca58ff/users/36747c689a84434ebd3828baf7a18c33/roles/fa9b6b80eda3440ca058cb77bd7f8f5c` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:38.037568 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6bbe85-3eab-4877-aae8-85c9b8211d3b None admin] RBAC: Authorizing `identity:create_grant(project_id=e4fda5c0f3254787895d944262ca58ff, user_id=36747c689a84434ebd3828baf7a18c33, role_id=fa9b6b80eda3440ca058cb77bd7f8f5c)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:38.039006 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6bbe85-3eab-4877-aae8-85c9b8211d3b None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:38.053374 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 564/1123] 10.222.0.67 () {58 vars in 1439 bytes} [Thu Jul 14 17:41:37 2022] PUT /identity/v3/projects/e4fda5c0f3254787895d944262ca58ff/users/36747c689a84434ebd3828baf7a18c33/roles/fa9b6b80eda3440ca058cb77bd7f8f5c => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 17:41:40.083317 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0109034-8aaa-4dd7-8a3c-fdc00892c9cf None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:40.083847 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0109034-8aaa-4dd7-8a3c-fdc00892c9cf None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:40.083940 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0109034-8aaa-4dd7-8a3c-fdc00892c9cf None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:40.085232 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 560/1124] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:41:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:41:40.090626 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494d4d34-e511-4489-b197-e34c003f4cfb None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:40.091041 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494d4d34-e511-4489-b197-e34c003f4cfb None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:40.091187 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494d4d34-e511-4489-b197-e34c003f4cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:40.107777 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-494d4d34-e511-4489-b197-e34c003f4cfb None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:41:40.108976 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-494d4d34-e511-4489-b197-e34c003f4cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:41:40.174888 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 565/1125] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:41:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 17:41:40.199166 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0109034-8aaa-4dd7-8a3c-fdc00892c9cf None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:40.304291 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0109034-8aaa-4dd7-8a3c-fdc00892c9cf None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:40.318814 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:40.339359 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0bbb43-1fbd-46cb-86ef-879b89bf694b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:40.340141 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0bbb43-1fbd-46cb-86ef-879b89bf694b None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:40.340424 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0bbb43-1fbd-46cb-86ef-879b89bf694b None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:40.340698 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0bbb43-1fbd-46cb-86ef-879b89bf694b None admin] PATH_INFO: `/v3/roles/fa9b6b80eda3440ca058cb77bd7f8f5c` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:40.342194 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0bbb43-1fbd-46cb-86ef-879b89bf694b None admin] RBAC: Authorizing `identity:get_role(role_id=fa9b6b80eda3440ca058cb77bd7f8f5c)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:40.343556 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0bbb43-1fbd-46cb-86ef-879b89bf694b None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:40.344920 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 561/1126] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 14 17:41:40 2022] GET /identity/v3/roles/fa9b6b80eda3440ca058cb77bd7f8f5c => generated 223 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:41:40.350946 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494d4d34-e511-4489-b197-e34c003f4cfb None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:40.409594 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:40.452049 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494d4d34-e511-4489-b197-e34c003f4cfb None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:40.485870 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166fbc40-cd11-4cae-ba5e-5f66e1285dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:40.486756 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166fbc40-cd11-4cae-ba5e-5f66e1285dd0 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:40.487034 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166fbc40-cd11-4cae-ba5e-5f66e1285dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:40.487304 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166fbc40-cd11-4cae-ba5e-5f66e1285dd0 None admin] PATH_INFO: `/v3/users/36747c689a84434ebd3828baf7a18c33` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:40.488488 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166fbc40-cd11-4cae-ba5e-5f66e1285dd0 None admin] RBAC: Authorizing `identity:get_user(user_id=36747c689a84434ebd3828baf7a18c33)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:40.489964 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166fbc40-cd11-4cae-ba5e-5f66e1285dd0 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:40.491586 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 566/1127] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 14 17:41:40 2022] GET /identity/v3/users/36747c689a84434ebd3828baf7a18c33 => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:41:40.498743 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0bbb43-1fbd-46cb-86ef-879b89bf694b None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:40.613928 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0bbb43-1fbd-46cb-86ef-879b89bf694b None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:40.647360 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a42f0a-5bf1-434b-b44a-1711364890a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:40.648018 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a42f0a-5bf1-434b-b44a-1711364890a3 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:40.648305 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a42f0a-5bf1-434b-b44a-1711364890a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:40.648584 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a42f0a-5bf1-434b-b44a-1711364890a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:40.697419 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:40.715940 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a42f0a-5bf1-434b-b44a-1711364890a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:40.717403 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a42f0a-5bf1-434b-b44a-1711364890a3 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:40.831433 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 562/1128] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 14 17:41:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 17:41:40.837372 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166fbc40-cd11-4cae-ba5e-5f66e1285dd0 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:40.933282 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166fbc40-cd11-4cae-ba5e-5f66e1285dd0 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:40.960288 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:40.969906 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382d8ea0-8b3a-45c6-978c-bfe31d9db730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:40.970814 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382d8ea0-8b3a-45c6-978c-bfe31d9db730 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:40.971096 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382d8ea0-8b3a-45c6-978c-bfe31d9db730 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:40.971370 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382d8ea0-8b3a-45c6-978c-bfe31d9db730 None admin] PATH_INFO: `/v3/projects/e4fda5c0f3254787895d944262ca58ff` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:40.972619 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382d8ea0-8b3a-45c6-978c-bfe31d9db730 None admin] RBAC: Authorizing `identity:get_project(project_id=e4fda5c0f3254787895d944262ca58ff)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:40.974122 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382d8ea0-8b3a-45c6-978c-bfe31d9db730 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:40.975892 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 567/1129] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 14 17:41:40 2022] GET /identity/v3/projects/e4fda5c0f3254787895d944262ca58ff => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:41:40.982349 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a42f0a-5bf1-434b-b44a-1711364890a3 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:41.066409 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:41.085565 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a42f0a-5bf1-434b-b44a-1711364890a3 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:41.119302 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5491759-7176-43d4-805c-30c241c118e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:41.119950 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5491759-7176-43d4-805c-30c241c118e8 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:41.120228 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5491759-7176-43d4-805c-30c241c118e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:41.120500 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5491759-7176-43d4-805c-30c241c118e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:41.121619 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5491759-7176-43d4-805c-30c241c118e8 None admin] RBAC: Adding query filter params (role.id=fa9b6b80eda3440ca058cb77bd7f8f5c, scope.project.id=e4fda5c0f3254787895d944262ca58ff, user.id=36747c689a84434ebd3828baf7a18c33) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:41:41.121928 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5491759-7176-43d4-805c-30c241c118e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:41.123360 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5491759-7176-43d4-805c-30c241c118e8 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:41.129119 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 563/1130] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 14 17:41:40 2022] GET /identity/v3/role_assignments?user.id=36747c689a84434ebd3828baf7a18c33&scope.project.id=e4fda5c0f3254787895d944262ca58ff&role.id=fa9b6b80eda3440ca058cb77bd7f8f5c => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:41:43.177053 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e637feca-4510-4561-b4c9-519e4a9fac56 None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:43.177640 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e637feca-4510-4561-b4c9-519e4a9fac56 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:43.177640 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e637feca-4510-4561-b4c9-519e4a9fac56 None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:43.178983 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 568/1131] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:41:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:41:43.184254 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7479f29-385e-4b1d-83bc-3ad8e624a92b None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:43.184648 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7479f29-385e-4b1d-83bc-3ad8e624a92b None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:43.184814 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7479f29-385e-4b1d-83bc-3ad8e624a92b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:43.201353 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-e7479f29-385e-4b1d-83bc-3ad8e624a92b None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:41:43.202566 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-e7479f29-385e-4b1d-83bc-3ad8e624a92b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:41:43.271193 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 564/1132] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:41:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 17:41:43.295487 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e637feca-4510-4561-b4c9-519e4a9fac56 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:43.403411 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e637feca-4510-4561-b4c9-519e4a9fac56 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:43.439828 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad7c23f-a121-4093-802b-154c652d7049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:43.440548 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad7c23f-a121-4093-802b-154c652d7049 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:43.440830 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad7c23f-a121-4093-802b-154c652d7049 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:43.441108 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad7c23f-a121-4093-802b-154c652d7049 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:43.442317 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad7c23f-a121-4093-802b-154c652d7049 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:43.443753 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad7c23f-a121-4093-802b-154c652d7049 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:43.445371 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 569/1133] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:41:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:41:43.451773 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7479f29-385e-4b1d-83bc-3ad8e624a92b None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:43.526948 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:43.549397 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7479f29-385e-4b1d-83bc-3ad8e624a92b None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:43.582633 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472c76ef-5666-4df5-8d10-bcdaf857def9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:43.583291 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472c76ef-5666-4df5-8d10-bcdaf857def9 None admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:43.583574 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472c76ef-5666-4df5-8d10-bcdaf857def9 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:43.583849 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472c76ef-5666-4df5-8d10-bcdaf857def9 None admin] PATH_INFO: `/v3/projects` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:43.584549 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472c76ef-5666-4df5-8d10-bcdaf857def9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:43.586008 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472c76ef-5666-4df5-8d10-bcdaf857def9 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:43.611368 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 565/1134] 10.222.0.67 () {60 vars in 1141 bytes} [Thu Jul 14 17:41:43 2022] POST /identity/v3/projects => generated 311 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:41:45.654984 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157df367-1f04-4cdd-9589-6182cd478c36 None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:45.655500 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157df367-1f04-4cdd-9589-6182cd478c36 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:45.655613 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157df367-1f04-4cdd-9589-6182cd478c36 None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:45.656892 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 570/1135] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:41:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:41:45.662083 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e76c8-20b0-48db-9c8c-261bc0884f88 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:45.662492 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e76c8-20b0-48db-9c8c-261bc0884f88 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:45.662639 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e76c8-20b0-48db-9c8c-261bc0884f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:45.678899 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-1d7e76c8-20b0-48db-9c8c-261bc0884f88 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:41:45.680075 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-1d7e76c8-20b0-48db-9c8c-261bc0884f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:41:45.748395 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 566/1136] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:41:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 17:41:45.776778 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157df367-1f04-4cdd-9589-6182cd478c36 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:45.842716 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:45.881321 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157df367-1f04-4cdd-9589-6182cd478c36 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:45.915291 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22da96e5-6d9a-4e07-a1a0-423d00173ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:45.916084 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22da96e5-6d9a-4e07-a1a0-423d00173ad0 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:45.916365 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22da96e5-6d9a-4e07-a1a0-423d00173ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:45.916639 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22da96e5-6d9a-4e07-a1a0-423d00173ad0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:45.917849 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22da96e5-6d9a-4e07-a1a0-423d00173ad0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:45.919278 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22da96e5-6d9a-4e07-a1a0-423d00173ad0 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:45.920896 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 571/1137] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:41:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:41:45.926688 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7e76c8-20b0-48db-9c8c-261bc0884f88 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:45.983495 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:46.025937 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7e76c8-20b0-48db-9c8c-261bc0884f88 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:46.058970 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d242dad3-32f1-443e-88ef-434641b2138c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:46.059658 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d242dad3-32f1-443e-88ef-434641b2138c None admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:46.059936 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d242dad3-32f1-443e-88ef-434641b2138c None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:46.060206 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d242dad3-32f1-443e-88ef-434641b2138c None admin] PATH_INFO: `/v3/users` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:46.060928 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d242dad3-32f1-443e-88ef-434641b2138c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:46.062431 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d242dad3-32f1-443e-88ef-434641b2138c None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:46.084081 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 567/1138] 10.222.0.67 () {60 vars in 1132 bytes} [Thu Jul 14 17:41:45 2022] POST /identity/v3/users => generated 286 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:41:48.171190 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befb6a09-1915-4ca9-a8c1-c909255c03d5 None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:48.171754 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befb6a09-1915-4ca9-a8c1-c909255c03d5 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:48.171754 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befb6a09-1915-4ca9-a8c1-c909255c03d5 None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:48.173098 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 572/1139] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:41:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:41:48.178550 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa17af-ceff-4a4d-8f57-420976b4b516 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:48.178929 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa17af-ceff-4a4d-8f57-420976b4b516 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:48.179102 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa17af-ceff-4a4d-8f57-420976b4b516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:48.196164 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-32fa17af-ceff-4a4d-8f57-420976b4b516 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:41:48.197905 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-32fa17af-ceff-4a4d-8f57-420976b4b516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:41:48.262869 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 568/1140] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:41:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 17:41:48.286875 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befb6a09-1915-4ca9-a8c1-c909255c03d5 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:48.388307 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befb6a09-1915-4ca9-a8c1-c909255c03d5 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:48.416074 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:48.422365 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5519efa3-1b75-47f7-9309-40855ba94ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:48.423097 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5519efa3-1b75-47f7-9309-40855ba94ad0 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:48.423379 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5519efa3-1b75-47f7-9309-40855ba94ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:48.423651 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5519efa3-1b75-47f7-9309-40855ba94ad0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:48.434751 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5519efa3-1b75-47f7-9309-40855ba94ad0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:41:48.442548 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-5519efa3-1b75-47f7-9309-40855ba94ad0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 17:41:48.442548 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:41:48.442548 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:41:48.442548 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:41:48.442548 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:41:48.442548 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:41:48.442548 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:41:48.442548 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:41:48.442548 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:41:48.442548 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:41:48.442548 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:41:48.442548 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:41:48.442548 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:41:48.442548 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:41:48.442548 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:41:48.442548 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:41:48.443646 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:41:48.443646 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:41:48.443646 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:41:48.443646 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:41:48.443646 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:41:48.443646 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:41:48.443646 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:41:48.443646 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:41:48.443646 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:41:48.443646 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:41:48.443646 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:41:48.443646 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:41:48.443646 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:41:48.443646 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:41:48.443646 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:41:48.443646 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:41:48.444564 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:41:48.444564 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:41:48.444564 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:41:48.444564 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:41:48.444564 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:41:48.444564 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:41:48.444564 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:41:48.444564 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:41:48.444564 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:41:48.444564 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:41:48.444564 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 17:41:48.444564 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:41:48.444564 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 573/1141] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 14 17:41:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 17:41:48.450593 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fa17af-ceff-4a4d-8f57-420976b4b516 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:48.495938 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:48.550112 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fa17af-ceff-4a4d-8f57-420976b4b516 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:48.592458 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ba2f09-7f38-46fe-8701-e3690ff1e3d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:48.593133 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ba2f09-7f38-46fe-8701-e3690ff1e3d4 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:48.593420 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ba2f09-7f38-46fe-8701-e3690ff1e3d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:48.593730 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ba2f09-7f38-46fe-8701-e3690ff1e3d4 None admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:48.594487 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ba2f09-7f38-46fe-8701-e3690ff1e3d4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:41:48.594799 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ba2f09-7f38-46fe-8701-e3690ff1e3d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:48.596166 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ba2f09-7f38-46fe-8701-e3690ff1e3d4 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:48.604570 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 569/1142] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 14 17:41:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:41:48.610704 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5519efa3-1b75-47f7-9309-40855ba94ad0 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:48.717651 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5519efa3-1b75-47f7-9309-40855ba94ad0 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:48.758772 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd7344d-f490-4281-8fc3-bcfc70b63337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:48.760339 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd7344d-f490-4281-8fc3-bcfc70b63337 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:48.760685 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd7344d-f490-4281-8fc3-bcfc70b63337 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:48.761056 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd7344d-f490-4281-8fc3-bcfc70b63337 None admin] PATH_INFO: `/v3/users/15b5be68c49d4f7b99bedd3f880e701c` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:48.780187 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd7344d-f490-4281-8fc3-bcfc70b63337 None admin] RBAC: Authorizing `identity:get_user(user_id=15b5be68c49d4f7b99bedd3f880e701c)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:48.781809 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd7344d-f490-4281-8fc3-bcfc70b63337 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:48.783829 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 574/1143] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 14 17:41:48 2022] GET /identity/v3/users/15b5be68c49d4f7b99bedd3f880e701c => generated 286 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:41:48.790000 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ba2f09-7f38-46fe-8701-e3690ff1e3d4 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:48.898447 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ba2f09-7f38-46fe-8701-e3690ff1e3d4 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:48.906676 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:48.934499 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29efd0b-a13c-4ee3-9575-9be08f265739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:48.935158 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29efd0b-a13c-4ee3-9575-9be08f265739 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:48.935444 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29efd0b-a13c-4ee3-9575-9be08f265739 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:48.935716 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29efd0b-a13c-4ee3-9575-9be08f265739 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:49.004788 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29efd0b-a13c-4ee3-9575-9be08f265739 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:49.006189 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29efd0b-a13c-4ee3-9575-9be08f265739 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:49.102103 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 570/1144] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 14 17:41:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 17:41:49.108708 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd7344d-f490-4281-8fc3-bcfc70b63337 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:49.156944 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:49.206786 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd7344d-f490-4281-8fc3-bcfc70b63337 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:49.241110 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10b037b-5eaa-48e8-8381-045ac680b96f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:49.241987 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b037b-5eaa-48e8-8381-045ac680b96f None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:49.242264 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b037b-5eaa-48e8-8381-045ac680b96f None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:49.242537 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b037b-5eaa-48e8-8381-045ac680b96f None admin] PATH_INFO: `/v3/projects/40f40ef0fd2a4ff4a7014f1f64bcd83b` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:49.244011 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10b037b-5eaa-48e8-8381-045ac680b96f None admin] RBAC: Authorizing `identity:get_project(project_id=40f40ef0fd2a4ff4a7014f1f64bcd83b)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:49.245439 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10b037b-5eaa-48e8-8381-045ac680b96f None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:49.247415 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 575/1145] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 14 17:41:49 2022] GET /identity/v3/projects/40f40ef0fd2a4ff4a7014f1f64bcd83b => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:41:49.253629 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29efd0b-a13c-4ee3-9575-9be08f265739 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:49.261962 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:49.358742 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29efd0b-a13c-4ee3-9575-9be08f265739 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:49.397635 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07692fb-acef-4861-8c81-dd5ebc05c302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:49.398292 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07692fb-acef-4861-8c81-dd5ebc05c302 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:49.398574 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07692fb-acef-4861-8c81-dd5ebc05c302 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:49.398846 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07692fb-acef-4861-8c81-dd5ebc05c302 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:49.399683 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07692fb-acef-4861-8c81-dd5ebc05c302 None admin] RBAC: Adding query filter params (role.id=4651a1cc7b4d4ab7a7a9ca1e77e58e71, scope.project.id=40f40ef0fd2a4ff4a7014f1f64bcd83b, user.id=15b5be68c49d4f7b99bedd3f880e701c) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:41:49.400531 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07692fb-acef-4861-8c81-dd5ebc05c302 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:49.402003 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07692fb-acef-4861-8c81-dd5ebc05c302 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:49.407748 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 571/1146] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 14 17:41:49 2022] GET /identity/v3/role_assignments?user.id=15b5be68c49d4f7b99bedd3f880e701c&scope.project.id=40f40ef0fd2a4ff4a7014f1f64bcd83b&role.id=4651a1cc7b4d4ab7a7a9ca1e77e58e71 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:41:51.427890 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20510746-017d-4b00-9150-376127192d14 None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:51.428471 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20510746-017d-4b00-9150-376127192d14 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:51.428471 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20510746-017d-4b00-9150-376127192d14 None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:51.429819 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 576/1147] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:41:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:41:51.435721 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1aa00c-1bd4-4e57-a5b6-65d2d540e77e None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:51.436119 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1aa00c-1bd4-4e57-a5b6-65d2d540e77e None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:51.436324 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1aa00c-1bd4-4e57-a5b6-65d2d540e77e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:51.454280 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-5e1aa00c-1bd4-4e57-a5b6-65d2d540e77e None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:41:51.455496 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-5e1aa00c-1bd4-4e57-a5b6-65d2d540e77e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:41:51.531127 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:51.536628 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 572/1148] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:41:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 17:41:51.561043 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20510746-017d-4b00-9150-376127192d14 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:51.665460 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20510746-017d-4b00-9150-376127192d14 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:51.682458 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:51.701802 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd45c9ca-a896-4fae-9371-c2c458bc83f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:51.702626 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd45c9ca-a896-4fae-9371-c2c458bc83f3 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:51.702907 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd45c9ca-a896-4fae-9371-c2c458bc83f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:51.703285 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd45c9ca-a896-4fae-9371-c2c458bc83f3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:51.714171 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd45c9ca-a896-4fae-9371-c2c458bc83f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:41:51.721840 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-fd45c9ca-a896-4fae-9371-c2c458bc83f3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 17:41:51.721840 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:41:51.721840 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:41:51.721840 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:41:51.721840 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:41:51.721840 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:41:51.721840 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:41:51.721840 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:41:51.721840 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:41:51.721840 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:41:51.721840 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:41:51.721840 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:41:51.721840 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:41:51.721840 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:41:51.721840 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:41:51.721840 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:41:51.723648 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:41:51.723648 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:41:51.723648 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:41:51.723648 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:41:51.723648 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:41:51.723648 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:41:51.723648 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:41:51.723648 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:41:51.723648 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:41:51.723648 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:41:51.723648 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:41:51.723648 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:41:51.723648 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:41:51.723648 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:41:51.723648 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:41:51.723648 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:41:51.725313 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:41:51.725313 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:41:51.725313 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:41:51.725313 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:41:51.725313 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:41:51.725313 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:41:51.725313 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:41:51.725313 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:41:51.725313 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:41:51.725313 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:41:51.725313 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 17:41:51.725313 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:41:51.725313 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 577/1149] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 14 17:41:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:41:51.729734 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1aa00c-1bd4-4e57-a5b6-65d2d540e77e None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:51.830001 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1aa00c-1bd4-4e57-a5b6-65d2d540e77e None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:51.864642 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc70d420-3bdd-4054-956c-353b8c74e56d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:51.865314 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc70d420-3bdd-4054-956c-353b8c74e56d None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:51.865628 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc70d420-3bdd-4054-956c-353b8c74e56d None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:51.865995 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc70d420-3bdd-4054-956c-353b8c74e56d None admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:51.866663 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc70d420-3bdd-4054-956c-353b8c74e56d None admin] RBAC: Adding query filter params (name=admin) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:41:51.866972 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc70d420-3bdd-4054-956c-353b8c74e56d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:51.868576 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc70d420-3bdd-4054-956c-353b8c74e56d None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:51.877859 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 573/1150] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 14 17:41:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:41:51.883724 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd45c9ca-a896-4fae-9371-c2c458bc83f3 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:51.982472 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd45c9ca-a896-4fae-9371-c2c458bc83f3 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:52.016335 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99754ee7-cab5-4d23-a9cf-b2401702b25a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:52.017205 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99754ee7-cab5-4d23-a9cf-b2401702b25a None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:52.017487 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99754ee7-cab5-4d23-a9cf-b2401702b25a None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:52.017798 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99754ee7-cab5-4d23-a9cf-b2401702b25a None admin] PATH_INFO: `/v3/users/15b5be68c49d4f7b99bedd3f880e701c` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:52.019004 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99754ee7-cab5-4d23-a9cf-b2401702b25a None admin] RBAC: Authorizing `identity:get_user(user_id=15b5be68c49d4f7b99bedd3f880e701c)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:52.020446 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99754ee7-cab5-4d23-a9cf-b2401702b25a None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:52.022127 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 578/1151] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 14 17:41:51 2022] GET /identity/v3/users/15b5be68c49d4f7b99bedd3f880e701c => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:41:52.028761 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc70d420-3bdd-4054-956c-353b8c74e56d None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:52.092431 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:52.133767 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc70d420-3bdd-4054-956c-353b8c74e56d None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:52.168072 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393798e9-469f-4704-8d8d-fc36b6c2fef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:52.168931 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393798e9-469f-4704-8d8d-fc36b6c2fef9 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:52.169220 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393798e9-469f-4704-8d8d-fc36b6c2fef9 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:52.169499 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393798e9-469f-4704-8d8d-fc36b6c2fef9 None admin] PATH_INFO: `/v3/projects/40f40ef0fd2a4ff4a7014f1f64bcd83b` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:52.170721 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393798e9-469f-4704-8d8d-fc36b6c2fef9 None admin] RBAC: Authorizing `identity:get_project(project_id=40f40ef0fd2a4ff4a7014f1f64bcd83b)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:52.172157 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393798e9-469f-4704-8d8d-fc36b6c2fef9 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:52.173906 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 574/1152] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 14 17:41:52 2022] GET /identity/v3/projects/40f40ef0fd2a4ff4a7014f1f64bcd83b => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:41:52.185010 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99754ee7-cab5-4d23-a9cf-b2401702b25a None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:52.255438 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:52.318182 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99754ee7-cab5-4d23-a9cf-b2401702b25a None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:52.359875 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6057db2e-48d3-48b4-ae7a-ff0867fef50b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:52.360781 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6057db2e-48d3-48b4-ae7a-ff0867fef50b None admin] REQUEST_METHOD: `PUT` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:52.361059 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6057db2e-48d3-48b4-ae7a-ff0867fef50b None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:52.361336 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6057db2e-48d3-48b4-ae7a-ff0867fef50b None admin] PATH_INFO: `/v3/projects/40f40ef0fd2a4ff4a7014f1f64bcd83b/users/15b5be68c49d4f7b99bedd3f880e701c/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:52.363390 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6057db2e-48d3-48b4-ae7a-ff0867fef50b None admin] RBAC: Authorizing `identity:create_grant(project_id=40f40ef0fd2a4ff4a7014f1f64bcd83b, user_id=15b5be68c49d4f7b99bedd3f880e701c, role_id=4651a1cc7b4d4ab7a7a9ca1e77e58e71)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:52.364837 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6057db2e-48d3-48b4-ae7a-ff0867fef50b None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:52.380148 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 579/1153] 10.222.0.67 () {58 vars in 1439 bytes} [Thu Jul 14 17:41:52 2022] PUT /identity/v3/projects/40f40ef0fd2a4ff4a7014f1f64bcd83b/users/15b5be68c49d4f7b99bedd3f880e701c/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:41:54.496516 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71557707-afde-4962-9911-ac758b4c9faa None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:54.497338 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71557707-afde-4962-9911-ac758b4c9faa None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:54.497338 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71557707-afde-4962-9911-ac758b4c9faa None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:54.498741 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 575/1154] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:41:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:41:54.504497 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c5183-faed-4a75-9fc4-e3ad766f4a7f None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:54.504955 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c5183-faed-4a75-9fc4-e3ad766f4a7f None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:54.505216 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c5183-faed-4a75-9fc4-e3ad766f4a7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:54.525139 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-8a0c5183-faed-4a75-9fc4-e3ad766f4a7f None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:41:54.526644 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-8a0c5183-faed-4a75-9fc4-e3ad766f4a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:41:54.597711 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 580/1155] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:41:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 17:41:54.622442 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71557707-afde-4962-9911-ac758b4c9faa None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:54.753013 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71557707-afde-4962-9911-ac758b4c9faa None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:54.782499 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:54.789654 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36080fa8-0320-4c3f-8e53-15e5c40919ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:54.791047 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36080fa8-0320-4c3f-8e53-15e5c40919ed None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:54.791329 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36080fa8-0320-4c3f-8e53-15e5c40919ed None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:54.791618 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36080fa8-0320-4c3f-8e53-15e5c40919ed None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:54.803893 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36080fa8-0320-4c3f-8e53-15e5c40919ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:41:54.812958 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-36080fa8-0320-4c3f-8e53-15e5c40919ed None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 17:41:54.812958 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:41:54.812958 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:41:54.812958 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:41:54.812958 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:41:54.812958 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:41:54.812958 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:41:54.812958 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:41:54.812958 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:41:54.812958 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:41:54.812958 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:41:54.812958 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:41:54.812958 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:41:54.812958 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:41:54.812958 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:41:54.812958 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:41:54.814223 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:41:54.814223 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:41:54.814223 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:41:54.814223 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:41:54.814223 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:41:54.814223 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:41:54.814223 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:41:54.814223 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:41:54.814223 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:41:54.814223 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:41:54.814223 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:41:54.814223 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:41:54.814223 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:41:54.814223 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:41:54.814223 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:41:54.814223 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:41:54.815276 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:41:54.815276 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:41:54.815276 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:41:54.815276 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:41:54.815276 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:41:54.815276 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:41:54.815276 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:41:54.815276 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:41:54.815276 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:41:54.815276 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:41:54.815276 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 17:41:54.815276 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:41:54.815276 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 576/1156] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 14 17:41:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:41:54.820896 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0c5183-faed-4a75-9fc4-e3ad766f4a7f None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:54.858236 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:54.926147 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0c5183-faed-4a75-9fc4-e3ad766f4a7f None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:54.965465 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad0b80b-25df-4039-b0c7-8375cdbd44fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:54.966231 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad0b80b-25df-4039-b0c7-8375cdbd44fa None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:54.966510 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad0b80b-25df-4039-b0c7-8375cdbd44fa None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:54.966785 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad0b80b-25df-4039-b0c7-8375cdbd44fa None admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:54.967616 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad0b80b-25df-4039-b0c7-8375cdbd44fa None admin] RBAC: Adding query filter params (name=admin) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:41:54.967939 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad0b80b-25df-4039-b0c7-8375cdbd44fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:54.969484 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad0b80b-25df-4039-b0c7-8375cdbd44fa None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:54.979855 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 581/1157] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 14 17:41:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:41:54.986682 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36080fa8-0320-4c3f-8e53-15e5c40919ed None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:55.128121 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36080fa8-0320-4c3f-8e53-15e5c40919ed None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:55.169113 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53af22fa-1649-48df-ac92-d8289cf09f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:55.170016 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af22fa-1649-48df-ac92-d8289cf09f11 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:55.170296 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af22fa-1649-48df-ac92-d8289cf09f11 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:55.170568 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af22fa-1649-48df-ac92-d8289cf09f11 None admin] PATH_INFO: `/v3/users/15b5be68c49d4f7b99bedd3f880e701c` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:55.171790 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53af22fa-1649-48df-ac92-d8289cf09f11 None admin] RBAC: Authorizing `identity:get_user(user_id=15b5be68c49d4f7b99bedd3f880e701c)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:55.173228 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53af22fa-1649-48df-ac92-d8289cf09f11 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:55.174906 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 577/1158] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 14 17:41:54 2022] GET /identity/v3/users/15b5be68c49d4f7b99bedd3f880e701c => generated 286 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:41:55.181516 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad0b80b-25df-4039-b0c7-8375cdbd44fa None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:55.297348 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:55.304009 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad0b80b-25df-4039-b0c7-8375cdbd44fa None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:55.345660 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ededf48-08b4-4cfc-950f-484cdd847afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:55.346413 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ededf48-08b4-4cfc-950f-484cdd847afc None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:55.346695 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ededf48-08b4-4cfc-950f-484cdd847afc None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:55.347040 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ededf48-08b4-4cfc-950f-484cdd847afc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:55.431535 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ededf48-08b4-4cfc-950f-484cdd847afc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:55.433003 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ededf48-08b4-4cfc-950f-484cdd847afc None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:55.544448 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:55.552562 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 582/1159] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 14 17:41:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 17:41:55.560245 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53af22fa-1649-48df-ac92-d8289cf09f11 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:55.656551 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:55.702271 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53af22fa-1649-48df-ac92-d8289cf09f11 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:55.738752 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a01cc9-81f8-4cd3-9b8c-398105997970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:55.739648 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a01cc9-81f8-4cd3-9b8c-398105997970 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:55.739929 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a01cc9-81f8-4cd3-9b8c-398105997970 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:55.740205 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a01cc9-81f8-4cd3-9b8c-398105997970 None admin] PATH_INFO: `/v3/projects/40f40ef0fd2a4ff4a7014f1f64bcd83b` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:55.741599 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a01cc9-81f8-4cd3-9b8c-398105997970 None admin] RBAC: Authorizing `identity:get_project(project_id=40f40ef0fd2a4ff4a7014f1f64bcd83b)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:55.743112 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a01cc9-81f8-4cd3-9b8c-398105997970 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:55.745033 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 578/1160] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 14 17:41:55 2022] GET /identity/v3/projects/40f40ef0fd2a4ff4a7014f1f64bcd83b => generated 311 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:41:55.751659 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ededf48-08b4-4cfc-950f-484cdd847afc None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:55.872454 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ededf48-08b4-4cfc-950f-484cdd847afc None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:55.914888 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c978cf-7555-4bdc-8347-f5d2ddfc314d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:55.915468 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c978cf-7555-4bdc-8347-f5d2ddfc314d None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:55.915776 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c978cf-7555-4bdc-8347-f5d2ddfc314d None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:55.916055 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c978cf-7555-4bdc-8347-f5d2ddfc314d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:55.916897 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c978cf-7555-4bdc-8347-f5d2ddfc314d None admin] RBAC: Adding query filter params (role.id=4651a1cc7b4d4ab7a7a9ca1e77e58e71, scope.project.id=40f40ef0fd2a4ff4a7014f1f64bcd83b, user.id=15b5be68c49d4f7b99bedd3f880e701c) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:41:55.917212 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c978cf-7555-4bdc-8347-f5d2ddfc314d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:55.918757 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c978cf-7555-4bdc-8347-f5d2ddfc314d None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:55.925610 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 583/1161] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 14 17:41:55 2022] GET /identity/v3/role_assignments?user.id=15b5be68c49d4f7b99bedd3f880e701c&scope.project.id=40f40ef0fd2a4ff4a7014f1f64bcd83b&role.id=4651a1cc7b4d4ab7a7a9ca1e77e58e71 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:41:58.228364 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44efc0f0-c39c-4dcd-9079-39550140c651 None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:58.228912 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44efc0f0-c39c-4dcd-9079-39550140c651 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:58.228912 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44efc0f0-c39c-4dcd-9079-39550140c651 None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:58.230327 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 579/1162] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:41:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:41:58.236780 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f731e6-0397-43a2-a9c6-d3a962e89a34 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:58.237258 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f731e6-0397-43a2-a9c6-d3a962e89a34 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:58.237692 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f731e6-0397-43a2-a9c6-d3a962e89a34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:58.258832 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-a9f731e6-0397-43a2-a9c6-d3a962e89a34 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:41:58.260840 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-a9f731e6-0397-43a2-a9c6-d3a962e89a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:41:58.327812 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:58.341641 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 584/1163] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:41:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 17:41:58.365254 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44efc0f0-c39c-4dcd-9079-39550140c651 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:58.473859 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44efc0f0-c39c-4dcd-9079-39550140c651 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:58.501421 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:58.510629 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e71658-b7b2-46fe-b7ee-68adcc83b871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:58.511283 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e71658-b7b2-46fe-b7ee-68adcc83b871 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:58.511560 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e71658-b7b2-46fe-b7ee-68adcc83b871 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:58.511836 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e71658-b7b2-46fe-b7ee-68adcc83b871 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:58.580361 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e71658-b7b2-46fe-b7ee-68adcc83b871 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:58.581840 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e71658-b7b2-46fe-b7ee-68adcc83b871 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:58.694457 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 580/1164] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 14 17:41:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 17:41:58.701079 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f731e6-0397-43a2-a9c6-d3a962e89a34 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:58.810210 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f731e6-0397-43a2-a9c6-d3a962e89a34 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:58.857467 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef55747-355c-4c30-ab5a-b35f2b23f75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:58.858463 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef55747-355c-4c30-ab5a-b35f2b23f75d None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:58.858747 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef55747-355c-4c30-ab5a-b35f2b23f75d None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:58.859151 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef55747-355c-4c30-ab5a-b35f2b23f75d None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:58.866594 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef55747-355c-4c30-ab5a-b35f2b23f75d None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:58.868040 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef55747-355c-4c30-ab5a-b35f2b23f75d None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:58.883809 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-6ef55747-355c-4c30-ab5a-b35f2b23f75d None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 14 17:41:58.883809 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:41:58.883809 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 14 17:41:58.883809 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 14 17:41:58.883809 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 17:41:58.883809 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 17:41:58.883809 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 17:41:58.883809 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 17:41:58.883809 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 14 17:41:58.883809 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:41:58.883809 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 17:41:58.883809 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:41:58.883809 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:41:58.883809 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:41:58.883809 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:41:58.883809 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:41:58.883809 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:41:58.885848 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:41:58.885848 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:41:58.885848 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:41:58.885848 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:41:58.885848 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:41:58.885848 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:41:58.885848 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:41:58.885848 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:41:58.885848 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:41:58.885848 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:41:58.885848 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:41:58.885848 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:41:58.885848 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:41:58.885848 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:41:58.885848 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:41:58.885848 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:41:58.887496 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:41:58.887496 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:41:58.887496 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:41:58.887496 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:41:58.887496 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:41:58.887496 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:41:58.887496 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:41:58.887496 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:41:58.887496 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:41:58.887496 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:41:58.887496 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 14 17:41:58.887496 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:41:58.887496 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 14 17:41:58.887496 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:41:58.887496 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 585/1165] 10.222.0.67 () {56 vars in 1117 bytes} [Thu Jul 14 17:41:58 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 17:41:58.893607 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e71658-b7b2-46fe-b7ee-68adcc83b871 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:41:58.927858 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:41:59.005370 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e71658-b7b2-46fe-b7ee-68adcc83b871 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:41:59.041813 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3fee80-559c-46b0-82b6-5df6e7acb745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:41:59.042489 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3fee80-559c-46b0-82b6-5df6e7acb745 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:41:59.042773 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3fee80-559c-46b0-82b6-5df6e7acb745 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:41:59.043120 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3fee80-559c-46b0-82b6-5df6e7acb745 None admin] PATH_INFO: `/v3/domains` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:41:59.043849 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3fee80-559c-46b0-82b6-5df6e7acb745 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:41:59.044151 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3fee80-559c-46b0-82b6-5df6e7acb745 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:41:59.045516 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3fee80-559c-46b0-82b6-5df6e7acb745 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:41:59.053349 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 581/1166] 10.222.0.67 () {56 vars in 1115 bytes} [Thu Jul 14 17:41:58 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:42:01.255637 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3555483-b355-4959-8e85-1a1f23c022f6 None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:42:01.256272 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3555483-b355-4959-8e85-1a1f23c022f6 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:42:01.256272 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3555483-b355-4959-8e85-1a1f23c022f6 None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:42:01.257655 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 586/1167] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:42:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:42:01.264565 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0497c6a-712c-4106-9db3-8e09e8a05bfd None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:42:01.265121 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0497c6a-712c-4106-9db3-8e09e8a05bfd None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:42:01.265217 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0497c6a-712c-4106-9db3-8e09e8a05bfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:42:01.288406 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-f0497c6a-712c-4106-9db3-8e09e8a05bfd None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:42:01.290215 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-f0497c6a-712c-4106-9db3-8e09e8a05bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:42:01.374365 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 582/1168] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:42:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 17:42:01.402947 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3555483-b355-4959-8e85-1a1f23c022f6 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:42:01.465403 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:42:01.526496 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3555483-b355-4959-8e85-1a1f23c022f6 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:42:01.564608 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c949e6d-87fe-42cd-9652-8a2d8737d8bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:42:01.565274 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c949e6d-87fe-42cd-9652-8a2d8737d8bd None admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:42:01.565577 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c949e6d-87fe-42cd-9652-8a2d8737d8bd None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:42:01.565852 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c949e6d-87fe-42cd-9652-8a2d8737d8bd None admin] PATH_INFO: `/v3/domains` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:42:01.566693 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c949e6d-87fe-42cd-9652-8a2d8737d8bd None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:42:01.568143 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c949e6d-87fe-42cd-9652-8a2d8737d8bd None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:42:01.584078 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 587/1169] 10.222.0.67 () {60 vars in 1138 bytes} [Thu Jul 14 17:42:01 2022] POST /identity/v3/domains => generated 267 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:42:03.729065 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a109f83b-bd7f-48b2-b41a-952ce7e887c6 None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:42:03.729622 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a109f83b-bd7f-48b2-b41a-952ce7e887c6 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:42:03.729622 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a109f83b-bd7f-48b2-b41a-952ce7e887c6 None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:42:03.730938 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 583/1170] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:42:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:42:03.736410 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbe3ec7-622e-44d7-9a9d-7b54aab6c76d None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:42:03.736864 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbe3ec7-622e-44d7-9a9d-7b54aab6c76d None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:42:03.736972 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbe3ec7-622e-44d7-9a9d-7b54aab6c76d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:42:03.754470 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-dcbe3ec7-622e-44d7-9a9d-7b54aab6c76d None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:42:03.755671 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-dcbe3ec7-622e-44d7-9a9d-7b54aab6c76d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:42:03.825422 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 588/1171] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:42:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 17:42:03.848545 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a109f83b-bd7f-48b2-b41a-952ce7e887c6 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:42:03.870809 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:42:03.949995 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a109f83b-bd7f-48b2-b41a-952ce7e887c6 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:42:03.983748 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531ca4ce-ca88-4463-80f0-ba0db08141f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:42:03.984533 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ca4ce-ca88-4463-80f0-ba0db08141f5 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:42:03.984814 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ca4ce-ca88-4463-80f0-ba0db08141f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:42:03.985090 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ca4ce-ca88-4463-80f0-ba0db08141f5 None admin] PATH_INFO: `/v3/domains/fcb5b717c4744d17bc9088574cc11f5c` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:42:03.996118 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531ca4ce-ca88-4463-80f0-ba0db08141f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=fcb5b717c4744d17bc9088574cc11f5c)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:42:03.997901 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531ca4ce-ca88-4463-80f0-ba0db08141f5 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:42:03.999565 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 584/1172] 10.222.0.67 () {56 vars in 1183 bytes} [Thu Jul 14 17:42:03 2022] GET /identity/v3/domains/fcb5b717c4744d17bc9088574cc11f5c => generated 267 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:42:04.005553 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbe3ec7-622e-44d7-9a9d-7b54aab6c76d None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:42:04.046691 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:42:04.103027 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbe3ec7-622e-44d7-9a9d-7b54aab6c76d None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:42:04.136486 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd26612f-5acb-439c-8361-16a47c2c27d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:42:04.137144 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd26612f-5acb-439c-8361-16a47c2c27d0 None admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:42:04.137427 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd26612f-5acb-439c-8361-16a47c2c27d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:42:04.137757 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd26612f-5acb-439c-8361-16a47c2c27d0 None admin] PATH_INFO: `/v3/projects` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:42:04.138469 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd26612f-5acb-439c-8361-16a47c2c27d0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:42:04.140369 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd26612f-5acb-439c-8361-16a47c2c27d0 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:42:04.164540 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 589/1173] 10.222.0.67 () {60 vars in 1141 bytes} [Thu Jul 14 17:42:04 2022] POST /identity/v3/projects => generated 361 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:42:06.219477 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693672c1-b855-4a41-8613-e4966daeb287 None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:42:06.220040 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693672c1-b855-4a41-8613-e4966daeb287 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:42:06.220040 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693672c1-b855-4a41-8613-e4966daeb287 None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:42:06.221382 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 585/1174] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:42:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:42:06.226846 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a2b863-86ab-4e3d-bd2e-83e0c23fadf2 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:42:06.227256 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a2b863-86ab-4e3d-bd2e-83e0c23fadf2 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:42:06.227390 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a2b863-86ab-4e3d-bd2e-83e0c23fadf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:42:06.243781 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-36a2b863-86ab-4e3d-bd2e-83e0c23fadf2 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:42:06.245003 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-36a2b863-86ab-4e3d-bd2e-83e0c23fadf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:42:06.309904 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 590/1175] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:42:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 17:42:06.334844 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693672c1-b855-4a41-8613-e4966daeb287 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:42:06.415676 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:42:06.438102 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693672c1-b855-4a41-8613-e4966daeb287 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:42:06.475966 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9df7a5-e369-447b-b286-d89c9fb96f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:42:06.476756 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9df7a5-e369-447b-b286-d89c9fb96f18 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:42:06.477042 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9df7a5-e369-447b-b286-d89c9fb96f18 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:42:06.477319 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9df7a5-e369-447b-b286-d89c9fb96f18 None admin] PATH_INFO: `/v3/domains/fcb5b717c4744d17bc9088574cc11f5c` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:42:06.479286 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9df7a5-e369-447b-b286-d89c9fb96f18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=fcb5b717c4744d17bc9088574cc11f5c)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:42:06.480769 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9df7a5-e369-447b-b286-d89c9fb96f18 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:42:06.482515 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 586/1176] 10.222.0.67 () {56 vars in 1183 bytes} [Thu Jul 14 17:42:06 2022] GET /identity/v3/domains/fcb5b717c4744d17bc9088574cc11f5c => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:42:06.488487 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a2b863-86ab-4e3d-bd2e-83e0c23fadf2 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:42:06.513056 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:42:06.593158 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a2b863-86ab-4e3d-bd2e-83e0c23fadf2 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:42:06.628827 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7e9685-4c3c-4190-8cc8-2fad04d20831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:42:06.629503 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7e9685-4c3c-4190-8cc8-2fad04d20831 None admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:42:06.629808 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7e9685-4c3c-4190-8cc8-2fad04d20831 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:42:06.630080 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7e9685-4c3c-4190-8cc8-2fad04d20831 None admin] PATH_INFO: `/v3/users` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:42:06.630794 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7e9685-4c3c-4190-8cc8-2fad04d20831 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:42:06.632220 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7e9685-4c3c-4190-8cc8-2fad04d20831 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:42:06.652993 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 591/1177] 10.222.0.67 () {60 vars in 1132 bytes} [Thu Jul 14 17:42:06 2022] POST /identity/v3/users => generated 311 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:42:08.741584 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ecca87-2338-4b87-a1af-b46c32b4e5e0 None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:42:08.742086 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ecca87-2338-4b87-a1af-b46c32b4e5e0 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:42:08.742086 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ecca87-2338-4b87-a1af-b46c32b4e5e0 None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:42:08.743467 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 587/1178] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:42:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 17:42:08.749263 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c1e67c-00c2-4f30-b99d-bffc2d04c6f6 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:42:08.749967 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c1e67c-00c2-4f30-b99d-bffc2d04c6f6 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:42:08.749967 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c1e67c-00c2-4f30-b99d-bffc2d04c6f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:42:08.767745 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-07c1e67c-00c2-4f30-b99d-bffc2d04c6f6 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:42:08.769101 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-07c1e67c-00c2-4f30-b99d-bffc2d04c6f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:42:08.839692 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 592/1179] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:42:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 17:42:08.862978 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ecca87-2338-4b87-a1af-b46c32b4e5e0 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:42:08.961134 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ecca87-2338-4b87-a1af-b46c32b4e5e0 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:42:08.994152 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b704d1-0c12-4fd2-8df0-2687c9497670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:42:08.995430 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b704d1-0c12-4fd2-8df0-2687c9497670 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:42:08.995712 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b704d1-0c12-4fd2-8df0-2687c9497670 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:42:08.995986 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b704d1-0c12-4fd2-8df0-2687c9497670 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:42:09.006037 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b704d1-0c12-4fd2-8df0-2687c9497670 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:42:09.013698 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-b9b704d1-0c12-4fd2-8df0-2687c9497670 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 17:42:09.013698 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:42:09.013698 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:42:09.013698 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:42:09.013698 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:42:09.013698 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:42:09.013698 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:42:09.013698 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:42:09.013698 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:42:09.013698 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:42:09.013698 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:42:09.013698 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:42:09.013698 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:42:09.013698 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:42:09.013698 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:42:09.013698 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:42:09.014803 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:42:09.014803 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:42:09.014803 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:42:09.014803 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:42:09.014803 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:42:09.014803 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:42:09.014803 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:42:09.014803 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:42:09.014803 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:42:09.014803 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:42:09.014803 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:42:09.014803 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:42:09.014803 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:42:09.014803 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:42:09.014803 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:42:09.014803 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:42:09.016027 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:42:09.016027 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:42:09.016027 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:42:09.016027 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:42:09.016027 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:42:09.016027 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:42:09.016027 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:42:09.016027 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:42:09.016027 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:42:09.016027 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:42:09.016027 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 17:42:09.016027 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:42:09.016027 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 588/1180] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 14 17:42:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:42:09.020914 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c1e67c-00c2-4f30-b99d-bffc2d04c6f6 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:42:09.030896 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:42:09.118890 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c1e67c-00c2-4f30-b99d-bffc2d04c6f6 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:42:09.151774 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a911a03f-9634-46bc-9bf4-4e12c56e068a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:42:09.152444 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a911a03f-9634-46bc-9bf4-4e12c56e068a None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:42:09.152721 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a911a03f-9634-46bc-9bf4-4e12c56e068a None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:42:09.152999 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a911a03f-9634-46bc-9bf4-4e12c56e068a None admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:42:09.153761 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a911a03f-9634-46bc-9bf4-4e12c56e068a None admin] RBAC: Adding query filter params (name=admin) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:42:09.154065 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a911a03f-9634-46bc-9bf4-4e12c56e068a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:42:09.155423 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a911a03f-9634-46bc-9bf4-4e12c56e068a None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:42:09.163248 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 593/1181] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 14 17:42:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:42:09.169624 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b704d1-0c12-4fd2-8df0-2687c9497670 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:42:09.180780 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:42:09.267547 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b704d1-0c12-4fd2-8df0-2687c9497670 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:42:09.300156 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260a272c-be6a-4c17-a6a0-07d93c30389c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:42:09.301017 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a272c-be6a-4c17-a6a0-07d93c30389c None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:42:09.301296 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a272c-be6a-4c17-a6a0-07d93c30389c None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:42:09.301591 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a272c-be6a-4c17-a6a0-07d93c30389c None admin] PATH_INFO: `/v3/users/39f7371fea8b421f9eaba57148faeef9` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:42:09.314348 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260a272c-be6a-4c17-a6a0-07d93c30389c None admin] RBAC: Authorizing `identity:get_user(user_id=39f7371fea8b421f9eaba57148faeef9)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:42:09.315780 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260a272c-be6a-4c17-a6a0-07d93c30389c None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:42:09.317420 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 589/1182] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 14 17:42:09 2022] GET /identity/v3/users/39f7371fea8b421f9eaba57148faeef9 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:42:09.323314 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a911a03f-9634-46bc-9bf4-4e12c56e068a None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:42:09.394523 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:42:09.428110 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a911a03f-9634-46bc-9bf4-4e12c56e068a None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:42:09.460711 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79869f6-1745-40c5-8d18-7267d4226991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:42:09.461371 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79869f6-1745-40c5-8d18-7267d4226991 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:42:09.461674 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79869f6-1745-40c5-8d18-7267d4226991 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:42:09.461950 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79869f6-1745-40c5-8d18-7267d4226991 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:42:09.527110 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79869f6-1745-40c5-8d18-7267d4226991 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:42:09.528468 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79869f6-1745-40c5-8d18-7267d4226991 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:42:09.592072 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:42:09.624098 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 594/1183] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 14 17:42:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 17:42:09.630019 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260a272c-be6a-4c17-a6a0-07d93c30389c None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:42:09.693464 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:42:09.728427 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260a272c-be6a-4c17-a6a0-07d93c30389c None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:42:09.763487 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be61a2c1-841d-4b19-ad14-a9dcb8948f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:42:09.764366 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be61a2c1-841d-4b19-ad14-a9dcb8948f8f None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:42:09.764645 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be61a2c1-841d-4b19-ad14-a9dcb8948f8f None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:42:09.764920 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be61a2c1-841d-4b19-ad14-a9dcb8948f8f None admin] PATH_INFO: `/v3/projects/d6a4414d3a864cfa9cf51623ae707e3d` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:42:09.766219 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be61a2c1-841d-4b19-ad14-a9dcb8948f8f None admin] RBAC: Authorizing `identity:get_project(project_id=d6a4414d3a864cfa9cf51623ae707e3d)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:42:09.767712 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be61a2c1-841d-4b19-ad14-a9dcb8948f8f None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:42:09.769542 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 590/1184] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 14 17:42:09 2022] GET /identity/v3/projects/d6a4414d3a864cfa9cf51623ae707e3d => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:42:09.778078 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79869f6-1745-40c5-8d18-7267d4226991 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:42:09.875353 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79869f6-1745-40c5-8d18-7267d4226991 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:42:09.908707 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e76733-00b7-418f-9e04-0ca59666ab3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:42:09.909361 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e76733-00b7-418f-9e04-0ca59666ab3d None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:42:09.909675 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e76733-00b7-418f-9e04-0ca59666ab3d None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:42:09.909954 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e76733-00b7-418f-9e04-0ca59666ab3d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:42:09.910791 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e76733-00b7-418f-9e04-0ca59666ab3d None admin] RBAC: Adding query filter params (role.id=4651a1cc7b4d4ab7a7a9ca1e77e58e71, scope.project.id=d6a4414d3a864cfa9cf51623ae707e3d, user.id=39f7371fea8b421f9eaba57148faeef9) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:42:09.911102 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e76733-00b7-418f-9e04-0ca59666ab3d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:42:09.912531 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e76733-00b7-418f-9e04-0ca59666ab3d None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:42:09.917956 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 595/1185] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 14 17:42:09 2022] GET /identity/v3/role_assignments?user.id=39f7371fea8b421f9eaba57148faeef9&scope.project.id=d6a4414d3a864cfa9cf51623ae707e3d&role.id=4651a1cc7b4d4ab7a7a9ca1e77e58e71 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:42:11.951519 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a00cb19-3e01-40b3-9f7e-a2b70b9bcab7 None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:42:11.952085 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a00cb19-3e01-40b3-9f7e-a2b70b9bcab7 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:42:11.952085 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a00cb19-3e01-40b3-9f7e-a2b70b9bcab7 None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:42:11.953407 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 591/1186] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:42:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 17:42:11.959261 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a4b5c1-7667-45c1-bddb-4cdb0ef055ed None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:42:11.959701 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a4b5c1-7667-45c1-bddb-4cdb0ef055ed None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:42:11.959817 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a4b5c1-7667-45c1-bddb-4cdb0ef055ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:42:11.976898 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-71a4b5c1-7667-45c1-bddb-4cdb0ef055ed None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:42:11.978111 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-71a4b5c1-7667-45c1-bddb-4cdb0ef055ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:42:12.004537 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:42:12.045281 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 596/1187] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:42:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 17:42:12.074640 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a00cb19-3e01-40b3-9f7e-a2b70b9bcab7 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:42:12.178728 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a00cb19-3e01-40b3-9f7e-a2b70b9bcab7 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:42:12.213749 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0299e730-aeed-4ed0-aa67-5c538e07deae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:42:12.214375 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0299e730-aeed-4ed0-aa67-5c538e07deae None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:42:12.214654 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0299e730-aeed-4ed0-aa67-5c538e07deae None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:42:12.214926 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0299e730-aeed-4ed0-aa67-5c538e07deae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:42:12.216776 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:42:12.225930 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0299e730-aeed-4ed0-aa67-5c538e07deae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:42:12.233598 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-0299e730-aeed-4ed0-aa67-5c538e07deae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 17:42:12.233598 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:42:12.233598 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:42:12.233598 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:42:12.233598 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:42:12.233598 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:42:12.233598 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:42:12.233598 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:42:12.233598 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:42:12.233598 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:42:12.233598 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:42:12.233598 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:42:12.233598 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:42:12.233598 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:42:12.233598 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:42:12.233598 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:42:12.235169 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:42:12.235169 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:42:12.235169 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:42:12.235169 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:42:12.235169 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:42:12.235169 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:42:12.235169 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:42:12.235169 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:42:12.235169 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:42:12.235169 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:42:12.235169 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:42:12.235169 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:42:12.235169 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:42:12.235169 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:42:12.235169 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:42:12.235169 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:42:12.236301 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:42:12.236301 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:42:12.236301 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:42:12.236301 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:42:12.236301 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:42:12.236301 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:42:12.236301 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:42:12.236301 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:42:12.236301 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:42:12.236301 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:42:12.236301 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 17:42:12.236301 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:42:12.237691 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 592/1188] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 14 17:42:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:42:12.240959 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a4b5c1-7667-45c1-bddb-4cdb0ef055ed None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:42:12.343918 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a4b5c1-7667-45c1-bddb-4cdb0ef055ed None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:42:12.382410 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf51a15-ccb5-4207-822c-e1918e739128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:42:12.383077 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf51a15-ccb5-4207-822c-e1918e739128 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:42:12.383361 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf51a15-ccb5-4207-822c-e1918e739128 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:42:12.383637 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf51a15-ccb5-4207-822c-e1918e739128 None admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:42:12.384381 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf51a15-ccb5-4207-822c-e1918e739128 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:42:12.384687 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf51a15-ccb5-4207-822c-e1918e739128 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:42:12.386732 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf51a15-ccb5-4207-822c-e1918e739128 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:42:12.395072 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 597/1189] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 14 17:42:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:42:12.400996 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0299e730-aeed-4ed0-aa67-5c538e07deae None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:42:12.501491 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0299e730-aeed-4ed0-aa67-5c538e07deae None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:42:12.534747 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600a5542-0aa5-4942-9107-48bd7ad509bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:42:12.535616 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600a5542-0aa5-4942-9107-48bd7ad509bb None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:42:12.535900 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600a5542-0aa5-4942-9107-48bd7ad509bb None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:42:12.536174 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600a5542-0aa5-4942-9107-48bd7ad509bb None admin] PATH_INFO: `/v3/users/39f7371fea8b421f9eaba57148faeef9` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:42:12.537354 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600a5542-0aa5-4942-9107-48bd7ad509bb None admin] RBAC: Authorizing `identity:get_user(user_id=39f7371fea8b421f9eaba57148faeef9)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:42:12.538824 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600a5542-0aa5-4942-9107-48bd7ad509bb None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:42:12.540457 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 593/1190] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 14 17:42:12 2022] GET /identity/v3/users/39f7371fea8b421f9eaba57148faeef9 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:42:12.546910 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf51a15-ccb5-4207-822c-e1918e739128 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:42:12.575435 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:42:12.648793 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf51a15-ccb5-4207-822c-e1918e739128 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:42:12.683283 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a1d261-0a18-4d41-b049-c3a34ad1c9f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:42:12.684170 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a1d261-0a18-4d41-b049-c3a34ad1c9f9 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:42:12.684456 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a1d261-0a18-4d41-b049-c3a34ad1c9f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:42:12.684767 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a1d261-0a18-4d41-b049-c3a34ad1c9f9 None admin] PATH_INFO: `/v3/projects/d6a4414d3a864cfa9cf51623ae707e3d` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:42:12.686002 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a1d261-0a18-4d41-b049-c3a34ad1c9f9 None admin] RBAC: Authorizing `identity:get_project(project_id=d6a4414d3a864cfa9cf51623ae707e3d)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:42:12.687464 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a1d261-0a18-4d41-b049-c3a34ad1c9f9 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:42:12.689214 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 598/1191] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 14 17:42:12 2022] GET /identity/v3/projects/d6a4414d3a864cfa9cf51623ae707e3d => generated 361 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:42:12.695777 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600a5542-0aa5-4942-9107-48bd7ad509bb None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:42:12.762255 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:42:12.805419 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600a5542-0aa5-4942-9107-48bd7ad509bb None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:42:12.842771 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fea7f8-6f65-4a30-96c6-e4406d751928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:42:12.843656 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fea7f8-6f65-4a30-96c6-e4406d751928 None admin] REQUEST_METHOD: `PUT` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:42:12.843934 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fea7f8-6f65-4a30-96c6-e4406d751928 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:42:12.844202 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fea7f8-6f65-4a30-96c6-e4406d751928 None admin] PATH_INFO: `/v3/projects/d6a4414d3a864cfa9cf51623ae707e3d/users/39f7371fea8b421f9eaba57148faeef9/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:42:12.846201 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fea7f8-6f65-4a30-96c6-e4406d751928 None admin] RBAC: Authorizing `identity:create_grant(project_id=d6a4414d3a864cfa9cf51623ae707e3d, user_id=39f7371fea8b421f9eaba57148faeef9, role_id=4651a1cc7b4d4ab7a7a9ca1e77e58e71)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:42:12.847620 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fea7f8-6f65-4a30-96c6-e4406d751928 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:42:12.862315 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 594/1192] 10.222.0.67 () {58 vars in 1439 bytes} [Thu Jul 14 17:42:12 2022] PUT /identity/v3/projects/d6a4414d3a864cfa9cf51623ae707e3d/users/39f7371fea8b421f9eaba57148faeef9/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:42:14.886039 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08359b5-5156-4c9b-9c86-9d7c669e1fa5 None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:42:14.886624 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08359b5-5156-4c9b-9c86-9d7c669e1fa5 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:42:14.886624 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08359b5-5156-4c9b-9c86-9d7c669e1fa5 None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:42:14.887937 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 599/1193] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:42:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:42:14.893400 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29bda58-3c69-4ac9-8609-882c309901ba None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:42:14.893925 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29bda58-3c69-4ac9-8609-882c309901ba None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:42:14.894046 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29bda58-3c69-4ac9-8609-882c309901ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:42:14.910779 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-a29bda58-3c69-4ac9-8609-882c309901ba None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:42:14.911981 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-a29bda58-3c69-4ac9-8609-882c309901ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:42:14.981319 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 595/1194] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:42:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 17:42:15.006834 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08359b5-5156-4c9b-9c86-9d7c669e1fa5 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:42:15.107874 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:42:15.116493 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08359b5-5156-4c9b-9c86-9d7c669e1fa5 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:42:15.152921 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d65650-36d4-4f85-8a1f-dd55f691a089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:42:15.153762 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d65650-36d4-4f85-8a1f-dd55f691a089 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:42:15.154055 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d65650-36d4-4f85-8a1f-dd55f691a089 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:42:15.154331 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d65650-36d4-4f85-8a1f-dd55f691a089 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:42:15.165282 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d65650-36d4-4f85-8a1f-dd55f691a089 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:42:15.172898 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-b6d65650-36d4-4f85-8a1f-dd55f691a089 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 17:42:15.172898 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:42:15.172898 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:42:15.172898 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:42:15.172898 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:42:15.172898 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:42:15.172898 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:42:15.172898 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:42:15.172898 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:42:15.172898 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:42:15.172898 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:42:15.172898 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:42:15.172898 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:42:15.172898 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:42:15.172898 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:42:15.172898 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:42:15.174113 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:42:15.174113 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:42:15.174113 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:42:15.174113 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:42:15.174113 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:42:15.174113 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:42:15.174113 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:42:15.174113 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:42:15.174113 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:42:15.174113 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:42:15.174113 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:42:15.174113 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:42:15.174113 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:42:15.174113 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:42:15.174113 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:42:15.174113 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:42:15.175169 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:42:15.175169 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:42:15.175169 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:42:15.175169 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:42:15.175169 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:42:15.175169 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:42:15.175169 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:42:15.175169 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:42:15.175169 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:42:15.175169 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:42:15.175169 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 17:42:15.175169 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:42:15.175169 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 600/1195] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 14 17:42:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:42:15.180397 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29bda58-3c69-4ac9-8609-882c309901ba None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:42:15.235511 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:42:15.284998 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29bda58-3c69-4ac9-8609-882c309901ba None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:42:15.318450 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3162ae68-d570-4a24-b675-bdb2ced2475c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:42:15.319123 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3162ae68-d570-4a24-b675-bdb2ced2475c None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:42:15.319406 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3162ae68-d570-4a24-b675-bdb2ced2475c None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:42:15.319682 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3162ae68-d570-4a24-b675-bdb2ced2475c None admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:42:15.320462 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3162ae68-d570-4a24-b675-bdb2ced2475c None admin] RBAC: Adding query filter params (name=admin) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:42:15.320768 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3162ae68-d570-4a24-b675-bdb2ced2475c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:42:15.322166 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3162ae68-d570-4a24-b675-bdb2ced2475c None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:42:15.330972 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 596/1196] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 14 17:42:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:42:15.336768 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d65650-36d4-4f85-8a1f-dd55f691a089 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:42:15.436279 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d65650-36d4-4f85-8a1f-dd55f691a089 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:42:15.470866 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19141d83-3d2e-4bf6-b8e1-4f56aed7031f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:42:15.471738 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19141d83-3d2e-4bf6-b8e1-4f56aed7031f None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:42:15.472017 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19141d83-3d2e-4bf6-b8e1-4f56aed7031f None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:42:15.472290 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19141d83-3d2e-4bf6-b8e1-4f56aed7031f None admin] PATH_INFO: `/v3/users/39f7371fea8b421f9eaba57148faeef9` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:42:15.473489 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19141d83-3d2e-4bf6-b8e1-4f56aed7031f None admin] RBAC: Authorizing `identity:get_user(user_id=39f7371fea8b421f9eaba57148faeef9)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:42:15.474945 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19141d83-3d2e-4bf6-b8e1-4f56aed7031f None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:42:15.476602 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 601/1197] 10.222.0.67 () {56 vars in 1177 bytes} [Thu Jul 14 17:42:15 2022] GET /identity/v3/users/39f7371fea8b421f9eaba57148faeef9 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:42:15.483389 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3162ae68-d570-4a24-b675-bdb2ced2475c None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:42:15.585131 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3162ae68-d570-4a24-b675-bdb2ced2475c None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:42:15.599799 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:42:15.621162 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ea1742-c47a-42ed-86c0-4f3d37b4a46a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:42:15.621851 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea1742-c47a-42ed-86c0-4f3d37b4a46a None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:42:15.622137 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea1742-c47a-42ed-86c0-4f3d37b4a46a None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:42:15.622413 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea1742-c47a-42ed-86c0-4f3d37b4a46a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:42:15.695123 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ea1742-c47a-42ed-86c0-4f3d37b4a46a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:42:15.696587 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ea1742-c47a-42ed-86c0-4f3d37b4a46a None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:42:15.807951 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 597/1198] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 14 17:42:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 17:42:15.814244 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19141d83-3d2e-4bf6-b8e1-4f56aed7031f None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:42:15.840932 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:42:15.927700 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19141d83-3d2e-4bf6-b8e1-4f56aed7031f None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:42:15.962632 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453675ed-4cd1-4844-b205-df439457c9fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:42:15.964066 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453675ed-4cd1-4844-b205-df439457c9fe None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:42:15.964355 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453675ed-4cd1-4844-b205-df439457c9fe None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:42:15.964629 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453675ed-4cd1-4844-b205-df439457c9fe None admin] PATH_INFO: `/v3/projects/d6a4414d3a864cfa9cf51623ae707e3d` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:42:15.965871 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453675ed-4cd1-4844-b205-df439457c9fe None admin] RBAC: Authorizing `identity:get_project(project_id=d6a4414d3a864cfa9cf51623ae707e3d)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:42:15.967315 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453675ed-4cd1-4844-b205-df439457c9fe None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:42:15.969039 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 602/1199] 10.222.0.67 () {56 vars in 1186 bytes} [Thu Jul 14 17:42:15 2022] GET /identity/v3/projects/d6a4414d3a864cfa9cf51623ae707e3d => generated 361 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:42:15.975460 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ea1742-c47a-42ed-86c0-4f3d37b4a46a None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:42:15.991023 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:42:16.086526 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ea1742-c47a-42ed-86c0-4f3d37b4a46a None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:42:16.121375 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f92111d-8678-4751-b2e5-d500b3e7c425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:42:16.122047 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f92111d-8678-4751-b2e5-d500b3e7c425 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:42:16.122327 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f92111d-8678-4751-b2e5-d500b3e7c425 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:42:16.122600 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f92111d-8678-4751-b2e5-d500b3e7c425 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:42:16.123680 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f92111d-8678-4751-b2e5-d500b3e7c425 None admin] RBAC: Adding query filter params (role.id=4651a1cc7b4d4ab7a7a9ca1e77e58e71, scope.project.id=d6a4414d3a864cfa9cf51623ae707e3d, user.id=39f7371fea8b421f9eaba57148faeef9) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:42:16.123987 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f92111d-8678-4751-b2e5-d500b3e7c425 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:42:16.125426 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f92111d-8678-4751-b2e5-d500b3e7c425 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:42:16.131471 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 598/1200] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 14 17:42:15 2022] GET /identity/v3/role_assignments?user.id=39f7371fea8b421f9eaba57148faeef9&scope.project.id=d6a4414d3a864cfa9cf51623ae707e3d&role.id=4651a1cc7b4d4ab7a7a9ca1e77e58e71 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:42:25.958441 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=55 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:42:26.129178 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=61 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:43:13.235492 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23956e73-f7a4-4e59-b85f-464c673e4e37 None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:13.236137 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23956e73-f7a4-4e59-b85f-464c673e4e37 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:13.236238 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23956e73-f7a4-4e59-b85f-464c673e4e37 None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:13.237929 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 603/1201] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:43:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 17:43:13.244376 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663b191-ea7d-4753-a329-6ab54dcbf30d None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:13.245410 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663b191-ea7d-4753-a329-6ab54dcbf30d None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:13.245889 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663b191-ea7d-4753-a329-6ab54dcbf30d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:13.270266 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-6663b191-ea7d-4753-a329-6ab54dcbf30d None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:43:13.271568 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-6663b191-ea7d-4753-a329-6ab54dcbf30d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:43:13.395711 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 599/1202] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:43:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 17:43:13.423716 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23956e73-f7a4-4e59-b85f-464c673e4e37 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:43:13.615875 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23956e73-f7a4-4e59-b85f-464c673e4e37 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:43:13.665379 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43a95f2-5198-4724-a52a-e807421096af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:43:13.666256 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43a95f2-5198-4724-a52a-e807421096af None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:13.666591 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43a95f2-5198-4724-a52a-e807421096af None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:13.666856 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43a95f2-5198-4724-a52a-e807421096af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:13.689114 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43a95f2-5198-4724-a52a-e807421096af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:43:13.690654 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43a95f2-5198-4724-a52a-e807421096af None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:43:13.720290 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-b43a95f2-5198-4724-a52a-e807421096af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:43:13.720290 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:43:13.720290 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:43:13.720290 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:43:13.720290 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:43:13.720290 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:43:13.720290 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:43:13.720290 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:43:13.720290 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:43:13.720290 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:43:13.720290 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:43:13.720290 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:43:13.720290 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:43:13.720290 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:43:13.720290 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:43:13.721860 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:43:13.721860 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:43:13.721860 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:43:13.721860 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:43:13.721860 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:43:13.721860 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:43:13.721860 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:43:13.721860 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:43:13.721860 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:43:13.721860 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:43:13.721860 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:43:13.721860 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:43:13.721860 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:43:13.721860 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:43:13.721860 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:43:13.721860 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:43:13.721860 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:43:13.722873 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:43:13.722873 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:43:13.722873 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:43:13.722873 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:43:13.727032 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 604/1203] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:43:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:43:13.728025 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6663b191-ea7d-4753-a329-6ab54dcbf30d None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:43:13.886450 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6663b191-ea7d-4753-a329-6ab54dcbf30d None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:43:13.938246 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:43:13.951616 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0a01e6-ce6f-4fac-baf7-d4d254ac647a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:43:13.952408 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0a01e6-ce6f-4fac-baf7-d4d254ac647a None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:13.952706 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0a01e6-ce6f-4fac-baf7-d4d254ac647a None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:13.952997 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0a01e6-ce6f-4fac-baf7-d4d254ac647a None admin] PATH_INFO: `/v3/domains` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:13.953843 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0a01e6-ce6f-4fac-baf7-d4d254ac647a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:43:13.954172 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0a01e6-ce6f-4fac-baf7-d4d254ac647a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:43:13.955743 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0a01e6-ce6f-4fac-baf7-d4d254ac647a None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:43:13.973025 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 600/1204] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 14 17:43:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:43:13.979431 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43a95f2-5198-4724-a52a-e807421096af None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:43:14.052494 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:43:14.137404 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43a95f2-5198-4724-a52a-e807421096af None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:43:14.191427 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdf5672-f449-4d50-a71d-6c1dbf8db32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:43:14.192224 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf5672-f449-4d50-a71d-6c1dbf8db32a None admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:14.192544 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf5672-f449-4d50-a71d-6c1dbf8db32a None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:14.192890 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf5672-f449-4d50-a71d-6c1dbf8db32a None admin] PATH_INFO: `/v3/users` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:14.197290 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdf5672-f449-4d50-a71d-6c1dbf8db32a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:43:14.197290 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdf5672-f449-4d50-a71d-6c1dbf8db32a None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:43:14.226514 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 605/1205] 10.222.0.67 () {60 vars in 1132 bytes} [Thu Jul 14 17:43:13 2022] POST /identity/v3/users => generated 251 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:43:16.616737 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30625269-c05c-4c61-a0f5-5ce5ea9bda26 None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:16.617296 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30625269-c05c-4c61-a0f5-5ce5ea9bda26 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:16.617296 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30625269-c05c-4c61-a0f5-5ce5ea9bda26 None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:16.618962 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 601/1206] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:43:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:43:16.625167 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf6f6c-9868-49e8-9051-946b5326f917 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:16.625754 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf6f6c-9868-49e8-9051-946b5326f917 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:16.625754 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf6f6c-9868-49e8-9051-946b5326f917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:16.644163 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-f9bf6f6c-9868-49e8-9051-946b5326f917 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:43:16.645381 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-f9bf6f6c-9868-49e8-9051-946b5326f917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:43:16.730624 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 606/1207] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:43:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 17:43:16.754754 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30625269-c05c-4c61-a0f5-5ce5ea9bda26 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:43:16.897934 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30625269-c05c-4c61-a0f5-5ce5ea9bda26 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:43:16.941469 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d824c7f2-c65d-489c-b042-3351c0e7246c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:43:16.942320 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d824c7f2-c65d-489c-b042-3351c0e7246c None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:16.942603 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d824c7f2-c65d-489c-b042-3351c0e7246c None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:16.942864 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d824c7f2-c65d-489c-b042-3351c0e7246c None admin] PATH_INFO: `/v3/roles/service` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:16.956775 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d824c7f2-c65d-489c-b042-3351c0e7246c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:43:16.968836 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-d824c7f2-c65d-489c-b042-3351c0e7246c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 17:43:16.968836 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:43:16.968836 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:43:16.968836 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:43:16.968836 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:43:16.968836 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:43:16.968836 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:43:16.968836 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:43:16.968836 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:43:16.968836 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:43:16.968836 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:43:16.968836 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:43:16.968836 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:43:16.968836 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:43:16.968836 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:43:16.968836 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:43:16.970158 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:43:16.970158 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:43:16.970158 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:43:16.970158 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:43:16.970158 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:43:16.970158 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:43:16.970158 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:43:16.970158 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:43:16.970158 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:43:16.970158 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:43:16.970158 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:43:16.970158 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:43:16.970158 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:43:16.970158 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:43:16.970158 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:43:16.970158 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:43:16.971347 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:43:16.971347 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:43:16.971347 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:43:16.971347 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:43:16.971347 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:43:16.971347 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:43:16.971347 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:43:16.971347 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:43:16.971347 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:43:16.971347 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:43:16.971347 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 17:43:16.971347 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:43:16.971347 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 602/1208] 10.222.0.67 () {56 vars in 1102 bytes} [Thu Jul 14 17:43:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:43:16.976577 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bf6f6c-9868-49e8-9051-946b5326f917 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:43:17.020556 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:43:17.094913 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bf6f6c-9868-49e8-9051-946b5326f917 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:43:17.139883 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b0a0ed-0d4b-432c-973f-5753dca76684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:43:17.140577 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b0a0ed-0d4b-432c-973f-5753dca76684 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:17.140862 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b0a0ed-0d4b-432c-973f-5753dca76684 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:17.141144 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b0a0ed-0d4b-432c-973f-5753dca76684 None admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:17.143459 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b0a0ed-0d4b-432c-973f-5753dca76684 None admin] RBAC: Adding query filter params (name=service) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:43:17.143796 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b0a0ed-0d4b-432c-973f-5753dca76684 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:43:17.145187 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b0a0ed-0d4b-432c-973f-5753dca76684 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:43:17.155227 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 607/1209] 10.222.0.67 () {56 vars in 1103 bytes} [Thu Jul 14 17:43:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:43:17.161727 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d824c7f2-c65d-489c-b042-3351c0e7246c None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:43:17.226681 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:43:17.288557 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d824c7f2-c65d-489c-b042-3351c0e7246c None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:43:17.325679 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eddb729-9f89-4540-af2f-8e413b1dc3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:43:17.327163 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eddb729-9f89-4540-af2f-8e413b1dc3ee None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:17.327465 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eddb729-9f89-4540-af2f-8e413b1dc3ee None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:17.327823 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eddb729-9f89-4540-af2f-8e413b1dc3ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:17.342101 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eddb729-9f89-4540-af2f-8e413b1dc3ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:43:17.343873 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eddb729-9f89-4540-af2f-8e413b1dc3ee None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:43:17.363464 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-9eddb729-9f89-4540-af2f-8e413b1dc3ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:43:17.363464 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:43:17.363464 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:43:17.363464 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:43:17.363464 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:43:17.363464 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:43:17.363464 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:43:17.363464 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:43:17.363464 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:43:17.363464 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:43:17.363464 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:43:17.363464 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:43:17.363464 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:43:17.363464 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:43:17.363464 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:43:17.364778 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:43:17.364778 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:43:17.364778 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:43:17.364778 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:43:17.364778 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:43:17.364778 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:43:17.364778 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:43:17.364778 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:43:17.364778 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:43:17.364778 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:43:17.364778 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:43:17.364778 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:43:17.364778 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:43:17.364778 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:43:17.364778 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:43:17.364778 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:43:17.364778 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:43:17.365902 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:43:17.365902 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:43:17.365902 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:43:17.365902 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:43:17.365902 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 603/1210] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:43:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:43:17.370592 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b0a0ed-0d4b-432c-973f-5753dca76684 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:43:17.490113 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:43:17.493970 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b0a0ed-0d4b-432c-973f-5753dca76684 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:43:17.539353 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d612e20-3faa-4ea8-98e7-df6f1a99ced6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:43:17.539561 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d612e20-3faa-4ea8-98e7-df6f1a99ced6 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:17.539859 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d612e20-3faa-4ea8-98e7-df6f1a99ced6 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:17.540241 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d612e20-3faa-4ea8-98e7-df6f1a99ced6 None admin] PATH_INFO: `/v3/domains` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:17.541253 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d612e20-3faa-4ea8-98e7-df6f1a99ced6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:43:17.541592 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d612e20-3faa-4ea8-98e7-df6f1a99ced6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:43:17.543528 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d612e20-3faa-4ea8-98e7-df6f1a99ced6 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:43:17.564440 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 608/1211] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 14 17:43:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:43:17.565935 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eddb729-9f89-4540-af2f-8e413b1dc3ee None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:43:17.687702 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eddb729-9f89-4540-af2f-8e413b1dc3ee None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:43:17.690933 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:43:17.728277 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeb86db-9069-423d-b2ba-63c55258f4dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:43:17.729127 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb86db-9069-423d-b2ba-63c55258f4dd None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:17.729678 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb86db-9069-423d-b2ba-63c55258f4dd None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:17.729892 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb86db-9069-423d-b2ba-63c55258f4dd None admin] PATH_INFO: `/v3/users/placement` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:17.738847 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeb86db-9069-423d-b2ba-63c55258f4dd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:43:17.740459 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeb86db-9069-423d-b2ba-63c55258f4dd None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:43:17.757983 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-1eeb86db-9069-423d-b2ba-63c55258f4dd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 14 17:43:17.757983 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:43:17.757983 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:43:17.757983 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:43:17.757983 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:43:17.757983 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:43:17.757983 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:43:17.757983 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:43:17.757983 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:43:17.757983 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:43:17.757983 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:43:17.757983 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:43:17.757983 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 17:43:17.757983 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 17:43:17.757983 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 17:43:17.757983 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 17:43:17.759601 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:43:17.759601 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:43:17.759601 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 17:43:17.759601 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:43:17.759601 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 17:43:17.759601 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:43:17.759601 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:43:17.759601 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:43:17.759601 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:43:17.759601 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:43:17.759601 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:43:17.759601 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:43:17.759601 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:43:17.759601 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:43:17.759601 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:43:17.759601 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:43:17.759601 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:43:17.759601 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:43:17.760889 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:43:17.760889 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:43:17.760889 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 17:43:17.760889 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 17:43:17.760889 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 17:43:17.760889 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 17:43:17.760889 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 17:43:17.760889 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 17:43:17.760889 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 14 17:43:17.760889 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:43:17.765378 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 604/1212] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:43:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:43:17.766517 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d612e20-3faa-4ea8-98e7-df6f1a99ced6 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:43:17.884145 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d612e20-3faa-4ea8-98e7-df6f1a99ced6 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:43:17.921184 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448bcf40-fd66-4db9-94c0-8e5a01fab2b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:43:17.921904 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448bcf40-fd66-4db9-94c0-8e5a01fab2b2 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:17.922187 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448bcf40-fd66-4db9-94c0-8e5a01fab2b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:17.922457 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448bcf40-fd66-4db9-94c0-8e5a01fab2b2 None admin] PATH_INFO: `/v3/users` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:17.923301 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448bcf40-fd66-4db9-94c0-8e5a01fab2b2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:43:17.923611 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448bcf40-fd66-4db9-94c0-8e5a01fab2b2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:43:17.925051 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448bcf40-fd66-4db9-94c0-8e5a01fab2b2 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:43:17.945394 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 609/1213] 10.222.0.67 () {56 vars in 1143 bytes} [Thu Jul 14 17:43:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:43:17.951849 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeb86db-9069-423d-b2ba-63c55258f4dd None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:43:18.074263 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeb86db-9069-423d-b2ba-63c55258f4dd None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:43:18.118762 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed32442-b05d-4d08-9e10-c67284eb53f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:43:18.119506 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed32442-b05d-4d08-9e10-c67284eb53f6 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:18.119883 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed32442-b05d-4d08-9e10-c67284eb53f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:18.120191 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed32442-b05d-4d08-9e10-c67284eb53f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:18.161897 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:43:18.211118 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed32442-b05d-4d08-9e10-c67284eb53f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:43:18.212703 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed32442-b05d-4d08-9e10-c67284eb53f6 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:43:18.331999 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 605/1214] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 14 17:43:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 14 17:43:18.339141 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448bcf40-fd66-4db9-94c0-8e5a01fab2b2 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:43:18.362751 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:43:18.454982 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448bcf40-fd66-4db9-94c0-8e5a01fab2b2 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:43:18.496883 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc8eeab-0a8c-4e08-9967-f3625a49eb06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:43:18.497774 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc8eeab-0a8c-4e08-9967-f3625a49eb06 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:18.498082 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc8eeab-0a8c-4e08-9967-f3625a49eb06 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:18.498381 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc8eeab-0a8c-4e08-9967-f3625a49eb06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:18.511049 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc8eeab-0a8c-4e08-9967-f3625a49eb06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:43:18.513379 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc8eeab-0a8c-4e08-9967-f3625a49eb06 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:43:18.535380 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-3fc8eeab-0a8c-4e08-9967-f3625a49eb06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:43:18.535380 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:43:18.535380 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:43:18.535380 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:43:18.535380 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:43:18.535380 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:43:18.535380 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:43:18.535380 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:43:18.535380 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:43:18.535380 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:43:18.535380 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:43:18.535380 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:43:18.535380 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:43:18.535380 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:43:18.535380 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:43:18.536635 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:43:18.536635 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:43:18.536635 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:43:18.536635 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:43:18.536635 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:43:18.536635 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:43:18.536635 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:43:18.536635 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:43:18.536635 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:43:18.536635 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:43:18.536635 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:43:18.536635 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:43:18.536635 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:43:18.536635 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:43:18.536635 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:43:18.536635 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:43:18.536635 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:43:18.537874 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:43:18.537874 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:43:18.537874 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:43:18.537874 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:43:18.542701 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 610/1215] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:43:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:43:18.543270 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed32442-b05d-4d08-9e10-c67284eb53f6 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:43:18.627474 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:43:18.677786 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed32442-b05d-4d08-9e10-c67284eb53f6 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:43:18.719257 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d789c152-d636-4726-870b-7fe8f34d4a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:43:18.719257 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d789c152-d636-4726-870b-7fe8f34d4a82 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:18.719980 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d789c152-d636-4726-870b-7fe8f34d4a82 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:18.719980 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d789c152-d636-4726-870b-7fe8f34d4a82 None admin] PATH_INFO: `/v3/domains` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:18.720483 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d789c152-d636-4726-870b-7fe8f34d4a82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:43:18.720789 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d789c152-d636-4726-870b-7fe8f34d4a82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:43:18.722269 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d789c152-d636-4726-870b-7fe8f34d4a82 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:43:18.736333 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 606/1216] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 14 17:43:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:43:18.743910 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc8eeab-0a8c-4e08-9967-f3625a49eb06 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:43:18.835404 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:43:18.875556 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc8eeab-0a8c-4e08-9967-f3625a49eb06 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:43:18.913858 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdd65de-6813-423a-ad54-0e6446139a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:43:18.914667 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd65de-6813-423a-ad54-0e6446139a5a None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:18.914956 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd65de-6813-423a-ad54-0e6446139a5a None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:18.915236 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd65de-6813-423a-ad54-0e6446139a5a None admin] PATH_INFO: `/v3/projects/service` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:18.923797 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdd65de-6813-423a-ad54-0e6446139a5a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:43:18.925273 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdd65de-6813-423a-ad54-0e6446139a5a None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:43:18.945208 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-8cdd65de-6813-423a-ad54-0e6446139a5a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:43:18.945208 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:43:18.945208 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:43:18.945208 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:43:18.945208 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:43:18.945208 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:43:18.945208 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:43:18.945208 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:43:18.945208 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:43:18.945208 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:43:18.945208 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:43:18.945208 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:43:18.945208 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 17:43:18.945208 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 17:43:18.945208 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 17:43:18.947325 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 17:43:18.947325 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:43:18.947325 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:43:18.947325 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:43:18.947325 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:43:18.947325 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:43:18.947325 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:43:18.947325 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:43:18.947325 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:43:18.947325 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:43:18.947325 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:43:18.947325 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:43:18.947325 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:43:18.947325 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:43:18.947325 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:43:18.947325 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:43:18.947325 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:43:18.949136 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 17:43:18.949136 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 17:43:18.949136 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 17:43:18.949136 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 17:43:18.949136 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 17:43:18.949136 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 17:43:18.949136 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:43:18.949136 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:43:18.952438 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 611/1217] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 14 17:43:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:43:18.954109 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d789c152-d636-4726-870b-7fe8f34d4a82 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:43:19.094471 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d789c152-d636-4726-870b-7fe8f34d4a82 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:43:19.126888 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:43:19.143194 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa7ce2a-061b-4c5a-bf63-04ac15b02d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:43:19.143973 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa7ce2a-061b-4c5a-bf63-04ac15b02d08 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:19.144341 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa7ce2a-061b-4c5a-bf63-04ac15b02d08 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:19.144694 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa7ce2a-061b-4c5a-bf63-04ac15b02d08 None admin] PATH_INFO: `/v3/projects` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:19.145605 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa7ce2a-061b-4c5a-bf63-04ac15b02d08 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:43:19.145993 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa7ce2a-061b-4c5a-bf63-04ac15b02d08 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:43:19.147752 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa7ce2a-061b-4c5a-bf63-04ac15b02d08 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:43:19.164340 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 607/1218] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 14 17:43:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:43:19.171679 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdd65de-6813-423a-ad54-0e6446139a5a None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:43:19.309337 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdd65de-6813-423a-ad54-0e6446139a5a None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:43:19.343528 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:43:19.350288 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a457444f-8639-4a49-9653-7b4d51a5f9b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:43:19.350886 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a457444f-8639-4a49-9653-7b4d51a5f9b0 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:19.351284 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a457444f-8639-4a49-9653-7b4d51a5f9b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:19.351586 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a457444f-8639-4a49-9653-7b4d51a5f9b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:19.352450 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a457444f-8639-4a49-9653-7b4d51a5f9b0 None admin] RBAC: Adding query filter params (role.id=edc349453a61464087c153399e397247, scope.project.id=39a570421bb64fac8b1a0129f1bcc7d9, user.id=5324ab45f4a4449980dad920278f5034) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:43:19.352794 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a457444f-8639-4a49-9653-7b4d51a5f9b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:43:19.354264 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a457444f-8639-4a49-9653-7b4d51a5f9b0 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:43:19.360783 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 612/1219] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 14 17:43:19 2022] GET /identity/v3/role_assignments?user.id=5324ab45f4a4449980dad920278f5034&scope.project.id=39a570421bb64fac8b1a0129f1bcc7d9&role.id=edc349453a61464087c153399e397247 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:43:21.523027 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28368e0-e4a2-41ce-9231-766ea3b4b5c4 None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:21.523560 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28368e0-e4a2-41ce-9231-766ea3b4b5c4 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:21.523560 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28368e0-e4a2-41ce-9231-766ea3b4b5c4 None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:21.524955 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 608/1220] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:43:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:43:21.530904 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79addab8-395f-410e-9b56-4062638390d5 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:21.531431 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79addab8-395f-410e-9b56-4062638390d5 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:21.531616 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79addab8-395f-410e-9b56-4062638390d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:21.552632 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-79addab8-395f-410e-9b56-4062638390d5 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:43:21.554118 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-79addab8-395f-410e-9b56-4062638390d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:43:21.631372 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 613/1221] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:43:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 17:43:21.657970 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28368e0-e4a2-41ce-9231-766ea3b4b5c4 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:43:21.786002 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28368e0-e4a2-41ce-9231-766ea3b4b5c4 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:43:21.826483 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cda7f7-bfd7-4de2-bfc0-733fd9386fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:43:21.827407 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cda7f7-bfd7-4de2-bfc0-733fd9386fc6 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:21.827822 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cda7f7-bfd7-4de2-bfc0-733fd9386fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:21.828115 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cda7f7-bfd7-4de2-bfc0-733fd9386fc6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:21.839036 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cda7f7-bfd7-4de2-bfc0-733fd9386fc6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:43:21.846936 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-79cda7f7-bfd7-4de2-bfc0-733fd9386fc6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 17:43:21.846936 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:43:21.846936 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:43:21.846936 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:43:21.846936 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:43:21.846936 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:43:21.846936 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:43:21.846936 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:43:21.846936 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:43:21.846936 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:43:21.846936 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:43:21.846936 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:43:21.846936 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:43:21.846936 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:43:21.846936 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:43:21.846936 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:43:21.848047 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:43:21.848047 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:43:21.848047 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:43:21.848047 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:43:21.848047 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:43:21.848047 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:43:21.848047 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:43:21.848047 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:43:21.848047 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:43:21.848047 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:43:21.848047 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:43:21.848047 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:43:21.848047 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:43:21.848047 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:43:21.848047 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:43:21.848047 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:43:21.848952 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:43:21.848952 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:43:21.848952 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:43:21.848952 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:43:21.848952 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:43:21.848952 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:43:21.848952 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:43:21.848952 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:43:21.848952 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:43:21.848952 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:43:21.848952 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 17:43:21.848952 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:43:21.848952 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 609/1222] 10.222.0.67 () {56 vars in 1102 bytes} [Thu Jul 14 17:43:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:43:21.854717 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79addab8-395f-410e-9b56-4062638390d5 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:43:21.959500 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79addab8-395f-410e-9b56-4062638390d5 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:43:21.986604 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:43:21.999403 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329ef487-1556-4b4d-b424-ddd1b503969a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:43:22.000123 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ef487-1556-4b4d-b424-ddd1b503969a None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:22.000406 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ef487-1556-4b4d-b424-ddd1b503969a None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:22.000682 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ef487-1556-4b4d-b424-ddd1b503969a None admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:22.001655 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329ef487-1556-4b4d-b424-ddd1b503969a None admin] RBAC: Adding query filter params (name=service) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:43:22.001936 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329ef487-1556-4b4d-b424-ddd1b503969a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:43:22.003706 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329ef487-1556-4b4d-b424-ddd1b503969a None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:43:22.012427 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 614/1223] 10.222.0.67 () {56 vars in 1103 bytes} [Thu Jul 14 17:43:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:43:22.018288 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cda7f7-bfd7-4de2-bfc0-733fd9386fc6 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:43:22.064307 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:43:22.129893 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cda7f7-bfd7-4de2-bfc0-733fd9386fc6 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:43:22.176313 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98300774-1498-407c-b56d-cbd4794a4ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:43:22.177202 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98300774-1498-407c-b56d-cbd4794a4ff5 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:22.177537 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98300774-1498-407c-b56d-cbd4794a4ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:22.177875 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98300774-1498-407c-b56d-cbd4794a4ff5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:22.190626 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98300774-1498-407c-b56d-cbd4794a4ff5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:43:22.192365 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98300774-1498-407c-b56d-cbd4794a4ff5 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:43:22.211566 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-98300774-1498-407c-b56d-cbd4794a4ff5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:43:22.211566 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:43:22.211566 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:43:22.211566 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:43:22.211566 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:43:22.211566 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:43:22.211566 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:43:22.211566 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:43:22.211566 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:43:22.211566 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:43:22.211566 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:43:22.211566 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:43:22.211566 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:43:22.211566 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:43:22.211566 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:43:22.212756 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:43:22.212756 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:43:22.212756 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:43:22.212756 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:43:22.212756 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:43:22.212756 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:43:22.212756 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:43:22.212756 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:43:22.212756 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:43:22.212756 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:43:22.212756 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:43:22.212756 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:43:22.212756 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:43:22.212756 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:43:22.212756 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:43:22.212756 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:43:22.212756 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:43:22.213896 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:43:22.213896 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:43:22.213896 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:43:22.213896 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:43:22.213896 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 610/1224] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:43:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:43:22.219249 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329ef487-1556-4b4d-b424-ddd1b503969a None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:43:22.323935 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329ef487-1556-4b4d-b424-ddd1b503969a None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:43:22.360793 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803cfa8e-a41e-4e5a-b58c-ad0a1cbda499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:43:22.361458 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803cfa8e-a41e-4e5a-b58c-ad0a1cbda499 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:22.361763 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803cfa8e-a41e-4e5a-b58c-ad0a1cbda499 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:22.362034 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803cfa8e-a41e-4e5a-b58c-ad0a1cbda499 None admin] PATH_INFO: `/v3/domains` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:22.362766 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803cfa8e-a41e-4e5a-b58c-ad0a1cbda499 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:43:22.363061 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803cfa8e-a41e-4e5a-b58c-ad0a1cbda499 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:43:22.364425 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803cfa8e-a41e-4e5a-b58c-ad0a1cbda499 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:43:22.381152 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 615/1225] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 14 17:43:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:43:22.387191 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98300774-1498-407c-b56d-cbd4794a4ff5 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:43:22.508415 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:43:22.517968 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98300774-1498-407c-b56d-cbd4794a4ff5 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:43:22.552331 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1a96a4-0fbc-45de-bc0b-527213618598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:43:22.553133 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a96a4-0fbc-45de-bc0b-527213618598 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:22.553418 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a96a4-0fbc-45de-bc0b-527213618598 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:22.553726 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a96a4-0fbc-45de-bc0b-527213618598 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:22.562585 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1a96a4-0fbc-45de-bc0b-527213618598 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:43:22.564774 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1a96a4-0fbc-45de-bc0b-527213618598 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:43:22.580967 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-8d1a96a4-0fbc-45de-bc0b-527213618598 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 14 17:43:22.580967 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:43:22.580967 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:43:22.580967 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:43:22.580967 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:43:22.580967 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:43:22.580967 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:43:22.580967 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:43:22.580967 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:43:22.580967 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:43:22.580967 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:43:22.580967 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:43:22.580967 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 17:43:22.580967 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 17:43:22.580967 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 17:43:22.580967 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 17:43:22.582278 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:43:22.582278 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:43:22.582278 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 17:43:22.582278 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:43:22.582278 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 17:43:22.582278 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:43:22.582278 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:43:22.582278 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:43:22.582278 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:43:22.582278 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:43:22.582278 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:43:22.582278 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:43:22.582278 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:43:22.582278 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:43:22.582278 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:43:22.582278 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:43:22.582278 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:43:22.582278 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:43:22.583351 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:43:22.583351 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:43:22.583351 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 17:43:22.583351 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 17:43:22.583351 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 17:43:22.583351 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 17:43:22.583351 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 17:43:22.583351 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 17:43:22.583351 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 14 17:43:22.583351 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:43:22.583351 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 611/1226] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:43:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:43:22.588352 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803cfa8e-a41e-4e5a-b58c-ad0a1cbda499 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:43:22.643426 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:43:22.704741 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803cfa8e-a41e-4e5a-b58c-ad0a1cbda499 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:43:22.742975 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab1495d-76de-4ca8-a68b-ddd67751f336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:43:22.743695 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab1495d-76de-4ca8-a68b-ddd67751f336 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:22.743998 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab1495d-76de-4ca8-a68b-ddd67751f336 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:22.744296 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab1495d-76de-4ca8-a68b-ddd67751f336 None admin] PATH_INFO: `/v3/users` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:22.745104 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab1495d-76de-4ca8-a68b-ddd67751f336 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:43:22.745409 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab1495d-76de-4ca8-a68b-ddd67751f336 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:43:22.746901 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab1495d-76de-4ca8-a68b-ddd67751f336 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:43:22.767368 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 616/1227] 10.222.0.67 () {56 vars in 1143 bytes} [Thu Jul 14 17:43:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:43:22.773441 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1a96a4-0fbc-45de-bc0b-527213618598 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:43:22.892310 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1a96a4-0fbc-45de-bc0b-527213618598 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:43:22.932022 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b46c68c-2195-453b-8bba-b4dd1312f1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:43:22.932832 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b46c68c-2195-453b-8bba-b4dd1312f1d3 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:22.933119 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b46c68c-2195-453b-8bba-b4dd1312f1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:22.934981 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b46c68c-2195-453b-8bba-b4dd1312f1d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:22.948150 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b46c68c-2195-453b-8bba-b4dd1312f1d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:43:22.950115 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b46c68c-2195-453b-8bba-b4dd1312f1d3 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:43:22.974307 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-2b46c68c-2195-453b-8bba-b4dd1312f1d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:43:22.974307 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:43:22.974307 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:43:22.974307 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:43:22.974307 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:43:22.974307 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:43:22.974307 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:43:22.974307 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:43:22.974307 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:43:22.974307 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:43:22.974307 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:43:22.974307 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:43:22.974307 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:43:22.974307 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:43:22.974307 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:43:22.975483 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:43:22.975483 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:43:22.975483 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:43:22.975483 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:43:22.975483 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:43:22.975483 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:43:22.975483 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:43:22.975483 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:43:22.975483 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:43:22.975483 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:43:22.975483 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:43:22.975483 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:43:22.975483 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:43:22.975483 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:43:22.975483 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:43:22.975483 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:43:22.975483 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:43:22.976683 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:43:22.976683 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:43:22.976683 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:43:22.976683 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:43:22.976683 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 612/1228] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:43:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:43:22.981562 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab1495d-76de-4ca8-a68b-ddd67751f336 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:43:23.099104 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab1495d-76de-4ca8-a68b-ddd67751f336 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:43:23.101879 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:43:23.145495 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d11ec7c-705a-4e42-8bce-7d04e243d69c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:43:23.147766 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d11ec7c-705a-4e42-8bce-7d04e243d69c None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:23.147766 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d11ec7c-705a-4e42-8bce-7d04e243d69c None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:23.147766 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d11ec7c-705a-4e42-8bce-7d04e243d69c None admin] PATH_INFO: `/v3/domains` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:23.147766 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d11ec7c-705a-4e42-8bce-7d04e243d69c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:43:23.148171 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d11ec7c-705a-4e42-8bce-7d04e243d69c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:43:23.149237 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d11ec7c-705a-4e42-8bce-7d04e243d69c None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:43:23.162610 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 617/1229] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 14 17:43:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:43:23.168535 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b46c68c-2195-453b-8bba-b4dd1312f1d3 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:43:23.178861 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:43:23.292872 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b46c68c-2195-453b-8bba-b4dd1312f1d3 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:43:23.339496 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a032e8-c0de-4e78-88c6-dbe12dcbad99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:43:23.340327 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a032e8-c0de-4e78-88c6-dbe12dcbad99 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:23.340619 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a032e8-c0de-4e78-88c6-dbe12dcbad99 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:23.340903 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a032e8-c0de-4e78-88c6-dbe12dcbad99 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:23.351983 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a032e8-c0de-4e78-88c6-dbe12dcbad99 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:43:23.353516 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a032e8-c0de-4e78-88c6-dbe12dcbad99 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:43:23.372022 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-97a032e8-c0de-4e78-88c6-dbe12dcbad99 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:43:23.372022 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:43:23.372022 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:43:23.372022 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:43:23.372022 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:43:23.372022 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:43:23.372022 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:43:23.372022 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:43:23.372022 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:43:23.372022 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:43:23.372022 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:43:23.372022 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:43:23.372022 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 17:43:23.372022 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 17:43:23.372022 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 17:43:23.373163 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 17:43:23.373163 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:43:23.373163 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:43:23.373163 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:43:23.373163 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:43:23.373163 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:43:23.373163 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:43:23.373163 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:43:23.373163 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:43:23.373163 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:43:23.373163 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:43:23.373163 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:43:23.373163 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:43:23.373163 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:43:23.373163 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:43:23.373163 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:43:23.373163 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:43:23.374311 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 17:43:23.374311 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 17:43:23.374311 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 17:43:23.374311 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 17:43:23.374311 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 17:43:23.374311 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 17:43:23.374311 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:43:23.374311 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:43:23.374936 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 613/1230] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 14 17:43:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:43:23.380852 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d11ec7c-705a-4e42-8bce-7d04e243d69c None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:43:23.498063 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d11ec7c-705a-4e42-8bce-7d04e243d69c None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:43:23.534079 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb19dcb-fed1-43d4-9519-c209d33a512a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:43:23.534732 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb19dcb-fed1-43d4-9519-c209d33a512a None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:23.535017 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb19dcb-fed1-43d4-9519-c209d33a512a None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:23.535288 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb19dcb-fed1-43d4-9519-c209d33a512a None admin] PATH_INFO: `/v3/projects` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:23.536080 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb19dcb-fed1-43d4-9519-c209d33a512a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:43:23.536388 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb19dcb-fed1-43d4-9519-c209d33a512a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:43:23.537843 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb19dcb-fed1-43d4-9519-c209d33a512a None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:43:23.551108 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 618/1231] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 14 17:43:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:43:23.557172 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a032e8-c0de-4e78-88c6-dbe12dcbad99 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:43:23.633246 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:43:23.679454 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a032e8-c0de-4e78-88c6-dbe12dcbad99 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:43:23.719520 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c80902c-86dc-4104-8fe4-151cef1abfab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:43:23.720505 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c80902c-86dc-4104-8fe4-151cef1abfab None admin] REQUEST_METHOD: `PUT` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:23.720787 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c80902c-86dc-4104-8fe4-151cef1abfab None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:23.721060 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c80902c-86dc-4104-8fe4-151cef1abfab None admin] PATH_INFO: `/v3/projects/39a570421bb64fac8b1a0129f1bcc7d9/users/5324ab45f4a4449980dad920278f5034/roles/edc349453a61464087c153399e397247` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:23.736391 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c80902c-86dc-4104-8fe4-151cef1abfab None admin] RBAC: Authorizing `identity:create_grant(project_id=39a570421bb64fac8b1a0129f1bcc7d9, user_id=5324ab45f4a4449980dad920278f5034, role_id=edc349453a61464087c153399e397247)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:43:23.737982 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c80902c-86dc-4104-8fe4-151cef1abfab None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:43:23.757435 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 614/1232] 10.222.0.67 () {58 vars in 1439 bytes} [Thu Jul 14 17:43:23 2022] PUT /identity/v3/projects/39a570421bb64fac8b1a0129f1bcc7d9/users/5324ab45f4a4449980dad920278f5034/roles/edc349453a61464087c153399e397247 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:43:25.930042 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7527417-7374-4923-a309-a6e298e9071a None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:25.930635 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7527417-7374-4923-a309-a6e298e9071a None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:25.930635 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7527417-7374-4923-a309-a6e298e9071a None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:25.931961 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 619/1233] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:43:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:43:25.939259 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a76fe9-5b59-4a9f-8150-1eb36d683c18 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:25.939814 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a76fe9-5b59-4a9f-8150-1eb36d683c18 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:25.940476 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a76fe9-5b59-4a9f-8150-1eb36d683c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:25.965723 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-a6a76fe9-5b59-4a9f-8150-1eb36d683c18 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:43:25.967626 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-a6a76fe9-5b59-4a9f-8150-1eb36d683c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:43:26.038679 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 615/1234] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:43:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 17:43:26.062062 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7527417-7374-4923-a309-a6e298e9071a None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:43:26.091041 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:43:26.177779 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7527417-7374-4923-a309-a6e298e9071a None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:43:26.218950 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf075e3-1c25-49a1-ad57-dbed1255b718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:43:26.219750 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf075e3-1c25-49a1-ad57-dbed1255b718 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:26.220019 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf075e3-1c25-49a1-ad57-dbed1255b718 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:26.220333 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf075e3-1c25-49a1-ad57-dbed1255b718 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:26.231609 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf075e3-1c25-49a1-ad57-dbed1255b718 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:43:26.239544 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-fdf075e3-1c25-49a1-ad57-dbed1255b718 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 17:43:26.239544 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:43:26.239544 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:43:26.239544 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:43:26.239544 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:43:26.239544 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:43:26.239544 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:43:26.239544 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:43:26.239544 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:43:26.239544 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:43:26.239544 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:43:26.239544 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:43:26.239544 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:43:26.239544 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:43:26.239544 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:43:26.239544 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:43:26.241369 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:43:26.241369 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:43:26.241369 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:43:26.241369 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:43:26.241369 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:43:26.241369 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:43:26.241369 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:43:26.241369 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:43:26.241369 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:43:26.241369 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:43:26.241369 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:43:26.241369 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:43:26.241369 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:43:26.241369 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:43:26.241369 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:43:26.241369 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:43:26.249748 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:43:26.249748 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:43:26.249748 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:43:26.249748 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:43:26.249748 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:43:26.249748 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:43:26.249748 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:43:26.249748 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:43:26.249748 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:43:26.249748 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:43:26.249748 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 17:43:26.249748 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:43:26.249748 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 620/1235] 10.222.0.67 () {56 vars in 1102 bytes} [Thu Jul 14 17:43:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:43:26.250669 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a76fe9-5b59-4a9f-8150-1eb36d683c18 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:43:26.303549 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:43:26.365622 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a76fe9-5b59-4a9f-8150-1eb36d683c18 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:43:26.408100 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc00fdd9-c30b-42b1-a5ca-6724827a6e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:43:26.408883 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc00fdd9-c30b-42b1-a5ca-6724827a6e74 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:26.409271 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc00fdd9-c30b-42b1-a5ca-6724827a6e74 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:26.409683 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc00fdd9-c30b-42b1-a5ca-6724827a6e74 None admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:26.410560 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc00fdd9-c30b-42b1-a5ca-6724827a6e74 None admin] RBAC: Adding query filter params (name=service) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:43:26.411007 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc00fdd9-c30b-42b1-a5ca-6724827a6e74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:43:26.412461 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc00fdd9-c30b-42b1-a5ca-6724827a6e74 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:43:26.422642 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 616/1236] 10.222.0.67 () {56 vars in 1103 bytes} [Thu Jul 14 17:43:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:43:26.428794 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf075e3-1c25-49a1-ad57-dbed1255b718 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:43:26.545260 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:43:26.572262 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf075e3-1c25-49a1-ad57-dbed1255b718 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:43:26.620834 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07a319b-1b55-4904-a38b-8b38bdf1f5ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:43:26.621737 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a319b-1b55-4904-a38b-8b38bdf1f5ea None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:26.622027 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a319b-1b55-4904-a38b-8b38bdf1f5ea None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:26.622304 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a319b-1b55-4904-a38b-8b38bdf1f5ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:26.637015 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07a319b-1b55-4904-a38b-8b38bdf1f5ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:43:26.639097 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07a319b-1b55-4904-a38b-8b38bdf1f5ea None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:43:26.659575 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-c07a319b-1b55-4904-a38b-8b38bdf1f5ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:43:26.659575 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:43:26.659575 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:43:26.659575 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:43:26.659575 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:43:26.659575 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:43:26.659575 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:43:26.659575 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:43:26.659575 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:43:26.659575 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:43:26.659575 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:43:26.659575 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:43:26.659575 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:43:26.659575 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:43:26.659575 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:43:26.661667 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:43:26.661667 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:43:26.661667 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:43:26.661667 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:43:26.661667 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:43:26.661667 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:43:26.661667 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:43:26.661667 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:43:26.661667 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:43:26.661667 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:43:26.661667 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:43:26.661667 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:43:26.661667 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:43:26.661667 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:43:26.661667 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:43:26.661667 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:43:26.661667 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:43:26.663706 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:43:26.663706 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:43:26.663706 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:43:26.663706 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:43:26.663706 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 621/1237] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:43:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:43:26.667914 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc00fdd9-c30b-42b1-a5ca-6724827a6e74 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:43:26.814594 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc00fdd9-c30b-42b1-a5ca-6724827a6e74 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:43:26.826624 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:43:26.858471 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cc2a2d-658a-4794-8b04-5ebaab042723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:43:26.859618 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc2a2d-658a-4794-8b04-5ebaab042723 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:26.860126 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc2a2d-658a-4794-8b04-5ebaab042723 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:26.860603 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc2a2d-658a-4794-8b04-5ebaab042723 None admin] PATH_INFO: `/v3/domains` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:26.862072 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cc2a2d-658a-4794-8b04-5ebaab042723 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:43:26.862631 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cc2a2d-658a-4794-8b04-5ebaab042723 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:43:26.865331 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cc2a2d-658a-4794-8b04-5ebaab042723 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:43:26.888462 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 617/1238] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 14 17:43:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:43:26.894833 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07a319b-1b55-4904-a38b-8b38bdf1f5ea None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:43:27.053186 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07a319b-1b55-4904-a38b-8b38bdf1f5ea None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:43:27.100386 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd250bfe-0b53-4db2-8271-9a92ccb3647a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:43:27.101226 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd250bfe-0b53-4db2-8271-9a92ccb3647a None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:27.101565 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd250bfe-0b53-4db2-8271-9a92ccb3647a None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:27.102001 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd250bfe-0b53-4db2-8271-9a92ccb3647a None admin] PATH_INFO: `/v3/users/placement` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:27.105335 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:43:27.112554 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd250bfe-0b53-4db2-8271-9a92ccb3647a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:43:27.114457 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd250bfe-0b53-4db2-8271-9a92ccb3647a None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:43:27.131646 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-dd250bfe-0b53-4db2-8271-9a92ccb3647a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 14 17:43:27.131646 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:43:27.131646 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:43:27.131646 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:43:27.131646 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:43:27.131646 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:43:27.131646 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:43:27.131646 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:43:27.131646 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:43:27.131646 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:43:27.131646 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:43:27.131646 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:43:27.131646 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 17:43:27.131646 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 17:43:27.131646 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 17:43:27.131646 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 17:43:27.134514 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:43:27.134514 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:43:27.134514 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 17:43:27.134514 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:43:27.134514 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 17:43:27.134514 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:43:27.134514 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:43:27.134514 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:43:27.134514 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:43:27.134514 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:43:27.134514 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:43:27.134514 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:43:27.134514 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:43:27.134514 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:43:27.134514 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:43:27.134514 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:43:27.134514 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:43:27.134514 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:43:27.135726 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:43:27.135726 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:43:27.135726 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 17:43:27.135726 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 17:43:27.135726 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 17:43:27.135726 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 17:43:27.135726 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 17:43:27.135726 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 17:43:27.135726 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 14 17:43:27.135726 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:43:27.135726 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 622/1239] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:43:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 17:43:27.139237 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cc2a2d-658a-4794-8b04-5ebaab042723 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:43:27.254738 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cc2a2d-658a-4794-8b04-5ebaab042723 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:43:27.300618 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53979e3-fb9e-46cc-9946-160860f35214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:43:27.301586 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53979e3-fb9e-46cc-9946-160860f35214 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:27.301881 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53979e3-fb9e-46cc-9946-160860f35214 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:27.302160 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53979e3-fb9e-46cc-9946-160860f35214 None admin] PATH_INFO: `/v3/users` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:27.303666 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53979e3-fb9e-46cc-9946-160860f35214 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:43:27.304074 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53979e3-fb9e-46cc-9946-160860f35214 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:43:27.306185 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53979e3-fb9e-46cc-9946-160860f35214 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:43:27.328471 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 618/1240] 10.222.0.67 () {56 vars in 1143 bytes} [Thu Jul 14 17:43:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:43:27.336362 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd250bfe-0b53-4db2-8271-9a92ccb3647a None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:43:27.450926 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd250bfe-0b53-4db2-8271-9a92ccb3647a None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:43:27.492629 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d1c829-ce39-430b-b0b7-f03f9fb27d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:43:27.493349 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d1c829-ce39-430b-b0b7-f03f9fb27d9f None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:27.493856 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d1c829-ce39-430b-b0b7-f03f9fb27d9f None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:27.494262 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d1c829-ce39-430b-b0b7-f03f9fb27d9f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:27.570390 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:43:27.578890 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d1c829-ce39-430b-b0b7-f03f9fb27d9f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:43:27.580565 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d1c829-ce39-430b-b0b7-f03f9fb27d9f None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:43:27.708092 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 623/1241] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 14 17:43:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 17:43:27.709369 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53979e3-fb9e-46cc-9946-160860f35214 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:43:27.749891 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:43:27.853103 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53979e3-fb9e-46cc-9946-160860f35214 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:43:27.897694 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8afe8d0-5ed4-4283-92bd-ef0e1e92aab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:43:27.898510 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8afe8d0-5ed4-4283-92bd-ef0e1e92aab6 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:27.898809 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8afe8d0-5ed4-4283-92bd-ef0e1e92aab6 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:27.899070 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8afe8d0-5ed4-4283-92bd-ef0e1e92aab6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:27.911019 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8afe8d0-5ed4-4283-92bd-ef0e1e92aab6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:43:27.912492 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8afe8d0-5ed4-4283-92bd-ef0e1e92aab6 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:43:27.931974 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-e8afe8d0-5ed4-4283-92bd-ef0e1e92aab6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:43:27.931974 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:43:27.931974 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:43:27.931974 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:43:27.931974 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:43:27.931974 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:43:27.931974 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:43:27.931974 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:43:27.931974 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:43:27.931974 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:43:27.931974 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:43:27.931974 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:43:27.931974 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:43:27.931974 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:43:27.931974 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:43:27.933224 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:43:27.933224 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:43:27.933224 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:43:27.933224 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:43:27.933224 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:43:27.933224 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:43:27.933224 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:43:27.933224 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:43:27.933224 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:43:27.933224 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:43:27.933224 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:43:27.933224 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:43:27.933224 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:43:27.933224 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:43:27.933224 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:43:27.933224 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:43:27.933224 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:43:27.934800 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:43:27.934800 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:43:27.934800 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:43:27.934800 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:43:27.939282 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 619/1242] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:43:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:43:27.939468 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d1c829-ce39-430b-b0b7-f03f9fb27d9f None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:43:28.075709 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:43:28.086586 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d1c829-ce39-430b-b0b7-f03f9fb27d9f None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:43:28.133433 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6706aa8a-f9cf-492b-94ff-230c01dcdbe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:43:28.134180 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6706aa8a-f9cf-492b-94ff-230c01dcdbe1 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:28.134523 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6706aa8a-f9cf-492b-94ff-230c01dcdbe1 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:28.134916 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6706aa8a-f9cf-492b-94ff-230c01dcdbe1 None admin] PATH_INFO: `/v3/domains` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:28.135664 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6706aa8a-f9cf-492b-94ff-230c01dcdbe1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:43:28.135975 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6706aa8a-f9cf-492b-94ff-230c01dcdbe1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:43:28.137419 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6706aa8a-f9cf-492b-94ff-230c01dcdbe1 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:43:28.153370 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 624/1243] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 14 17:43:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:43:28.160171 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8afe8d0-5ed4-4283-92bd-ef0e1e92aab6 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:43:28.256903 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:43:28.293120 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8afe8d0-5ed4-4283-92bd-ef0e1e92aab6 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:43:28.342612 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eacf8d-1f4d-47e7-a0d8-d47a7d24528a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:43:28.343345 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eacf8d-1f4d-47e7-a0d8-d47a7d24528a None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:28.343660 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eacf8d-1f4d-47e7-a0d8-d47a7d24528a None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:28.343956 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eacf8d-1f4d-47e7-a0d8-d47a7d24528a None admin] PATH_INFO: `/v3/projects/service` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:28.353236 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eacf8d-1f4d-47e7-a0d8-d47a7d24528a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:43:28.354979 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eacf8d-1f4d-47e7-a0d8-d47a7d24528a None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:43:28.372160 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-60eacf8d-1f4d-47e7-a0d8-d47a7d24528a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:43:28.372160 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:43:28.372160 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:43:28.372160 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:43:28.372160 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:43:28.372160 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:43:28.372160 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:43:28.372160 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:43:28.372160 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:43:28.372160 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:43:28.372160 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:43:28.372160 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:43:28.372160 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 17:43:28.372160 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 17:43:28.372160 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 17:43:28.373441 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 17:43:28.373441 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:43:28.373441 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:43:28.373441 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:43:28.373441 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:43:28.373441 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:43:28.373441 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:43:28.373441 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:43:28.373441 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:43:28.373441 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:43:28.373441 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:43:28.373441 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:43:28.373441 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:43:28.373441 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:43:28.373441 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:43:28.373441 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:43:28.373441 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:43:28.374560 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 17:43:28.374560 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 17:43:28.374560 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 17:43:28.374560 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 17:43:28.374560 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 17:43:28.374560 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 17:43:28.374560 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:43:28.374560 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:43:28.374560 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 620/1244] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 14 17:43:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:43:28.383078 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6706aa8a-f9cf-492b-94ff-230c01dcdbe1 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:43:28.524518 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6706aa8a-f9cf-492b-94ff-230c01dcdbe1 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:43:28.565258 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced00b5c-cc2a-4c12-ab5a-558d18cde1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:43:28.566054 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced00b5c-cc2a-4c12-ab5a-558d18cde1cb None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:28.566350 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced00b5c-cc2a-4c12-ab5a-558d18cde1cb None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:28.566617 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced00b5c-cc2a-4c12-ab5a-558d18cde1cb None admin] PATH_INFO: `/v3/projects` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:28.567523 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced00b5c-cc2a-4c12-ab5a-558d18cde1cb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:43:28.567743 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced00b5c-cc2a-4c12-ab5a-558d18cde1cb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:43:28.569462 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced00b5c-cc2a-4c12-ab5a-558d18cde1cb None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:43:28.590610 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 625/1245] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 14 17:43:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:43:28.597705 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eacf8d-1f4d-47e7-a0d8-d47a7d24528a None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:43:28.736303 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eacf8d-1f4d-47e7-a0d8-d47a7d24528a None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:43:28.787805 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7f5882-93a6-440b-880f-66cbbd7710c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:43:28.788796 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7f5882-93a6-440b-880f-66cbbd7710c2 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:28.789276 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7f5882-93a6-440b-880f-66cbbd7710c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:28.789756 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7f5882-93a6-440b-880f-66cbbd7710c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:28.791019 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7f5882-93a6-440b-880f-66cbbd7710c2 None admin] RBAC: Adding query filter params (role.id=edc349453a61464087c153399e397247, scope.project.id=39a570421bb64fac8b1a0129f1bcc7d9, user.id=5324ab45f4a4449980dad920278f5034) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:43:28.791595 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7f5882-93a6-440b-880f-66cbbd7710c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:43:28.793520 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7f5882-93a6-440b-880f-66cbbd7710c2 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:43:28.801945 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 621/1246] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 14 17:43:28 2022] GET /identity/v3/role_assignments?user.id=5324ab45f4a4449980dad920278f5034&scope.project.id=39a570421bb64fac8b1a0129f1bcc7d9&role.id=edc349453a61464087c153399e397247 => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:43:31.187490 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0182f197-a5e7-4321-a694-3a1d03b50c10 None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:31.188103 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0182f197-a5e7-4321-a694-3a1d03b50c10 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:31.188208 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0182f197-a5e7-4321-a694-3a1d03b50c10 None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:31.189848 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 626/1247] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:43:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:43:31.197170 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7276b7-bc4d-483c-a4a0-a2289f79c715 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:31.197742 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7276b7-bc4d-483c-a4a0-a2289f79c715 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:31.197904 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7276b7-bc4d-483c-a4a0-a2289f79c715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:31.204640 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:43:31.221310 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-6c7276b7-bc4d-483c-a4a0-a2289f79c715 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:43:31.222586 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-6c7276b7-bc4d-483c-a4a0-a2289f79c715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:43:31.317579 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 622/1248] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:43:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 17:43:31.343353 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0182f197-a5e7-4321-a694-3a1d03b50c10 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:43:31.363730 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:43:31.474091 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0182f197-a5e7-4321-a694-3a1d03b50c10 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:43:31.518930 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd31442a-8134-49c1-b9f4-4262b5c290a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:43:31.519745 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd31442a-8134-49c1-b9f4-4262b5c290a8 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:31.520026 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd31442a-8134-49c1-b9f4-4262b5c290a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:31.520297 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd31442a-8134-49c1-b9f4-4262b5c290a8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:31.531868 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd31442a-8134-49c1-b9f4-4262b5c290a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:43:31.540877 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-dd31442a-8134-49c1-b9f4-4262b5c290a8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 17:43:31.540877 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:43:31.540877 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:43:31.540877 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:43:31.540877 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:43:31.540877 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:43:31.540877 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:43:31.540877 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:43:31.540877 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:43:31.540877 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:43:31.540877 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:43:31.540877 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:43:31.540877 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:43:31.540877 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:43:31.540877 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:43:31.540877 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:43:31.542001 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:43:31.542001 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:43:31.542001 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:43:31.542001 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:43:31.542001 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:43:31.542001 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:43:31.542001 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:43:31.542001 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:43:31.542001 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:43:31.542001 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:43:31.542001 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:43:31.542001 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:43:31.542001 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:43:31.542001 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:43:31.542001 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:43:31.542001 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:43:31.542870 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:43:31.542870 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:43:31.542870 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:43:31.542870 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:43:31.542870 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:43:31.542870 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:43:31.542870 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:43:31.542870 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:43:31.542870 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:43:31.542870 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:43:31.542870 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 17:43:31.542870 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:43:31.542870 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 627/1249] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 14 17:43:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:43:31.548956 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7276b7-bc4d-483c-a4a0-a2289f79c715 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:43:31.664627 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7276b7-bc4d-483c-a4a0-a2289f79c715 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:43:31.707203 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:43:31.716113 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4da9232-749a-4247-81ff-ac52ed8940e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:43:31.717589 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4da9232-749a-4247-81ff-ac52ed8940e9 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:31.718041 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4da9232-749a-4247-81ff-ac52ed8940e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:31.718487 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4da9232-749a-4247-81ff-ac52ed8940e9 None admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:31.719388 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4da9232-749a-4247-81ff-ac52ed8940e9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:43:31.719746 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4da9232-749a-4247-81ff-ac52ed8940e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:43:31.721686 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4da9232-749a-4247-81ff-ac52ed8940e9 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:43:31.731570 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 623/1250] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 14 17:43:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:43:31.739646 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd31442a-8134-49c1-b9f4-4262b5c290a8 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:43:31.856394 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:43:31.883911 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd31442a-8134-49c1-b9f4-4262b5c290a8 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:43:31.923784 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8ce725-ffa6-46cb-bafd-0886222aa2ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:43:31.924782 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8ce725-ffa6-46cb-bafd-0886222aa2ec None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:31.925033 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8ce725-ffa6-46cb-bafd-0886222aa2ec None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:31.925329 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8ce725-ffa6-46cb-bafd-0886222aa2ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:31.940043 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8ce725-ffa6-46cb-bafd-0886222aa2ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:43:31.941581 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8ce725-ffa6-46cb-bafd-0886222aa2ec None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:43:31.961937 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-7e8ce725-ffa6-46cb-bafd-0886222aa2ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:43:31.961937 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:43:31.961937 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:43:31.961937 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:43:31.961937 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:43:31.961937 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:43:31.961937 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:43:31.961937 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:43:31.961937 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:43:31.961937 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:43:31.961937 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:43:31.961937 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:43:31.961937 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:43:31.961937 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:43:31.961937 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:43:31.963235 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:43:31.963235 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:43:31.963235 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:43:31.963235 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:43:31.963235 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:43:31.963235 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:43:31.963235 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:43:31.963235 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:43:31.963235 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:43:31.963235 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:43:31.963235 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:43:31.963235 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:43:31.963235 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:43:31.963235 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:43:31.963235 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:43:31.963235 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:43:31.963235 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:43:31.964225 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:43:31.964225 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:43:31.964225 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:43:31.964225 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:43:31.964225 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 628/1251] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:43:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 17:43:31.970184 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4da9232-749a-4247-81ff-ac52ed8940e9 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:43:32.104190 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4da9232-749a-4247-81ff-ac52ed8940e9 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:43:32.145141 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477f3201-017b-484a-bd94-59f744083a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:43:32.146104 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477f3201-017b-484a-bd94-59f744083a46 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:32.146399 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477f3201-017b-484a-bd94-59f744083a46 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:32.146681 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477f3201-017b-484a-bd94-59f744083a46 None admin] PATH_INFO: `/v3/domains` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:32.147424 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477f3201-017b-484a-bd94-59f744083a46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:43:32.147733 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477f3201-017b-484a-bd94-59f744083a46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:43:32.149119 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477f3201-017b-484a-bd94-59f744083a46 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:43:32.166169 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 624/1252] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 14 17:43:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:43:32.171950 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8ce725-ffa6-46cb-bafd-0886222aa2ec None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:43:32.290812 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8ce725-ffa6-46cb-bafd-0886222aa2ec None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:43:32.322420 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:43:32.333627 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b248bebb-3616-4fc9-9437-eee6c152c048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:43:32.334483 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b248bebb-3616-4fc9-9437-eee6c152c048 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:32.334793 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b248bebb-3616-4fc9-9437-eee6c152c048 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:32.335162 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b248bebb-3616-4fc9-9437-eee6c152c048 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:32.348917 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b248bebb-3616-4fc9-9437-eee6c152c048 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:43:32.351636 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b248bebb-3616-4fc9-9437-eee6c152c048 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:43:32.378834 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-b248bebb-3616-4fc9-9437-eee6c152c048 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 14 17:43:32.378834 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:43:32.378834 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:43:32.378834 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:43:32.378834 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:43:32.378834 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:43:32.378834 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:43:32.378834 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:43:32.378834 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:43:32.378834 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:43:32.378834 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:43:32.378834 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:43:32.378834 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 17:43:32.378834 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 17:43:32.378834 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 17:43:32.378834 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 17:43:32.380155 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:43:32.380155 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:43:32.380155 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 17:43:32.380155 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:43:32.380155 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 17:43:32.380155 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:43:32.380155 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:43:32.380155 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:43:32.380155 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:43:32.380155 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:43:32.380155 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:43:32.380155 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:43:32.380155 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:43:32.380155 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:43:32.380155 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:43:32.380155 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:43:32.380155 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:43:32.380155 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:43:32.381512 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:43:32.381512 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:43:32.381512 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 17:43:32.381512 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 17:43:32.381512 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 17:43:32.381512 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 17:43:32.381512 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 17:43:32.381512 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 17:43:32.381512 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 14 17:43:32.381512 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:43:32.381512 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 629/1253] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:43:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:43:32.387498 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477f3201-017b-484a-bd94-59f744083a46 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:43:32.477782 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:43:32.533859 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477f3201-017b-484a-bd94-59f744083a46 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:43:32.573516 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df61159-da59-4b70-89fe-0397ede4f198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:43:32.574159 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df61159-da59-4b70-89fe-0397ede4f198 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:32.574450 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df61159-da59-4b70-89fe-0397ede4f198 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:32.574725 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df61159-da59-4b70-89fe-0397ede4f198 None admin] PATH_INFO: `/v3/users` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:32.575584 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df61159-da59-4b70-89fe-0397ede4f198 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:43:32.575921 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df61159-da59-4b70-89fe-0397ede4f198 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:43:32.577958 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df61159-da59-4b70-89fe-0397ede4f198 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:43:32.597690 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 625/1254] 10.222.0.67 () {56 vars in 1143 bytes} [Thu Jul 14 17:43:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:43:32.603704 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b248bebb-3616-4fc9-9437-eee6c152c048 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:43:32.777655 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b248bebb-3616-4fc9-9437-eee6c152c048 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:43:32.840904 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af77492a-5ba6-46c6-9850-3d4e6c7cbdbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:43:32.843682 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af77492a-5ba6-46c6-9850-3d4e6c7cbdbb None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:32.844370 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af77492a-5ba6-46c6-9850-3d4e6c7cbdbb None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:32.845010 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af77492a-5ba6-46c6-9850-3d4e6c7cbdbb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:32.929643 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:43:32.949888 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af77492a-5ba6-46c6-9850-3d4e6c7cbdbb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:43:32.951537 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af77492a-5ba6-46c6-9850-3d4e6c7cbdbb None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:43:33.072202 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 630/1255] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 14 17:43:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 17:43:33.073493 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df61159-da59-4b70-89fe-0397ede4f198 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:43:33.190832 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df61159-da59-4b70-89fe-0397ede4f198 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:43:33.205827 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:43:33.231256 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e3fdb8-9b11-4166-99ae-017eb5c09fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:43:33.232177 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e3fdb8-9b11-4166-99ae-017eb5c09fdb None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:33.233085 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e3fdb8-9b11-4166-99ae-017eb5c09fdb None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:33.233366 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e3fdb8-9b11-4166-99ae-017eb5c09fdb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:33.245994 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e3fdb8-9b11-4166-99ae-017eb5c09fdb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:43:33.247538 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e3fdb8-9b11-4166-99ae-017eb5c09fdb None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:43:33.273650 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-f6e3fdb8-9b11-4166-99ae-017eb5c09fdb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:43:33.273650 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:43:33.273650 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:43:33.273650 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:43:33.273650 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:43:33.273650 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:43:33.273650 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:43:33.273650 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:43:33.273650 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:43:33.273650 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:43:33.273650 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:43:33.273650 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:43:33.273650 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:43:33.273650 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:43:33.273650 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:43:33.274979 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:43:33.274979 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:43:33.274979 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:43:33.274979 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:43:33.274979 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:43:33.274979 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:43:33.274979 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:43:33.274979 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:43:33.274979 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:43:33.274979 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:43:33.274979 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:43:33.274979 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:43:33.274979 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:43:33.274979 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:43:33.274979 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:43:33.274979 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:43:33.274979 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:43:33.276407 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:43:33.276407 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:43:33.276407 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:43:33.276407 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:43:33.280303 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 626/1256] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:43:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 17:43:33.281294 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af77492a-5ba6-46c6-9850-3d4e6c7cbdbb None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:43:33.409278 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:43:33.428984 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af77492a-5ba6-46c6-9850-3d4e6c7cbdbb None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:43:33.474422 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa781a-4f48-4b00-b2cc-cd6ef4de5f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:43:33.475362 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa781a-4f48-4b00-b2cc-cd6ef4de5f56 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:33.475808 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa781a-4f48-4b00-b2cc-cd6ef4de5f56 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:33.476148 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa781a-4f48-4b00-b2cc-cd6ef4de5f56 None admin] PATH_INFO: `/v3/domains` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:33.476982 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aa781a-4f48-4b00-b2cc-cd6ef4de5f56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:43:33.477342 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aa781a-4f48-4b00-b2cc-cd6ef4de5f56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:43:33.478966 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aa781a-4f48-4b00-b2cc-cd6ef4de5f56 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:43:33.502670 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 631/1257] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 14 17:43:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:43:33.508754 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e3fdb8-9b11-4166-99ae-017eb5c09fdb None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:43:33.643589 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e3fdb8-9b11-4166-99ae-017eb5c09fdb None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:43:33.685788 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d12646a-7917-48cd-aae3-3d97c2abf30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:43:33.686811 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d12646a-7917-48cd-aae3-3d97c2abf30c None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:33.687149 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d12646a-7917-48cd-aae3-3d97c2abf30c None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:33.687454 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d12646a-7917-48cd-aae3-3d97c2abf30c None admin] PATH_INFO: `/v3/projects/service` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:33.696950 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d12646a-7917-48cd-aae3-3d97c2abf30c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:43:33.698658 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d12646a-7917-48cd-aae3-3d97c2abf30c None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:43:33.716451 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-2d12646a-7917-48cd-aae3-3d97c2abf30c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:43:33.716451 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:43:33.716451 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:43:33.716451 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:43:33.716451 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:43:33.716451 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:43:33.716451 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:43:33.716451 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:43:33.716451 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:43:33.716451 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:43:33.716451 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:43:33.716451 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:43:33.716451 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 17:43:33.716451 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 17:43:33.716451 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 17:43:33.718173 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 17:43:33.718173 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:43:33.718173 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:43:33.718173 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:43:33.718173 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:43:33.718173 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:43:33.718173 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:43:33.718173 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:43:33.718173 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:43:33.718173 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:43:33.718173 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:43:33.718173 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:43:33.718173 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:43:33.718173 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:43:33.718173 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:43:33.718173 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:43:33.718173 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:43:33.719345 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 17:43:33.719345 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 17:43:33.719345 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 17:43:33.719345 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 17:43:33.719345 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 17:43:33.719345 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 17:43:33.719345 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:43:33.719345 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:43:33.719345 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 627/1258] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 14 17:43:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:43:33.724952 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa781a-4f48-4b00-b2cc-cd6ef4de5f56 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:43:33.855999 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa781a-4f48-4b00-b2cc-cd6ef4de5f56 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:43:33.894589 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c36198-a656-4ca0-bb61-6638cc592dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:43:33.896705 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c36198-a656-4ca0-bb61-6638cc592dd4 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:33.896705 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c36198-a656-4ca0-bb61-6638cc592dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:33.896705 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c36198-a656-4ca0-bb61-6638cc592dd4 None admin] PATH_INFO: `/v3/projects` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:33.897143 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c36198-a656-4ca0-bb61-6638cc592dd4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:43:33.897827 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c36198-a656-4ca0-bb61-6638cc592dd4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:43:33.899360 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c36198-a656-4ca0-bb61-6638cc592dd4 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:43:33.913440 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 632/1259] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 14 17:43:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:43:33.919900 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d12646a-7917-48cd-aae3-3d97c2abf30c None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:43:33.948259 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:43:34.058195 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d12646a-7917-48cd-aae3-3d97c2abf30c None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:43:34.111225 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79be5a4-5fea-40c6-93a1-80a61305f3f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:43:34.111907 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79be5a4-5fea-40c6-93a1-80a61305f3f3 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:34.112188 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79be5a4-5fea-40c6-93a1-80a61305f3f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:34.112458 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79be5a4-5fea-40c6-93a1-80a61305f3f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:34.113349 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79be5a4-5fea-40c6-93a1-80a61305f3f3 None admin] RBAC: Adding query filter params (role.id=4651a1cc7b4d4ab7a7a9ca1e77e58e71, scope.project.id=39a570421bb64fac8b1a0129f1bcc7d9, user.id=5324ab45f4a4449980dad920278f5034) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:43:34.113689 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79be5a4-5fea-40c6-93a1-80a61305f3f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:43:34.115186 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79be5a4-5fea-40c6-93a1-80a61305f3f3 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:43:34.121414 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 628/1260] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 14 17:43:33 2022] GET /identity/v3/role_assignments?user.id=5324ab45f4a4449980dad920278f5034&scope.project.id=39a570421bb64fac8b1a0129f1bcc7d9&role.id=4651a1cc7b4d4ab7a7a9ca1e77e58e71 => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:43:36.250000 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb5696-d086-46c1-9715-8f61412b26c1 None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:36.250566 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb5696-d086-46c1-9715-8f61412b26c1 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:36.250566 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb5696-d086-46c1-9715-8f61412b26c1 None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:36.251896 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 633/1261] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:43:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:43:36.259148 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f44bf8-1d94-4fca-801b-0a1801309cc6 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:36.259645 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f44bf8-1d94-4fca-801b-0a1801309cc6 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:36.259779 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f44bf8-1d94-4fca-801b-0a1801309cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:36.277811 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-c3f44bf8-1d94-4fca-801b-0a1801309cc6 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:43:36.280160 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-c3f44bf8-1d94-4fca-801b-0a1801309cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:43:36.358318 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 629/1262] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:43:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 17:43:36.382027 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bb5696-d086-46c1-9715-8f61412b26c1 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:43:36.392980 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:43:36.496143 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bb5696-d086-46c1-9715-8f61412b26c1 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:43:36.531982 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49d048a-f08d-41c5-9153-27b34be57edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:43:36.532689 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49d048a-f08d-41c5-9153-27b34be57edd None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:36.532971 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49d048a-f08d-41c5-9153-27b34be57edd None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:36.533245 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49d048a-f08d-41c5-9153-27b34be57edd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:36.543577 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49d048a-f08d-41c5-9153-27b34be57edd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:43:36.551804 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-d49d048a-f08d-41c5-9153-27b34be57edd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 17:43:36.551804 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:43:36.551804 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:43:36.551804 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:43:36.551804 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:43:36.551804 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:43:36.551804 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:43:36.551804 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:43:36.551804 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:43:36.551804 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:43:36.551804 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:43:36.551804 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:43:36.551804 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:43:36.551804 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:43:36.551804 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:43:36.551804 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:43:36.552904 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:43:36.552904 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:43:36.552904 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:43:36.552904 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:43:36.552904 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:43:36.552904 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:43:36.552904 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:43:36.552904 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:43:36.552904 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:43:36.552904 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:43:36.552904 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:43:36.552904 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:43:36.552904 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:43:36.552904 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:43:36.552904 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:43:36.552904 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:43:36.553999 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:43:36.553999 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:43:36.553999 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:43:36.553999 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:43:36.553999 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:43:36.553999 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:43:36.553999 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:43:36.553999 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:43:36.553999 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:43:36.553999 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:43:36.553999 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 17:43:36.553999 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:43:36.553999 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 634/1263] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 14 17:43:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:43:36.559145 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f44bf8-1d94-4fca-801b-0a1801309cc6 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:43:36.580899 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:43:36.661713 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f44bf8-1d94-4fca-801b-0a1801309cc6 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:43:36.695592 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4717e983-1e2b-4a61-9d6a-ef6ea10a70f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:43:36.696276 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4717e983-1e2b-4a61-9d6a-ef6ea10a70f5 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:36.696559 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4717e983-1e2b-4a61-9d6a-ef6ea10a70f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:36.696831 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4717e983-1e2b-4a61-9d6a-ef6ea10a70f5 None admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:36.697613 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4717e983-1e2b-4a61-9d6a-ef6ea10a70f5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:43:36.697919 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4717e983-1e2b-4a61-9d6a-ef6ea10a70f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:43:36.699295 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4717e983-1e2b-4a61-9d6a-ef6ea10a70f5 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:43:36.708527 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 630/1264] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 14 17:43:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:43:36.720951 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49d048a-f08d-41c5-9153-27b34be57edd None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:43:36.792991 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:43:36.827382 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49d048a-f08d-41c5-9153-27b34be57edd None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:43:36.860426 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e2e0f2-68c5-48dc-9050-3fbbb1c940f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:43:36.861227 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e2e0f2-68c5-48dc-9050-3fbbb1c940f5 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:36.861512 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e2e0f2-68c5-48dc-9050-3fbbb1c940f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:36.861823 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e2e0f2-68c5-48dc-9050-3fbbb1c940f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:36.872716 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e2e0f2-68c5-48dc-9050-3fbbb1c940f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:43:36.874704 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e2e0f2-68c5-48dc-9050-3fbbb1c940f5 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:43:36.892678 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-53e2e0f2-68c5-48dc-9050-3fbbb1c940f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:43:36.892678 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:43:36.892678 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:43:36.892678 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:43:36.892678 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:43:36.892678 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:43:36.892678 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:43:36.892678 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:43:36.892678 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:43:36.892678 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:43:36.892678 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:43:36.892678 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:43:36.892678 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:43:36.892678 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:43:36.892678 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:43:36.893855 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:43:36.893855 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:43:36.893855 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:43:36.893855 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:43:36.893855 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:43:36.893855 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:43:36.893855 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:43:36.893855 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:43:36.893855 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:43:36.893855 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:43:36.893855 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:43:36.893855 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:43:36.893855 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:43:36.893855 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:43:36.893855 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:43:36.893855 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:43:36.893855 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:43:36.895143 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:43:36.895143 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:43:36.895143 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:43:36.895143 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:43:36.895143 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 635/1265] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:43:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:43:36.899689 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4717e983-1e2b-4a61-9d6a-ef6ea10a70f5 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:43:36.983909 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:43:37.007453 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4717e983-1e2b-4a61-9d6a-ef6ea10a70f5 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:43:37.042747 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a1558e-ebd3-48df-ab3c-2753d3c506f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:43:37.043474 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a1558e-ebd3-48df-ab3c-2753d3c506f5 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:37.043701 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a1558e-ebd3-48df-ab3c-2753d3c506f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:37.043975 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a1558e-ebd3-48df-ab3c-2753d3c506f5 None admin] PATH_INFO: `/v3/domains` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:37.044703 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a1558e-ebd3-48df-ab3c-2753d3c506f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:43:37.045584 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a1558e-ebd3-48df-ab3c-2753d3c506f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:43:37.046988 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a1558e-ebd3-48df-ab3c-2753d3c506f5 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:43:37.060017 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 631/1266] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 14 17:43:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:43:37.066702 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e2e0f2-68c5-48dc-9050-3fbbb1c940f5 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:43:37.173170 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e2e0f2-68c5-48dc-9050-3fbbb1c940f5 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:43:37.193875 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:43:37.208170 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4c537a-479e-4ceb-9727-00afd21f6f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:43:37.208979 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c537a-479e-4ceb-9727-00afd21f6f43 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:37.209261 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c537a-479e-4ceb-9727-00afd21f6f43 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:37.209551 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c537a-479e-4ceb-9727-00afd21f6f43 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:37.218101 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4c537a-479e-4ceb-9727-00afd21f6f43 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:43:37.219548 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4c537a-479e-4ceb-9727-00afd21f6f43 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:43:37.234632 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-fc4c537a-479e-4ceb-9727-00afd21f6f43 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 14 17:43:37.234632 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:43:37.234632 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:43:37.234632 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:43:37.234632 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:43:37.234632 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:43:37.234632 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:43:37.234632 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:43:37.234632 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:43:37.234632 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:43:37.234632 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:43:37.234632 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:43:37.234632 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 17:43:37.234632 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 17:43:37.234632 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 17:43:37.234632 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 17:43:37.235777 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:43:37.235777 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:43:37.235777 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 17:43:37.235777 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:43:37.235777 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 17:43:37.235777 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:43:37.235777 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:43:37.235777 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:43:37.235777 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:43:37.235777 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:43:37.235777 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:43:37.235777 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:43:37.235777 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:43:37.235777 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:43:37.235777 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:43:37.235777 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:43:37.235777 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:43:37.235777 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:43:37.237156 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:43:37.237156 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:43:37.237156 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 17:43:37.237156 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 17:43:37.237156 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 17:43:37.237156 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 17:43:37.237156 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 17:43:37.237156 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 17:43:37.237156 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 14 17:43:37.237156 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:43:37.237156 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 636/1267] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:43:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:43:37.242304 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a1558e-ebd3-48df-ab3c-2753d3c506f5 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:43:37.346166 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a1558e-ebd3-48df-ab3c-2753d3c506f5 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:43:37.382264 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753ed822-6a85-466f-800f-0e8fae5e0871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:43:37.382945 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753ed822-6a85-466f-800f-0e8fae5e0871 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:37.383229 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753ed822-6a85-466f-800f-0e8fae5e0871 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:37.383510 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753ed822-6a85-466f-800f-0e8fae5e0871 None admin] PATH_INFO: `/v3/users` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:37.384360 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753ed822-6a85-466f-800f-0e8fae5e0871 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:43:37.384669 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753ed822-6a85-466f-800f-0e8fae5e0871 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:43:37.386143 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753ed822-6a85-466f-800f-0e8fae5e0871 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:43:37.395896 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:43:37.406386 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 632/1268] 10.222.0.67 () {56 vars in 1143 bytes} [Thu Jul 14 17:43:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:43:37.412104 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4c537a-479e-4ceb-9727-00afd21f6f43 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:43:37.518278 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4c537a-479e-4ceb-9727-00afd21f6f43 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:43:37.553929 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec69bee-c7ad-4560-be0a-059d9eb6fc13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:43:37.554747 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec69bee-c7ad-4560-be0a-059d9eb6fc13 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:37.555034 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec69bee-c7ad-4560-be0a-059d9eb6fc13 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:37.555313 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec69bee-c7ad-4560-be0a-059d9eb6fc13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:37.567121 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec69bee-c7ad-4560-be0a-059d9eb6fc13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:43:37.568579 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec69bee-c7ad-4560-be0a-059d9eb6fc13 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:43:37.586828 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-eec69bee-c7ad-4560-be0a-059d9eb6fc13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:43:37.586828 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:43:37.586828 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:43:37.586828 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:43:37.586828 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:43:37.586828 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:43:37.586828 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:43:37.586828 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:43:37.586828 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:43:37.586828 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:43:37.586828 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:43:37.586828 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:43:37.586828 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:43:37.586828 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:43:37.586828 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:43:37.587979 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:43:37.587979 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:43:37.587979 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:43:37.587979 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:43:37.587979 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:43:37.587979 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:43:37.587979 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:43:37.587979 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:43:37.587979 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:43:37.587979 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:43:37.587979 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:43:37.587979 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:43:37.587979 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:43:37.587979 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:43:37.587979 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:43:37.587979 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:43:37.587979 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:43:37.588932 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:43:37.588932 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:43:37.588932 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:43:37.588932 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:43:37.588932 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 637/1269] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:43:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:43:37.593785 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753ed822-6a85-466f-800f-0e8fae5e0871 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:43:37.694507 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753ed822-6a85-466f-800f-0e8fae5e0871 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:43:37.728924 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0126ad79-0921-42ae-a8a1-5957fad05b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:43:37.729622 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126ad79-0921-42ae-a8a1-5957fad05b39 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:37.729912 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126ad79-0921-42ae-a8a1-5957fad05b39 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:37.730190 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126ad79-0921-42ae-a8a1-5957fad05b39 None admin] PATH_INFO: `/v3/domains` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:37.730924 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0126ad79-0921-42ae-a8a1-5957fad05b39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:43:37.731234 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0126ad79-0921-42ae-a8a1-5957fad05b39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:43:37.732665 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0126ad79-0921-42ae-a8a1-5957fad05b39 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:43:37.745478 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 633/1270] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 14 17:43:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:43:37.751641 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec69bee-c7ad-4560-be0a-059d9eb6fc13 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:43:37.793264 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:43:37.862580 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec69bee-c7ad-4560-be0a-059d9eb6fc13 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:43:37.898892 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc61e66-f5d1-42c5-9d70-c20e38baaf54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:43:37.899717 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc61e66-f5d1-42c5-9d70-c20e38baaf54 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:37.900000 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc61e66-f5d1-42c5-9d70-c20e38baaf54 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:37.900279 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc61e66-f5d1-42c5-9d70-c20e38baaf54 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:37.906971 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc61e66-f5d1-42c5-9d70-c20e38baaf54 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:43:37.908414 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc61e66-f5d1-42c5-9d70-c20e38baaf54 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:43:37.923805 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-7cc61e66-f5d1-42c5-9d70-c20e38baaf54 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:43:37.923805 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:43:37.923805 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:43:37.923805 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:43:37.923805 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:43:37.923805 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:43:37.923805 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:43:37.923805 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:43:37.923805 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:43:37.923805 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:43:37.923805 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:43:37.923805 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:43:37.923805 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 17:43:37.923805 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 17:43:37.923805 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 17:43:37.924888 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 17:43:37.924888 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:43:37.924888 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:43:37.924888 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:43:37.924888 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:43:37.924888 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:43:37.924888 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:43:37.924888 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:43:37.924888 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:43:37.924888 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:43:37.924888 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:43:37.924888 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:43:37.924888 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:43:37.924888 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:43:37.924888 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:43:37.924888 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:43:37.924888 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:43:37.930521 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 17:43:37.930521 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 17:43:37.930521 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 17:43:37.930521 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 17:43:37.930521 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 17:43:37.930521 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 17:43:37.930521 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:43:37.930521 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:43:37.930521 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 638/1271] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 14 17:43:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:43:37.931131 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0126ad79-0921-42ae-a8a1-5957fad05b39 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:43:37.987577 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:43:38.029540 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0126ad79-0921-42ae-a8a1-5957fad05b39 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:43:38.062769 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820e1f75-8266-4b57-b555-a8320082d703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:43:38.063425 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820e1f75-8266-4b57-b555-a8320082d703 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:38.063711 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820e1f75-8266-4b57-b555-a8320082d703 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:38.063992 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820e1f75-8266-4b57-b555-a8320082d703 None admin] PATH_INFO: `/v3/projects` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:38.064774 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820e1f75-8266-4b57-b555-a8320082d703 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:43:38.065085 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820e1f75-8266-4b57-b555-a8320082d703 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:43:38.066550 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820e1f75-8266-4b57-b555-a8320082d703 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:43:38.080129 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 634/1272] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 14 17:43:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:43:38.086090 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc61e66-f5d1-42c5-9d70-c20e38baaf54 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:43:38.179186 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:43:38.188221 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc61e66-f5d1-42c5-9d70-c20e38baaf54 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:43:38.222961 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dfd4f6-8837-4d35-b166-e9f29e298ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:43:38.223853 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dfd4f6-8837-4d35-b166-e9f29e298ed2 None admin] REQUEST_METHOD: `PUT` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:38.224132 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dfd4f6-8837-4d35-b166-e9f29e298ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:38.224402 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dfd4f6-8837-4d35-b166-e9f29e298ed2 None admin] PATH_INFO: `/v3/projects/39a570421bb64fac8b1a0129f1bcc7d9/users/5324ab45f4a4449980dad920278f5034/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:38.226394 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dfd4f6-8837-4d35-b166-e9f29e298ed2 None admin] RBAC: Authorizing `identity:create_grant(project_id=39a570421bb64fac8b1a0129f1bcc7d9, user_id=5324ab45f4a4449980dad920278f5034, role_id=4651a1cc7b4d4ab7a7a9ca1e77e58e71)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:43:38.227817 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dfd4f6-8837-4d35-b166-e9f29e298ed2 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:43:38.241841 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 639/1273] 10.222.0.67 () {58 vars in 1439 bytes} [Thu Jul 14 17:43:38 2022] PUT /identity/v3/projects/39a570421bb64fac8b1a0129f1bcc7d9/users/5324ab45f4a4449980dad920278f5034/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:43:40.312118 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f47221-a2b9-4744-b317-c5f760d761af None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:40.312696 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f47221-a2b9-4744-b317-c5f760d761af None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:40.312696 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f47221-a2b9-4744-b317-c5f760d761af None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:40.314197 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 635/1274] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:43:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:43:40.319782 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec2d4f-6c20-4525-8436-1531db84ce9e None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:40.320216 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec2d4f-6c20-4525-8436-1531db84ce9e None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:40.320328 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec2d4f-6c20-4525-8436-1531db84ce9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:40.337443 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-4eec2d4f-6c20-4525-8436-1531db84ce9e None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:43:40.338676 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-4eec2d4f-6c20-4525-8436-1531db84ce9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:43:40.414663 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 640/1275] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:43:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 17:43:40.438258 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f47221-a2b9-4744-b317-c5f760d761af None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:43:40.551735 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f47221-a2b9-4744-b317-c5f760d761af None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:43:40.571051 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:43:40.589655 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a032f7-14bc-4685-8d84-927b6898538a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:43:40.590469 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a032f7-14bc-4685-8d84-927b6898538a None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:40.590756 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a032f7-14bc-4685-8d84-927b6898538a None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:40.591034 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a032f7-14bc-4685-8d84-927b6898538a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:40.602946 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a032f7-14bc-4685-8d84-927b6898538a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 17:43:40.611073 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-54a032f7-14bc-4685-8d84-927b6898538a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 17:43:40.611073 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:43:40.611073 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:43:40.611073 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:43:40.611073 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:43:40.611073 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:43:40.611073 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:43:40.611073 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:43:40.611073 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:43:40.611073 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:43:40.611073 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:43:40.611073 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:43:40.611073 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 17:43:40.611073 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 17:43:40.611073 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 17:43:40.611073 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 17:43:40.612901 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 17:43:40.612901 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 17:43:40.612901 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 17:43:40.612901 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 17:43:40.612901 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:43:40.612901 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:43:40.612901 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:43:40.612901 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:43:40.612901 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:43:40.612901 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:43:40.612901 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:43:40.612901 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:43:40.612901 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:43:40.612901 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:43:40.612901 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:43:40.612901 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:43:40.614598 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:43:40.614598 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:43:40.614598 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:43:40.614598 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:43:40.614598 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 17:43:40.614598 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 17:43:40.614598 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 17:43:40.614598 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 17:43:40.614598 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 17:43:40.614598 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 17:43:40.614598 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 17:43:40.614598 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:43:40.614598 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 636/1276] 10.222.0.67 () {56 vars in 1096 bytes} [Thu Jul 14 17:43:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:43:40.620761 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eec2d4f-6c20-4525-8436-1531db84ce9e None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:43:40.753000 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:43:40.786074 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eec2d4f-6c20-4525-8436-1531db84ce9e None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:43:40.843515 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b69053-f95e-48f1-9ea6-2332e5e0cba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:43:40.844501 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b69053-f95e-48f1-9ea6-2332e5e0cba2 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:40.844911 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b69053-f95e-48f1-9ea6-2332e5e0cba2 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:40.845458 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b69053-f95e-48f1-9ea6-2332e5e0cba2 None admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:40.846848 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b69053-f95e-48f1-9ea6-2332e5e0cba2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:43:40.847257 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b69053-f95e-48f1-9ea6-2332e5e0cba2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:43:40.849640 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b69053-f95e-48f1-9ea6-2332e5e0cba2 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:43:40.860852 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 641/1277] 10.222.0.67 () {56 vars in 1099 bytes} [Thu Jul 14 17:43:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:43:40.869328 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a032f7-14bc-4685-8d84-927b6898538a None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:43:40.979858 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a032f7-14bc-4685-8d84-927b6898538a None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:43:41.015796 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dfb464-4bde-467f-8f54-aeaf56555e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:43:41.016608 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dfb464-4bde-467f-8f54-aeaf56555e0f None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:41.016892 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dfb464-4bde-467f-8f54-aeaf56555e0f None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:41.017166 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dfb464-4bde-467f-8f54-aeaf56555e0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:41.028540 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dfb464-4bde-467f-8f54-aeaf56555e0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:43:41.030124 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dfb464-4bde-467f-8f54-aeaf56555e0f None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:43:41.048315 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-d0dfb464-4bde-467f-8f54-aeaf56555e0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:43:41.048315 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:43:41.048315 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:43:41.048315 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:43:41.048315 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:43:41.048315 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:43:41.048315 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:43:41.048315 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:43:41.048315 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:43:41.048315 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:43:41.048315 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:43:41.048315 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:43:41.048315 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:43:41.048315 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:43:41.048315 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:43:41.049988 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:43:41.049988 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:43:41.049988 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:43:41.049988 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:43:41.049988 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:43:41.049988 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:43:41.049988 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:43:41.049988 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:43:41.049988 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:43:41.049988 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:43:41.049988 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:43:41.049988 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:43:41.049988 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:43:41.049988 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:43:41.049988 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:43:41.049988 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:43:41.049988 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:43:41.050996 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:43:41.050996 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:43:41.050996 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:43:41.050996 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:43:41.050996 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 637/1278] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:43:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:43:41.058582 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b69053-f95e-48f1-9ea6-2332e5e0cba2 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:43:41.176784 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b69053-f95e-48f1-9ea6-2332e5e0cba2 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:43:41.213962 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f9aaf6-c779-40fc-9d4f-223b5ff3c32c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:43:41.214642 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f9aaf6-c779-40fc-9d4f-223b5ff3c32c None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:41.214929 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f9aaf6-c779-40fc-9d4f-223b5ff3c32c None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:41.215206 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f9aaf6-c779-40fc-9d4f-223b5ff3c32c None admin] PATH_INFO: `/v3/domains` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:41.215947 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f9aaf6-c779-40fc-9d4f-223b5ff3c32c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:43:41.216254 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f9aaf6-c779-40fc-9d4f-223b5ff3c32c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:43:41.218263 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f9aaf6-c779-40fc-9d4f-223b5ff3c32c None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:43:41.231680 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 642/1279] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 14 17:43:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:43:41.240330 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dfb464-4bde-467f-8f54-aeaf56555e0f None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:43:41.277135 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:43:41.355130 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dfb464-4bde-467f-8f54-aeaf56555e0f None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:43:41.391014 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be033e9a-cb13-4442-ad98-650c3b112343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:43:41.391883 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be033e9a-cb13-4442-ad98-650c3b112343 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:41.392216 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be033e9a-cb13-4442-ad98-650c3b112343 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:41.392538 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be033e9a-cb13-4442-ad98-650c3b112343 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:41.401629 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be033e9a-cb13-4442-ad98-650c3b112343 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:43:41.403094 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be033e9a-cb13-4442-ad98-650c3b112343 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:43:41.419442 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-be033e9a-cb13-4442-ad98-650c3b112343 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 14 17:43:41.419442 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:43:41.419442 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:43:41.419442 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:43:41.419442 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:43:41.419442 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:43:41.419442 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:43:41.419442 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:43:41.419442 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:43:41.419442 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:43:41.419442 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:43:41.419442 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:43:41.419442 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 17:43:41.419442 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 17:43:41.419442 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 17:43:41.419442 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 17:43:41.421233 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:43:41.421233 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:43:41.421233 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 17:43:41.421233 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:43:41.421233 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 17:43:41.421233 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 17:43:41.421233 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:43:41.421233 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:43:41.421233 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:43:41.421233 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:43:41.421233 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:43:41.421233 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:43:41.421233 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:43:41.421233 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:43:41.421233 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:43:41.421233 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:43:41.421233 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:43:41.421233 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:43:41.423087 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:43:41.423087 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:43:41.423087 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 17:43:41.423087 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 17:43:41.423087 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 17:43:41.423087 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 17:43:41.423087 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 17:43:41.423087 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 17:43:41.423087 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 14 17:43:41.423087 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:43:41.423087 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 638/1280] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:43:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:43:41.426989 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f9aaf6-c779-40fc-9d4f-223b5ff3c32c None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:43:41.430876 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:43:41.553116 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f9aaf6-c779-40fc-9d4f-223b5ff3c32c None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:43:41.588126 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5461c0ad-e1ee-45ad-a1e5-6b725f9c900a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:43:41.588811 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5461c0ad-e1ee-45ad-a1e5-6b725f9c900a None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:41.589093 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5461c0ad-e1ee-45ad-a1e5-6b725f9c900a None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:41.589366 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5461c0ad-e1ee-45ad-a1e5-6b725f9c900a None admin] PATH_INFO: `/v3/users` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:41.590257 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5461c0ad-e1ee-45ad-a1e5-6b725f9c900a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:43:41.590569 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5461c0ad-e1ee-45ad-a1e5-6b725f9c900a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:43:41.592562 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5461c0ad-e1ee-45ad-a1e5-6b725f9c900a None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:43:41.613155 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 643/1281] 10.222.0.67 () {56 vars in 1143 bytes} [Thu Jul 14 17:43:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:43:41.619303 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be033e9a-cb13-4442-ad98-650c3b112343 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:43:41.718845 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:43:41.729039 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be033e9a-cb13-4442-ad98-650c3b112343 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:43:41.772648 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2a442c-5e91-4349-b1f0-c12ee53699c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:43:41.773763 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2a442c-5e91-4349-b1f0-c12ee53699c3 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:41.774241 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2a442c-5e91-4349-b1f0-c12ee53699c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:41.774616 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2a442c-5e91-4349-b1f0-c12ee53699c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:41.848316 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2a442c-5e91-4349-b1f0-c12ee53699c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:43:41.849803 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2a442c-5e91-4349-b1f0-c12ee53699c3 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:43:41.944237 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:43:41.955297 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 639/1282] 10.222.0.67 () {58 vars in 1282 bytes} [Thu Jul 14 17:43:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 17:43:41.964252 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5461c0ad-e1ee-45ad-a1e5-6b725f9c900a None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:43:42.035800 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:43:42.075530 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5461c0ad-e1ee-45ad-a1e5-6b725f9c900a None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:43:42.113093 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a8e378-f6e8-4853-838e-2128804a445d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:43:42.113957 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a8e378-f6e8-4853-838e-2128804a445d None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:42.114235 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a8e378-f6e8-4853-838e-2128804a445d None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:42.114575 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a8e378-f6e8-4853-838e-2128804a445d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:42.126622 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a8e378-f6e8-4853-838e-2128804a445d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:43:42.128162 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a8e378-f6e8-4853-838e-2128804a445d None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:43:42.147886 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-56a8e378-f6e8-4853-838e-2128804a445d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:43:42.147886 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:43:42.147886 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:43:42.147886 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:43:42.147886 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:43:42.147886 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:43:42.147886 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:43:42.147886 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:43:42.147886 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:43:42.147886 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:43:42.147886 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:43:42.147886 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:43:42.147886 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 17:43:42.147886 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 17:43:42.147886 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 17:43:42.149685 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 17:43:42.149685 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:43:42.149685 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:43:42.149685 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:43:42.149685 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:43:42.149685 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:43:42.149685 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:43:42.149685 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:43:42.149685 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:43:42.149685 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:43:42.149685 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:43:42.149685 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:43:42.149685 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:43:42.149685 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:43:42.149685 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:43:42.149685 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:43:42.149685 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:43:42.151877 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 17:43:42.151877 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 17:43:42.151877 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 17:43:42.151877 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:43:42.151877 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 644/1283] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:43:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:43:42.157233 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2a442c-5e91-4349-b1f0-c12ee53699c3 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:43:42.260452 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2a442c-5e91-4349-b1f0-c12ee53699c3 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:43:42.298606 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1ba787-123a-4ab9-bb68-19d2e32858fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:43:42.299191 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ba787-123a-4ab9-bb68-19d2e32858fb None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:42.299476 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ba787-123a-4ab9-bb68-19d2e32858fb None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:42.299755 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ba787-123a-4ab9-bb68-19d2e32858fb None admin] PATH_INFO: `/v3/domains` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:42.300490 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1ba787-123a-4ab9-bb68-19d2e32858fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:43:42.300798 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1ba787-123a-4ab9-bb68-19d2e32858fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:43:42.302221 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1ba787-123a-4ab9-bb68-19d2e32858fb None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:43:42.314990 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 640/1284] 10.222.0.67 () {56 vars in 1109 bytes} [Thu Jul 14 17:43:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:43:42.320850 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a8e378-f6e8-4853-838e-2128804a445d None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:43:42.459108 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a8e378-f6e8-4853-838e-2128804a445d None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:43:42.483263 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:43:42.517769 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b08aec-1f18-452f-bb6b-8a1b2f71dc10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:43:42.519106 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b08aec-1f18-452f-bb6b-8a1b2f71dc10 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:42.519589 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b08aec-1f18-452f-bb6b-8a1b2f71dc10 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:42.520072 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b08aec-1f18-452f-bb6b-8a1b2f71dc10 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:42.532476 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b08aec-1f18-452f-bb6b-8a1b2f71dc10 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:43:42.535005 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b08aec-1f18-452f-bb6b-8a1b2f71dc10 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:43:42.561360 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application [None req-78b08aec-1f18-452f-bb6b-8a1b2f71dc10 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:43:42.561360 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:43:42.561360 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:43:42.561360 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:43:42.561360 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:43:42.561360 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:43:42.561360 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:43:42.561360 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:43:42.561360 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:43:42.561360 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:43:42.561360 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:43:42.561360 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:43:42.561360 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 17:43:42.561360 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 17:43:42.561360 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 17:43:42.562537 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 17:43:42.562537 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:43:42.562537 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:43:42.562537 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:43:42.562537 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:43:42.562537 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:43:42.562537 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:43:42.562537 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:43:42.562537 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application with Lock( Jul 14 17:43:42.562537 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:43:42.562537 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:43:42.562537 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:43:42.562537 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:43:42.562537 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:43:42.562537 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:43:42.562537 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:43:42.562537 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:43:42.563650 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 17:43:42.563650 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 17:43:42.563650 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 17:43:42.563650 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 17:43:42.563650 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 17:43:42.563650 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 17:43:42.563650 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 17:43:42.563650 dv-cinder-849890-1-smb devstack@keystone.service[86773]: ERROR keystone.server.flask.application Jul 14 17:43:42.564190 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 645/1285] 10.222.0.67 () {56 vars in 1111 bytes} [Thu Jul 14 17:43:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 17:43:42.570552 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1ba787-123a-4ab9-bb68-19d2e32858fb None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:43:42.659774 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:43:42.720414 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1ba787-123a-4ab9-bb68-19d2e32858fb None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:43:42.763818 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b6a46d-c5ed-492d-9902-541a985c630e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:43:42.764648 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b6a46d-c5ed-492d-9902-541a985c630e None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:42.765072 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b6a46d-c5ed-492d-9902-541a985c630e None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:42.765424 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b6a46d-c5ed-492d-9902-541a985c630e None admin] PATH_INFO: `/v3/projects` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:42.766415 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b6a46d-c5ed-492d-9902-541a985c630e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:43:42.766767 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b6a46d-c5ed-492d-9902-541a985c630e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:43:42.768267 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b6a46d-c5ed-492d-9902-541a985c630e None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:43:42.782015 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 641/1286] 10.222.0.67 () {56 vars in 1148 bytes} [Thu Jul 14 17:43:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:43:42.791403 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b08aec-1f18-452f-bb6b-8a1b2f71dc10 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:43:42.898274 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b08aec-1f18-452f-bb6b-8a1b2f71dc10 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:43:42.933666 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1ed984-c840-4550-a494-32220af9b1ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:43:42.934340 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ed984-c840-4550-a494-32220af9b1ab None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:42.934627 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ed984-c840-4550-a494-32220af9b1ab None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:42.934929 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ed984-c840-4550-a494-32220af9b1ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:42.936292 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1ed984-c840-4550-a494-32220af9b1ab None admin] RBAC: Adding query filter params (role.id=4651a1cc7b4d4ab7a7a9ca1e77e58e71, scope.project.id=39a570421bb64fac8b1a0129f1bcc7d9, user.id=5324ab45f4a4449980dad920278f5034) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:43:42.936605 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1ed984-c840-4550-a494-32220af9b1ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:43:42.938111 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1ed984-c840-4550-a494-32220af9b1ab None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:43:42.944376 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 646/1287] 10.222.0.67 () {56 vars in 1374 bytes} [Thu Jul 14 17:43:42 2022] GET /identity/v3/role_assignments?user.id=5324ab45f4a4449980dad920278f5034&scope.project.id=39a570421bb64fac8b1a0129f1bcc7d9&role.id=4651a1cc7b4d4ab7a7a9ca1e77e58e71 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:43:45.132879 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1866bf7d-3f7f-476d-9c06-9b41537a98ca None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:45.133459 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1866bf7d-3f7f-476d-9c06-9b41537a98ca None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:45.133459 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1866bf7d-3f7f-476d-9c06-9b41537a98ca None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:45.135017 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 642/1288] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:43:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 17:43:45.141620 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703f8cfe-f7bf-43bd-9d34-f06ee134bb29 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:45.142153 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703f8cfe-f7bf-43bd-9d34-f06ee134bb29 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:45.142309 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703f8cfe-f7bf-43bd-9d34-f06ee134bb29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:45.160085 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-703f8cfe-f7bf-43bd-9d34-f06ee134bb29 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:43:45.161300 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-703f8cfe-f7bf-43bd-9d34-f06ee134bb29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:43:45.194607 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:43:45.235691 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 647/1289] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:43:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 17:43:45.258874 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1866bf7d-3f7f-476d-9c06-9b41537a98ca None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:43:45.369841 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1866bf7d-3f7f-476d-9c06-9b41537a98ca None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:43:45.383771 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:43:45.409357 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f106a0e-b6a4-497c-b17a-0eada9e70314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:43:45.410203 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f106a0e-b6a4-497c-b17a-0eada9e70314 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:45.410487 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f106a0e-b6a4-497c-b17a-0eada9e70314 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:45.410762 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f106a0e-b6a4-497c-b17a-0eada9e70314 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:45.411422 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f106a0e-b6a4-497c-b17a-0eada9e70314 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:43:45.412791 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f106a0e-b6a4-497c-b17a-0eada9e70314 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:43:45.425746 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-8f106a0e-b6a4-497c-b17a-0eada9e70314 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 17:43:45.425746 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:43:45.425746 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 17:43:45.425746 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 17:43:45.425746 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 17:43:45.425746 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 17:43:45.425746 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 17:43:45.425746 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 17:43:45.425746 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 17:43:45.425746 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:43:45.425746 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 17:43:45.425746 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:43:45.425746 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:43:45.425746 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:43:45.425746 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:43:45.425746 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:43:45.425746 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:43:45.427647 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:43:45.427647 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:43:45.427647 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:43:45.427647 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:43:45.427647 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:43:45.427647 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:43:45.427647 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 17:43:45.427647 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 17:43:45.427647 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 17:43:45.427647 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 17:43:45.427647 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:43:45.427647 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:43:45.427647 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:43:45.427647 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:43:45.427647 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:43:45.427647 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:43:45.429363 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:43:45.429363 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:43:45.429363 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:43:45.429363 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:43:45.429363 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:43:45.429363 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:43:45.429363 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:43:45.429363 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:43:45.429363 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:43:45.429363 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:43:45.429363 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 17:43:45.429363 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 17:43:45.429363 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 17:43:45.429363 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:43:45.429363 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 643/1290] 10.222.0.67 () {56 vars in 1117 bytes} [Thu Jul 14 17:43:45 2022] GET /identity/v3/services/placement => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:43:45.433481 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703f8cfe-f7bf-43bd-9d34-f06ee134bb29 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:43:45.549471 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703f8cfe-f7bf-43bd-9d34-f06ee134bb29 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:43:45.586545 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910b3eec-174c-421b-9e8f-a8abee904257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:43:45.587213 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b3eec-174c-421b-9e8f-a8abee904257 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:45.587501 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b3eec-174c-421b-9e8f-a8abee904257 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:45.587781 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b3eec-174c-421b-9e8f-a8abee904257 None admin] PATH_INFO: `/v3/services` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:45.588507 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910b3eec-174c-421b-9e8f-a8abee904257 None admin] RBAC: Adding query filter params (name=placement) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:43:45.588814 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910b3eec-174c-421b-9e8f-a8abee904257 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:43:45.590249 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910b3eec-174c-421b-9e8f-a8abee904257 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:43:45.596188 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 648/1291] 10.222.0.67 () {56 vars in 1116 bytes} [Thu Jul 14 17:43:45 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:43:45.602055 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f106a0e-b6a4-497c-b17a-0eada9e70314 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:43:45.714853 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f106a0e-b6a4-497c-b17a-0eada9e70314 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:43:45.750492 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44b29b0-03a8-4188-b1ab-f2c3c9ffe0c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:43:45.751188 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44b29b0-03a8-4188-b1ab-f2c3c9ffe0c1 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:45.751472 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44b29b0-03a8-4188-b1ab-f2c3c9ffe0c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:45.751753 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44b29b0-03a8-4188-b1ab-f2c3c9ffe0c1 None admin] PATH_INFO: `/v3/services` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:45.752499 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44b29b0-03a8-4188-b1ab-f2c3c9ffe0c1 None admin] RBAC: Adding query filter params (type=placement) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:43:45.752822 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44b29b0-03a8-4188-b1ab-f2c3c9ffe0c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:43:45.755018 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44b29b0-03a8-4188-b1ab-f2c3c9ffe0c1 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:43:45.763800 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 644/1292] 10.222.0.67 () {56 vars in 1116 bytes} [Thu Jul 14 17:43:45 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:43:47.846783 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6147ddfb-2352-4f76-913c-33e598be2e4e None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:47.847297 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6147ddfb-2352-4f76-913c-33e598be2e4e None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:47.847297 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6147ddfb-2352-4f76-913c-33e598be2e4e None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:47.848599 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 649/1293] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:43:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:43:47.853800 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be1d325-0f19-4fc7-9fdb-3dc4ff77fadd None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:47.854210 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be1d325-0f19-4fc7-9fdb-3dc4ff77fadd None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:47.854345 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be1d325-0f19-4fc7-9fdb-3dc4ff77fadd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:47.871541 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-1be1d325-0f19-4fc7-9fdb-3dc4ff77fadd None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:43:47.872727 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-1be1d325-0f19-4fc7-9fdb-3dc4ff77fadd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:43:47.902374 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:43:47.941195 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 645/1294] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:43:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 17:43:47.963309 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6147ddfb-2352-4f76-913c-33e598be2e4e None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:43:47.995186 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:43:48.067856 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6147ddfb-2352-4f76-913c-33e598be2e4e None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:43:48.111455 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19df4b72-7a97-47f7-a127-c2878e4dfeea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:43:48.112128 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df4b72-7a97-47f7-a127-c2878e4dfeea None admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:48.112410 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df4b72-7a97-47f7-a127-c2878e4dfeea None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:48.112684 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df4b72-7a97-47f7-a127-c2878e4dfeea None admin] PATH_INFO: `/v3/services` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:48.113430 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19df4b72-7a97-47f7-a127-c2878e4dfeea None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:43:48.114829 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19df4b72-7a97-47f7-a127-c2878e4dfeea None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:43:48.130060 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 650/1295] 10.222.0.67 () {60 vars in 1141 bytes} [Thu Jul 14 17:43:47 2022] POST /identity/v3/services => generated 246 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:43:50.183602 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eed5ab-9881-4f20-b56d-badeb988f306 None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:50.184168 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eed5ab-9881-4f20-b56d-badeb988f306 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:50.184168 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eed5ab-9881-4f20-b56d-badeb988f306 None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:50.185518 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 646/1296] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:43:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 17:43:50.191227 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17a2113-c972-44ea-b5b4-0c1d204bb0a8 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:50.191682 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17a2113-c972-44ea-b5b4-0c1d204bb0a8 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:50.191790 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17a2113-c972-44ea-b5b4-0c1d204bb0a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:50.209281 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-b17a2113-c972-44ea-b5b4-0c1d204bb0a8 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:43:50.210528 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-b17a2113-c972-44ea-b5b4-0c1d204bb0a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:43:50.284877 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 651/1297] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:43:50 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 17:43:50.307648 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eed5ab-9881-4f20-b56d-badeb988f306 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:43:50.413245 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eed5ab-9881-4f20-b56d-badeb988f306 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:43:50.447826 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4e3fc5-4dc7-4a4a-821f-e2449dd83556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:43:50.448539 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4e3fc5-4dc7-4a4a-821f-e2449dd83556 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:50.448817 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4e3fc5-4dc7-4a4a-821f-e2449dd83556 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:50.449088 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4e3fc5-4dc7-4a4a-821f-e2449dd83556 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:50.449774 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4e3fc5-4dc7-4a4a-821f-e2449dd83556 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:43:50.451152 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4e3fc5-4dc7-4a4a-821f-e2449dd83556 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:43:50.466497 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-8f4e3fc5-4dc7-4a4a-821f-e2449dd83556 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 17:43:50.466497 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:43:50.466497 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 17:43:50.466497 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 17:43:50.466497 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 17:43:50.466497 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 17:43:50.466497 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 17:43:50.466497 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 17:43:50.466497 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 17:43:50.466497 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:43:50.466497 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 17:43:50.466497 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:43:50.466497 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:43:50.466497 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:43:50.466497 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:43:50.466497 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:43:50.466497 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:43:50.475702 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:43:50.475702 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:43:50.475702 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:43:50.475702 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:43:50.475702 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:43:50.475702 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:43:50.475702 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 17:43:50.475702 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 17:43:50.475702 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 17:43:50.475702 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 17:43:50.475702 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:43:50.475702 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:43:50.475702 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:43:50.475702 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:43:50.475702 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:43:50.475702 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:43:50.476908 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:43:50.476908 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:43:50.476908 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:43:50.476908 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:43:50.476908 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:43:50.476908 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:43:50.476908 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:43:50.476908 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:43:50.476908 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:43:50.476908 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:43:50.476908 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 17:43:50.476908 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 17:43:50.476908 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 17:43:50.476908 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:43:50.476908 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 647/1298] 10.222.0.67 () {56 vars in 1117 bytes} [Thu Jul 14 17:43:50 2022] GET /identity/v3/services/placement => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:43:50.478041 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17a2113-c972-44ea-b5b4-0c1d204bb0a8 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:43:50.493520 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:43:50.577797 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17a2113-c972-44ea-b5b4-0c1d204bb0a8 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:43:50.611711 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f40b55-89ea-4774-80c8-16294fa59ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:43:50.612386 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f40b55-89ea-4774-80c8-16294fa59ee0 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:50.612669 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f40b55-89ea-4774-80c8-16294fa59ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:50.612947 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f40b55-89ea-4774-80c8-16294fa59ee0 None admin] PATH_INFO: `/v3/services` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:50.613699 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f40b55-89ea-4774-80c8-16294fa59ee0 None admin] RBAC: Adding query filter params (name=placement) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:43:50.614009 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f40b55-89ea-4774-80c8-16294fa59ee0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:43:50.615379 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f40b55-89ea-4774-80c8-16294fa59ee0 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:43:50.620871 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 652/1299] 10.222.0.67 () {56 vars in 1116 bytes} [Thu Jul 14 17:43:50 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:43:50.627559 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4e3fc5-4dc7-4a4a-821f-e2449dd83556 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:43:50.660565 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:43:50.746306 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4e3fc5-4dc7-4a4a-821f-e2449dd83556 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:43:50.789479 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1934a3be-a73d-4455-b740-88716257a874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:43:50.790188 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1934a3be-a73d-4455-b740-88716257a874 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:50.790478 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1934a3be-a73d-4455-b740-88716257a874 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:50.790843 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1934a3be-a73d-4455-b740-88716257a874 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:50.791781 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1934a3be-a73d-4455-b740-88716257a874 None admin] RBAC: Adding query filter params (interface=public, service_id=86c50ade24ea4b74991437ecf10777c6, region_id=RegionOne) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:43:50.792100 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1934a3be-a73d-4455-b740-88716257a874 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:43:50.793788 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1934a3be-a73d-4455-b740-88716257a874 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:43:50.801614 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 648/1300] 10.222.0.67 () {56 vars in 1251 bytes} [Thu Jul 14 17:43:50 2022] GET /identity/v3/endpoints?service_id=86c50ade24ea4b74991437ecf10777c6&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:43:50.810598 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f40b55-89ea-4774-80c8-16294fa59ee0 None admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:43:50.901968 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:43:50.919875 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f40b55-89ea-4774-80c8-16294fa59ee0 None admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:43:50.953240 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ffd041-4eeb-46f1-8925-2a4acb99eef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:43:50.953930 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ffd041-4eeb-46f1-8925-2a4acb99eef8 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:50.954212 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ffd041-4eeb-46f1-8925-2a4acb99eef8 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:50.954485 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ffd041-4eeb-46f1-8925-2a4acb99eef8 None admin] PATH_INFO: `/v3/services` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:50.955157 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ffd041-4eeb-46f1-8925-2a4acb99eef8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:43:50.956509 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ffd041-4eeb-46f1-8925-2a4acb99eef8 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:43:50.963163 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 653/1301] 10.222.0.67 () {56 vars in 1087 bytes} [Thu Jul 14 17:43:50 2022] GET /identity/v3/services => generated 2191 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 17:43:53.042089 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c021aa0-7ad6-48c2-9467-feea96e48604 None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:53.042947 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c021aa0-7ad6-48c2-9467-feea96e48604 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:53.042947 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c021aa0-7ad6-48c2-9467-feea96e48604 None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:53.044615 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 649/1302] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:43:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:43:53.051412 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f825bd-fe1d-4a7d-af14-1f2d1c8ba3d4 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:53.051962 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f825bd-fe1d-4a7d-af14-1f2d1c8ba3d4 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:53.051962 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f825bd-fe1d-4a7d-af14-1f2d1c8ba3d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:53.070394 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-e5f825bd-fe1d-4a7d-af14-1f2d1c8ba3d4 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:43:53.071622 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-e5f825bd-fe1d-4a7d-af14-1f2d1c8ba3d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:43:53.142511 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 654/1303] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:43:53 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 17:43:53.166597 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c021aa0-7ad6-48c2-9467-feea96e48604 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:43:53.267739 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:43:53.275449 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c021aa0-7ad6-48c2-9467-feea96e48604 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:43:53.313908 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c4fe27-e220-4fbc-9f42-d5654f23c2d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:43:53.314634 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c4fe27-e220-4fbc-9f42-d5654f23c2d5 None admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:53.314919 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c4fe27-e220-4fbc-9f42-d5654f23c2d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:53.315195 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c4fe27-e220-4fbc-9f42-d5654f23c2d5 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:53.315862 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c4fe27-e220-4fbc-9f42-d5654f23c2d5 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:43:53.317238 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c4fe27-e220-4fbc-9f42-d5654f23c2d5 None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:43:53.330711 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application [None req-46c4fe27-e220-4fbc-9f42-d5654f23c2d5 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 17:43:53.330711 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:43:53.330711 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 17:43:53.330711 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 17:43:53.330711 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 17:43:53.330711 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 17:43:53.330711 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 17:43:53.330711 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 17:43:53.330711 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 17:43:53.330711 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:43:53.330711 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 17:43:53.330711 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:43:53.330711 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 17:43:53.330711 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 17:43:53.330711 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 17:43:53.330711 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 17:43:53.330711 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 17:43:53.332598 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 17:43:53.332598 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 17:43:53.332598 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 17:43:53.332598 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 17:43:53.332598 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 17:43:53.332598 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 17:43:53.332598 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 17:43:53.332598 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 17:43:53.332598 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 17:43:53.332598 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 17:43:53.332598 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 17:43:53.332598 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 17:43:53.332598 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 17:43:53.332598 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 17:43:53.332598 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 17:43:53.332598 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 17:43:53.334220 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 17:43:53.334220 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application with Lock( Jul 14 17:43:53.334220 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 17:43:53.334220 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self._enter() Jul 14 17:43:53.334220 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 17:43:53.334220 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 17:43:53.334220 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 17:43:53.334220 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application return self.creator() Jul 14 17:43:53.334220 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 17:43:53.334220 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application created_value = creator( Jul 14 17:43:53.334220 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 17:43:53.334220 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 17:43:53.334220 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 17:43:53.334220 dv-cinder-849890-1-smb devstack@keystone.service[86772]: ERROR keystone.server.flask.application Jul 14 17:43:53.334220 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 650/1304] 10.222.0.67 () {56 vars in 1117 bytes} [Thu Jul 14 17:43:53 2022] GET /identity/v3/services/placement => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 17:43:53.338767 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f825bd-fe1d-4a7d-af14-1f2d1c8ba3d4 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:43:53.416174 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:43:53.440974 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f825bd-fe1d-4a7d-af14-1f2d1c8ba3d4 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:43:53.479075 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1377291f-e84d-44f6-b128-9153a477ac69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:43:53.479791 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1377291f-e84d-44f6-b128-9153a477ac69 None admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:53.480031 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1377291f-e84d-44f6-b128-9153a477ac69 None admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:53.480305 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1377291f-e84d-44f6-b128-9153a477ac69 None admin] PATH_INFO: `/v3/services` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:53.481020 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1377291f-e84d-44f6-b128-9153a477ac69 None admin] RBAC: Adding query filter params (name=placement) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:43:53.481328 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1377291f-e84d-44f6-b128-9153a477ac69 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:43:53.482737 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1377291f-e84d-44f6-b128-9153a477ac69 None admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:43:53.488185 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 655/1305] 10.222.0.67 () {56 vars in 1116 bytes} [Thu Jul 14 17:43:53 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:43:53.494405 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c4fe27-e220-4fbc-9f42-d5654f23c2d5 None admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:43:53.597802 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c4fe27-e220-4fbc-9f42-d5654f23c2d5 None admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:43:53.633048 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ae48c6-fb5d-4f8a-8b0c-27f7b2ac975c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:43:53.633738 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ae48c6-fb5d-4f8a-8b0c-27f7b2ac975c None admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:43:53.634024 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ae48c6-fb5d-4f8a-8b0c-27f7b2ac975c None admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:43:53.634300 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ae48c6-fb5d-4f8a-8b0c-27f7b2ac975c None admin] PATH_INFO: `/v3/endpoints` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:43:53.635054 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ae48c6-fb5d-4f8a-8b0c-27f7b2ac975c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:43:53.636415 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ae48c6-fb5d-4f8a-8b0c-27f7b2ac975c None admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:43:53.655578 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 651/1306] 10.222.0.67 () {60 vars in 1144 bytes} [Thu Jul 14 17:43:53 2022] POST /identity/v3/endpoints => generated 331 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 17:44:03.485070 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=30 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:44:03.650759 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:45:00.464221 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747a4c2f-ffe3-42b1-90aa-7cb85a547ebb None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:45:00.464668 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747a4c2f-ffe3-42b1-90aa-7cb85a547ebb None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:45:00.464773 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747a4c2f-ffe3-42b1-90aa-7cb85a547ebb None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:45:00.471324 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 656/1307] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:45:00 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:45:00.473161 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c8f22e-f974-4276-9905-dc1f046a3c7e None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:45:00.473935 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c8f22e-f974-4276-9905-dc1f046a3c7e None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:45:00.474183 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c8f22e-f974-4276-9905-dc1f046a3c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:45:00.585370 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-c9c8f22e-f974-4276-9905-dc1f046a3c7e None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:45:00.586779 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-c9c8f22e-f974-4276-9905-dc1f046a3c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:45:00.754060 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 652/1308] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:45:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 17:45:00.815325 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f6eef-77cc-4384-a18d-f1874606f994 None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:45:00.815690 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f6eef-77cc-4384-a18d-f1874606f994 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:45:00.816144 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f6eef-77cc-4384-a18d-f1874606f994 None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:45:00.818140 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 657/1309] 10.222.0.67 () {54 vars in 964 bytes} [Thu Jul 14 17:45:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:45:00.825070 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff521e-76ed-4679-96da-e498c80881f1 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:45:00.825295 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff521e-76ed-4679-96da-e498c80881f1 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:45:00.825613 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff521e-76ed-4679-96da-e498c80881f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:45:00.925338 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-14ff521e-76ed-4679-96da-e498c80881f1 None None] MFA Rules not processed for user `7bda83c5499f43f9838fda2679a522d4`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:45:00.926975 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-14ff521e-76ed-4679-96da-e498c80881f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:45:00.953602 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:45:01.019557 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 653/1310] 10.222.0.67 () {58 vars in 1061 bytes} [Thu Jul 14 17:45:00 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:45:01.029578 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f6eef-77cc-4384-a18d-f1874606f994 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:45:01.032577 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-b13f6eef-77cc-4384-a18d-f1874606f994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:45:01.200882 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f6eef-77cc-4384-a18d-f1874606f994 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:45:01.281134 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd793f62-05f5-477c-9a74-966f994dbe1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:45:01.281747 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd793f62-05f5-477c-9a74-966f994dbe1d service neutron] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:45:01.282028 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd793f62-05f5-477c-9a74-966f994dbe1d service neutron] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:45:01.282301 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd793f62-05f5-477c-9a74-966f994dbe1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:45:01.285347 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-cd793f62-05f5-477c-9a74-966f994dbe1d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:45:01.344278 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:45:01.407547 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd793f62-05f5-477c-9a74-966f994dbe1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:45:01.409063 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd793f62-05f5-477c-9a74-966f994dbe1d service neutron] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:45:01.433077 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 658/1311] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:45:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:45:03.824045 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e1523e-2be2-4966-a864-b79fd6d0532d None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:45:03.824579 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e1523e-2be2-4966-a864-b79fd6d0532d None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:45:03.824579 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e1523e-2be2-4966-a864-b79fd6d0532d None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:45:03.826154 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 654/1312] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:45:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:45:03.831530 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02cbaf-a39e-4cdf-9193-3d8a136fe6d0 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:45:03.831949 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02cbaf-a39e-4cdf-9193-3d8a136fe6d0 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:45:03.832083 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02cbaf-a39e-4cdf-9193-3d8a136fe6d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:45:03.913810 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-6b02cbaf-a39e-4cdf-9193-3d8a136fe6d0 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:45:03.915008 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-6b02cbaf-a39e-4cdf-9193-3d8a136fe6d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:45:04.013546 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 659/1313] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:45:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:45:04.051892 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e1523e-2be2-4966-a864-b79fd6d0532d None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:45:04.053439 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-19e1523e-2be2-4966-a864-b79fd6d0532d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:45:04.163103 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e1523e-2be2-4966-a864-b79fd6d0532d None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:45:04.239595 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:45:04.242133 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dbf6f9-225d-427b-931b-67c21ec5111b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:45:04.242876 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dbf6f9-225d-427b-931b-67c21ec5111b service neutron] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:45:04.243335 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dbf6f9-225d-427b-931b-67c21ec5111b service neutron] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:45:04.243834 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dbf6f9-225d-427b-931b-67c21ec5111b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:45:04.245734 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-d0dbf6f9-225d-427b-931b-67c21ec5111b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:45:04.357121 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dbf6f9-225d-427b-931b-67c21ec5111b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:45:04.358605 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dbf6f9-225d-427b-931b-67c21ec5111b service neutron] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:45:04.378624 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 655/1314] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:45:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:45:06.767694 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4ea1e3-2ce2-4ce4-8aa1-4048f305ff76 None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:45:06.768226 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4ea1e3-2ce2-4ce4-8aa1-4048f305ff76 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:45:06.768226 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4ea1e3-2ce2-4ce4-8aa1-4048f305ff76 None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:45:06.769507 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 660/1315] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:45:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:45:06.774959 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e7e92e-e1d2-4f5f-83d6-bce46892afd9 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:45:06.775400 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e7e92e-e1d2-4f5f-83d6-bce46892afd9 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:45:06.775509 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e7e92e-e1d2-4f5f-83d6-bce46892afd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:45:06.841123 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-38e7e92e-e1d2-4f5f-83d6-bce46892afd9 None None] MFA Rules not processed for user `07cbc28bcd2b49ae85b2ff52eb00af9b`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:45:06.842377 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-38e7e92e-e1d2-4f5f-83d6-bce46892afd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:45:06.894510 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:45:06.939420 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 656/1316] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:45:06 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:45:06.978958 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4ea1e3-2ce2-4ce4-8aa1-4048f305ff76 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:45:06.980497 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-ce4ea1e3-2ce2-4ce4-8aa1-4048f305ff76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:45:06.990808 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:45:07.083075 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4ea1e3-2ce2-4ce4-8aa1-4048f305ff76 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:45:07.160309 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3db222f-8d09-4cf9-b6d6-140c1fd73221 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:45:07.160969 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db222f-8d09-4cf9-b6d6-140c1fd73221 service neutron] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:45:07.161252 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db222f-8d09-4cf9-b6d6-140c1fd73221 service neutron] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:45:07.161554 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db222f-8d09-4cf9-b6d6-140c1fd73221 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:45:07.163233 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-a3db222f-8d09-4cf9-b6d6-140c1fd73221 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:45:07.227676 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:45:07.275129 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3db222f-8d09-4cf9-b6d6-140c1fd73221 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:45:07.276569 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3db222f-8d09-4cf9-b6d6-140c1fd73221 service neutron] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:45:07.294587 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 661/1317] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:45:06 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:45:09.904988 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b346a6-a98b-41bd-864d-04e9f7f0c1d8 None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:45:09.905555 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b346a6-a98b-41bd-864d-04e9f7f0c1d8 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:45:09.905555 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b346a6-a98b-41bd-864d-04e9f7f0c1d8 None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:45:09.906934 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 657/1318] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:45:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:45:09.912904 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ffc6b-b2a7-48ef-8415-826af8d9ff44 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:45:09.913362 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ffc6b-b2a7-48ef-8415-826af8d9ff44 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:45:09.913460 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ffc6b-b2a7-48ef-8415-826af8d9ff44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:45:09.978355 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-487ffc6b-b2a7-48ef-8415-826af8d9ff44 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:45:09.979559 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-487ffc6b-b2a7-48ef-8415-826af8d9ff44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:45:10.074915 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 662/1319] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:45:09 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:45:10.129516 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ef9df0-c727-475f-a396-599b9d3d8b59 None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:45:10.129829 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ef9df0-c727-475f-a396-599b9d3d8b59 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:45:10.130109 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ef9df0-c727-475f-a396-599b9d3d8b59 None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:45:10.131516 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 658/1320] 10.222.0.67 () {54 vars in 964 bytes} [Thu Jul 14 17:45:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:45:10.137831 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632babd4-e76b-4a2f-989b-743c401584ac None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:45:10.138126 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632babd4-e76b-4a2f-989b-743c401584ac None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:45:10.138416 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632babd4-e76b-4a2f-989b-743c401584ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:45:10.160050 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:45:10.214804 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-632babd4-e76b-4a2f-989b-743c401584ac None None] MFA Rules not processed for user `7bda83c5499f43f9838fda2679a522d4`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:45:10.216038 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-632babd4-e76b-4a2f-989b-743c401584ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:45:10.292068 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 663/1321] 10.222.0.67 () {58 vars in 1061 bytes} [Thu Jul 14 17:45:10 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:45:10.301160 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ef9df0-c727-475f-a396-599b9d3d8b59 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:45:10.302747 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-88ef9df0-c727-475f-a396-599b9d3d8b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:45:10.403991 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ef9df0-c727-475f-a396-599b9d3d8b59 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:45:10.480955 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb290486-6f65-4f4f-80f8-0b101f0945c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:45:10.481642 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb290486-6f65-4f4f-80f8-0b101f0945c5 service neutron] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:45:10.481928 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb290486-6f65-4f4f-80f8-0b101f0945c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:45:10.482208 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb290486-6f65-4f4f-80f8-0b101f0945c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:45:10.483870 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-eb290486-6f65-4f4f-80f8-0b101f0945c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:45:10.491570 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:45:10.594445 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb290486-6f65-4f4f-80f8-0b101f0945c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:45:10.595883 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb290486-6f65-4f4f-80f8-0b101f0945c5 service neutron] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:45:10.614494 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 659/1322] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:45:10 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:45:13.808217 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422e756d-89d0-4014-ad32-bd0cb5d65e8c None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:45:13.808773 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422e756d-89d0-4014-ad32-bd0cb5d65e8c None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:45:13.808773 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422e756d-89d0-4014-ad32-bd0cb5d65e8c None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:45:13.810234 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 664/1323] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:45:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:45:13.815709 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece721c3-5f3c-41af-ad40-2d06e7a69324 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:45:13.816157 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece721c3-5f3c-41af-ad40-2d06e7a69324 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:45:13.816256 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece721c3-5f3c-41af-ad40-2d06e7a69324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:45:13.885132 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-ece721c3-5f3c-41af-ad40-2d06e7a69324 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:45:13.886389 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-ece721c3-5f3c-41af-ad40-2d06e7a69324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:45:13.947170 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:45:13.989022 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 660/1324] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:45:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:45:14.027012 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422e756d-89d0-4014-ad32-bd0cb5d65e8c None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:45:14.028663 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-422e756d-89d0-4014-ad32-bd0cb5d65e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:45:14.151188 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422e756d-89d0-4014-ad32-bd0cb5d65e8c None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:45:14.166985 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:45:14.245128 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff0a3df-289a-46f6-8280-e2ae84867ae8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:45:14.245811 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff0a3df-289a-46f6-8280-e2ae84867ae8 service neutron] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:45:14.246087 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff0a3df-289a-46f6-8280-e2ae84867ae8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:45:14.246357 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff0a3df-289a-46f6-8280-e2ae84867ae8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:45:14.248083 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-eff0a3df-289a-46f6-8280-e2ae84867ae8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:45:14.362166 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff0a3df-289a-46f6-8280-e2ae84867ae8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:45:14.363602 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff0a3df-289a-46f6-8280-e2ae84867ae8 service neutron] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:45:14.382445 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 665/1325] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:45:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:45:16.492523 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec08a8c6-1ddd-454c-8a62-eb5dce93532d None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:45:16.493084 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec08a8c6-1ddd-454c-8a62-eb5dce93532d None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:45:16.493084 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec08a8c6-1ddd-454c-8a62-eb5dce93532d None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:45:16.494616 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 661/1326] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:45:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:45:16.500991 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d743599-2a84-4a78-b2ec-22ca84678ea7 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:45:16.501639 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d743599-2a84-4a78-b2ec-22ca84678ea7 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:45:16.502203 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d743599-2a84-4a78-b2ec-22ca84678ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:45:16.559127 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:45:16.580247 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-9d743599-2a84-4a78-b2ec-22ca84678ea7 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:45:16.581597 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-9d743599-2a84-4a78-b2ec-22ca84678ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:45:16.686545 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 666/1327] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:45:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:45:16.723356 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec08a8c6-1ddd-454c-8a62-eb5dce93532d None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:45:16.724894 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-ec08a8c6-1ddd-454c-8a62-eb5dce93532d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:45:16.844678 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec08a8c6-1ddd-454c-8a62-eb5dce93532d None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:45:16.929776 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcd3633-bd63-4275-9361-3ece8b281afb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:45:16.930472 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcd3633-bd63-4275-9361-3ece8b281afb service neutron] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:45:16.930750 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcd3633-bd63-4275-9361-3ece8b281afb service neutron] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:45:16.931020 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcd3633-bd63-4275-9361-3ece8b281afb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:45:16.932810 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-fbcd3633-bd63-4275-9361-3ece8b281afb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:45:16.952473 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:45:17.051586 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcd3633-bd63-4275-9361-3ece8b281afb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:45:17.053035 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcd3633-bd63-4275-9361-3ece8b281afb service neutron] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:45:17.072241 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 662/1328] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:45:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:45:19.162246 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20523c2-4f7c-4af5-9ffb-563d69c232ee None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:45:19.162873 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20523c2-4f7c-4af5-9ffb-563d69c232ee None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:45:19.162873 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20523c2-4f7c-4af5-9ffb-563d69c232ee None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:45:19.164183 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 667/1329] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:45:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:45:19.169773 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d187381d-cae7-4c4c-95f2-710613e56d25 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:45:19.170362 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d187381d-cae7-4c4c-95f2-710613e56d25 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:45:19.170362 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d187381d-cae7-4c4c-95f2-710613e56d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:45:19.238114 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-d187381d-cae7-4c4c-95f2-710613e56d25 None None] MFA Rules not processed for user `07cbc28bcd2b49ae85b2ff52eb00af9b`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:45:19.239340 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-d187381d-cae7-4c4c-95f2-710613e56d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:45:19.309977 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:45:19.345429 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 663/1330] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:45:19 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 17:45:19.384146 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20523c2-4f7c-4af5-9ffb-563d69c232ee None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:45:19.386081 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-f20523c2-4f7c-4af5-9ffb-563d69c232ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:45:19.504254 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20523c2-4f7c-4af5-9ffb-563d69c232ee None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:45:19.527011 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:45:19.590416 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb32b6f5-ce79-4c92-8846-b35e8cf14919 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:45:19.591086 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb32b6f5-ce79-4c92-8846-b35e8cf14919 service neutron] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:45:19.591369 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb32b6f5-ce79-4c92-8846-b35e8cf14919 service neutron] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:45:19.591646 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb32b6f5-ce79-4c92-8846-b35e8cf14919 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:45:19.593409 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-bb32b6f5-ce79-4c92-8846-b35e8cf14919 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:45:19.725050 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb32b6f5-ce79-4c92-8846-b35e8cf14919 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:45:19.726439 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb32b6f5-ce79-4c92-8846-b35e8cf14919 service neutron] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:45:19.744452 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 668/1331] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:45:19 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:45:22.064611 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a6e68-c2f7-4868-a7ec-9823063a2719 None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:45:22.065126 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a6e68-c2f7-4868-a7ec-9823063a2719 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:45:22.065126 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a6e68-c2f7-4868-a7ec-9823063a2719 None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:45:22.066986 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 664/1332] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:45:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:45:22.072250 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50261d22-6f35-42fc-90ce-543f495df73a None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:45:22.072693 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50261d22-6f35-42fc-90ce-543f495df73a None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:45:22.072890 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50261d22-6f35-42fc-90ce-543f495df73a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:45:22.137373 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:45:22.140988 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-50261d22-6f35-42fc-90ce-543f495df73a None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:45:22.142995 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-50261d22-6f35-42fc-90ce-543f495df73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:45:22.250742 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 669/1333] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:45:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:45:22.289303 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983a6e68-c2f7-4868-a7ec-9823063a2719 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:45:22.291087 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-983a6e68-c2f7-4868-a7ec-9823063a2719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:45:22.405763 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983a6e68-c2f7-4868-a7ec-9823063a2719 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:45:22.483405 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813755f5-5b1f-4440-92aa-33f60b49ede1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:45:22.484058 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813755f5-5b1f-4440-92aa-33f60b49ede1 service neutron] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:45:22.484343 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813755f5-5b1f-4440-92aa-33f60b49ede1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:45:22.484619 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813755f5-5b1f-4440-92aa-33f60b49ede1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:45:22.486305 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-813755f5-5b1f-4440-92aa-33f60b49ede1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:45:22.516248 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:45:22.598703 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813755f5-5b1f-4440-92aa-33f60b49ede1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:45:22.600142 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813755f5-5b1f-4440-92aa-33f60b49ede1 service neutron] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:45:22.618584 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 665/1334] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:45:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:45:24.723120 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a463162c-7868-4a97-b391-a89d94d7dbf9 None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:45:24.723636 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a463162c-7868-4a97-b391-a89d94d7dbf9 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:45:24.723636 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a463162c-7868-4a97-b391-a89d94d7dbf9 None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:45:24.724959 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 670/1335] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:45:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:45:24.730511 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d636db87-adc2-4359-8088-8f511c0b01e5 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:45:24.730972 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d636db87-adc2-4359-8088-8f511c0b01e5 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:45:24.731080 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d636db87-adc2-4359-8088-8f511c0b01e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:45:24.800362 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-d636db87-adc2-4359-8088-8f511c0b01e5 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:45:24.801679 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-d636db87-adc2-4359-8088-8f511c0b01e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:45:24.886175 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:45:24.912052 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 666/1336] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:45:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:45:24.952412 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a463162c-7868-4a97-b391-a89d94d7dbf9 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:45:24.953994 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-a463162c-7868-4a97-b391-a89d94d7dbf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:45:25.056903 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a463162c-7868-4a97-b391-a89d94d7dbf9 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:45:25.085829 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:45:25.133364 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a77831-b352-48dd-bd7c-40be9ff84dcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:45:25.134072 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a77831-b352-48dd-bd7c-40be9ff84dcc service neutron] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:45:25.134354 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a77831-b352-48dd-bd7c-40be9ff84dcc service neutron] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:45:25.134624 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a77831-b352-48dd-bd7c-40be9ff84dcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:45:25.136526 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-e4a77831-b352-48dd-bd7c-40be9ff84dcc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:45:25.246093 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a77831-b352-48dd-bd7c-40be9ff84dcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:45:25.247527 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a77831-b352-48dd-bd7c-40be9ff84dcc service neutron] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:45:25.265554 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 671/1337] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:45:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:45:27.724989 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5bbf92-9ecc-4d18-8550-048953068b7d None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:45:27.725620 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5bbf92-9ecc-4d18-8550-048953068b7d None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:45:27.725620 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5bbf92-9ecc-4d18-8550-048953068b7d None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:45:27.726986 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 667/1338] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:45:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:45:27.732471 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d9f3ca-6af0-4edc-86fd-c80f08531281 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:45:27.732955 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d9f3ca-6af0-4edc-86fd-c80f08531281 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:45:27.733055 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d9f3ca-6af0-4edc-86fd-c80f08531281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:45:27.799394 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-98d9f3ca-6af0-4edc-86fd-c80f08531281 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:45:27.801209 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-98d9f3ca-6af0-4edc-86fd-c80f08531281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:45:27.809716 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:45:27.900077 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 672/1339] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:45:27 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:45:27.936829 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5bbf92-9ecc-4d18-8550-048953068b7d None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:45:27.938422 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-fc5bbf92-9ecc-4d18-8550-048953068b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:45:28.040613 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5bbf92-9ecc-4d18-8550-048953068b7d None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:45:28.113981 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f47874-3472-417f-bad4-eeee15f8160f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:45:28.114676 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f47874-3472-417f-bad4-eeee15f8160f service neutron] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:45:28.114964 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f47874-3472-417f-bad4-eeee15f8160f service neutron] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:45:28.115246 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f47874-3472-417f-bad4-eeee15f8160f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:45:28.116918 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-80f47874-3472-417f-bad4-eeee15f8160f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:45:28.153539 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:45:28.226971 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f47874-3472-417f-bad4-eeee15f8160f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:45:28.228411 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f47874-3472-417f-bad4-eeee15f8160f service neutron] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:45:28.246571 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 668/1340] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:45:27 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:45:32.295827 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5cd1b3-de6a-4e38-84de-5d725ed89bc6 None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:45:32.296416 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5cd1b3-de6a-4e38-84de-5d725ed89bc6 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:45:32.296416 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5cd1b3-de6a-4e38-84de-5d725ed89bc6 None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:45:32.297788 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 673/1341] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:45:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:45:32.303920 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37828d22-6138-482c-b7b0-c42a729b6d2a None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:45:32.304420 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37828d22-6138-482c-b7b0-c42a729b6d2a None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:45:32.304523 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37828d22-6138-482c-b7b0-c42a729b6d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:45:32.372371 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-37828d22-6138-482c-b7b0-c42a729b6d2a None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:45:32.373764 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-37828d22-6138-482c-b7b0-c42a729b6d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:45:32.469884 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:45:32.483163 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 669/1342] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:45:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:45:32.522941 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5cd1b3-de6a-4e38-84de-5d725ed89bc6 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:45:32.524485 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-db5cd1b3-de6a-4e38-84de-5d725ed89bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:45:32.633046 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5cd1b3-de6a-4e38-84de-5d725ed89bc6 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:45:32.673851 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:45:32.713310 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee0a26d-dff7-4015-a06c-8ce93e33ee6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:45:32.714004 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee0a26d-dff7-4015-a06c-8ce93e33ee6f service neutron] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:45:32.714288 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee0a26d-dff7-4015-a06c-8ce93e33ee6f service neutron] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:45:32.714564 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee0a26d-dff7-4015-a06c-8ce93e33ee6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:45:32.716230 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-fee0a26d-dff7-4015-a06c-8ce93e33ee6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:45:32.838803 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee0a26d-dff7-4015-a06c-8ce93e33ee6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:45:32.840049 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee0a26d-dff7-4015-a06c-8ce93e33ee6f service neutron] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:45:32.859860 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 674/1343] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:45:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:45:35.481862 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6007ce60-8555-4528-88d1-4222c531fb47 None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:45:35.482436 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6007ce60-8555-4528-88d1-4222c531fb47 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:45:35.482436 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6007ce60-8555-4528-88d1-4222c531fb47 None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:45:35.484094 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 670/1344] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:45:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:45:35.490467 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee713358-ca43-492d-b4a9-59a5a8bbf8a9 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:45:35.491022 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee713358-ca43-492d-b4a9-59a5a8bbf8a9 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:45:35.491022 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee713358-ca43-492d-b4a9-59a5a8bbf8a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:45:35.563416 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-ee713358-ca43-492d-b4a9-59a5a8bbf8a9 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:45:35.564857 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-ee713358-ca43-492d-b4a9-59a5a8bbf8a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:45:35.585701 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:45:35.673898 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 675/1345] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:45:35 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:45:35.712193 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6007ce60-8555-4528-88d1-4222c531fb47 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:45:35.713806 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-6007ce60-8555-4528-88d1-4222c531fb47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:45:35.837432 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6007ce60-8555-4528-88d1-4222c531fb47 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:45:35.912001 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af3afa6-ac5a-4ce3-9eb1-64a42b373973 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:45:35.912574 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af3afa6-ac5a-4ce3-9eb1-64a42b373973 service neutron] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:45:35.912903 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af3afa6-ac5a-4ce3-9eb1-64a42b373973 service neutron] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:45:35.913121 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af3afa6-ac5a-4ce3-9eb1-64a42b373973 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:45:35.914835 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-8af3afa6-ac5a-4ce3-9eb1-64a42b373973 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:45:35.963158 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:45:36.030052 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af3afa6-ac5a-4ce3-9eb1-64a42b373973 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:45:36.031401 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af3afa6-ac5a-4ce3-9eb1-64a42b373973 service neutron] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:45:36.050164 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 671/1346] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:45:35 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:45:40.163689 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb8dc1d-e48d-4fd0-b49d-41aa04590c0c None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:45:40.164249 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb8dc1d-e48d-4fd0-b49d-41aa04590c0c None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:45:40.164249 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb8dc1d-e48d-4fd0-b49d-41aa04590c0c None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:45:40.165763 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 676/1347] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:45:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:45:40.172076 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc8301-eec7-454c-ad76-2ce15c798489 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:45:40.172526 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc8301-eec7-454c-ad76-2ce15c798489 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:45:40.172648 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc8301-eec7-454c-ad76-2ce15c798489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:45:40.242290 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-45dc8301-eec7-454c-ad76-2ce15c798489 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:45:40.243520 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-45dc8301-eec7-454c-ad76-2ce15c798489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:45:40.348152 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:45:40.352382 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 672/1348] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:45:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:45:40.389018 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb8dc1d-e48d-4fd0-b49d-41aa04590c0c None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:45:40.390789 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-4cb8dc1d-e48d-4fd0-b49d-41aa04590c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:45:40.521944 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb8dc1d-e48d-4fd0-b49d-41aa04590c0c None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:45:40.573214 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:45:40.600981 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4222c47-0b2b-44e1-8895-4d0dd58c4bab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:45:40.601700 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4222c47-0b2b-44e1-8895-4d0dd58c4bab service neutron] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:45:40.601983 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4222c47-0b2b-44e1-8895-4d0dd58c4bab service neutron] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:45:40.602258 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4222c47-0b2b-44e1-8895-4d0dd58c4bab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:45:40.603929 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-b4222c47-0b2b-44e1-8895-4d0dd58c4bab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:45:40.723564 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4222c47-0b2b-44e1-8895-4d0dd58c4bab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:45:40.725026 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4222c47-0b2b-44e1-8895-4d0dd58c4bab service neutron] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:45:40.744243 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 677/1349] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:45:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:45:45.859660 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d6449f-6b41-4e67-8ab7-a2c4501a8e5e None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:45:45.860950 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d6449f-6b41-4e67-8ab7-a2c4501a8e5e None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:45:45.861455 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d6449f-6b41-4e67-8ab7-a2c4501a8e5e None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:45:45.863499 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 673/1350] 10.222.0.67 () {54 vars in 921 bytes} [Thu Jul 14 17:45:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:45:45.869044 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acae5d8f-2e7e-4d4f-903c-45ac28e67e19 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:45:45.869944 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acae5d8f-2e7e-4d4f-903c-45ac28e67e19 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:45:45.870476 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acae5d8f-2e7e-4d4f-903c-45ac28e67e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:45:46.020545 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-acae5d8f-2e7e-4d4f-903c-45ac28e67e19 None None] MFA Rules not processed for user `5324ab45f4a4449980dad920278f5034`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:45:46.021897 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-acae5d8f-2e7e-4d4f-903c-45ac28e67e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:45:46.052979 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:45:46.166717 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 678/1351] 10.222.0.67 () {58 vars in 1018 bytes} [Thu Jul 14 17:45:45 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 17:45:50.255131 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f13304-b271-40a7-bf8c-572b9101797d None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:45:50.255672 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f13304-b271-40a7-bf8c-572b9101797d None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:45:50.256588 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f13304-b271-40a7-bf8c-572b9101797d None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:45:50.258163 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 674/1352] 10.222.0.67 () {54 vars in 921 bytes} [Thu Jul 14 17:45:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:45:50.264220 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ec3fb-fbba-4a22-be81-94b2178a80ca None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:45:50.264666 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ec3fb-fbba-4a22-be81-94b2178a80ca None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:45:50.264775 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ec3fb-fbba-4a22-be81-94b2178a80ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:45:50.351230 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-215ec3fb-fbba-4a22-be81-94b2178a80ca None None] MFA Rules not processed for user `5324ab45f4a4449980dad920278f5034`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:45:50.352446 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-215ec3fb-fbba-4a22-be81-94b2178a80ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:45:50.432576 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:45:50.487564 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 679/1353] 10.222.0.67 () {58 vars in 1018 bytes} [Thu Jul 14 17:45:50 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:45:51.956902 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c8e7d-99df-4d43-a237-30218c6b8c56 None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:45:51.957485 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c8e7d-99df-4d43-a237-30218c6b8c56 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:45:51.957602 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c8e7d-99df-4d43-a237-30218c6b8c56 None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:45:51.959414 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 675/1354] 10.222.0.67 () {54 vars in 921 bytes} [Thu Jul 14 17:45:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:45:51.964724 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4377fc3-f3a2-4cec-89f1-6848f17c6498 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:45:51.965154 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4377fc3-f3a2-4cec-89f1-6848f17c6498 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:45:51.965458 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4377fc3-f3a2-4cec-89f1-6848f17c6498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:45:52.044195 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-b4377fc3-f3a2-4cec-89f1-6848f17c6498 None None] MFA Rules not processed for user `5324ab45f4a4449980dad920278f5034`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:45:52.045403 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-b4377fc3-f3a2-4cec-89f1-6848f17c6498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:45:52.156967 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 680/1355] 10.222.0.67 () {58 vars in 1018 bytes} [Thu Jul 14 17:45:51 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:45:55.767970 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471b3fb4-9291-41ef-a6fe-0aaba876c671 None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:45:55.768505 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471b3fb4-9291-41ef-a6fe-0aaba876c671 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:45:55.768600 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471b3fb4-9291-41ef-a6fe-0aaba876c671 None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:45:55.769965 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 676/1356] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:45:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:45:55.776023 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41198303-8118-4d96-ab86-1ae42986fed8 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:45:55.776478 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41198303-8118-4d96-ab86-1ae42986fed8 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:45:55.776592 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41198303-8118-4d96-ab86-1ae42986fed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:45:55.820996 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:45:55.873009 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-41198303-8118-4d96-ab86-1ae42986fed8 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:45:55.875840 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-41198303-8118-4d96-ab86-1ae42986fed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:45:56.005716 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 681/1357] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:45:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:45:56.062382 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202f082-f760-4334-884c-62557ad4de9c None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:45:56.062740 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202f082-f760-4334-884c-62557ad4de9c None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:45:56.063224 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202f082-f760-4334-884c-62557ad4de9c None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:45:56.064791 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 677/1358] 10.222.0.67 () {54 vars in 961 bytes} [Thu Jul 14 17:45:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:45:56.074872 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc7ae3a-1a16-4f9b-a364-b9e0ccffcabf None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:45:56.075266 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc7ae3a-1a16-4f9b-a364-b9e0ccffcabf None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:45:56.075690 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc7ae3a-1a16-4f9b-a364-b9e0ccffcabf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:45:56.167946 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-5cc7ae3a-1a16-4f9b-a364-b9e0ccffcabf None None] MFA Rules not processed for user `41b893bdf4ec474dbfa819c22fc29ce9`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:45:56.169145 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-5cc7ae3a-1a16-4f9b-a364-b9e0ccffcabf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:45:56.225300 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:45:56.302747 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 682/1359] 10.222.0.67 () {58 vars in 1058 bytes} [Thu Jul 14 17:45:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:45:56.310522 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3202f082-f760-4334-884c-62557ad4de9c None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:45:56.312250 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-3202f082-f760-4334-884c-62557ad4de9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:45:56.501443 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3202f082-f760-4334-884c-62557ad4de9c None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:45:56.586845 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:45:56.638338 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41a63de-2814-4976-9fff-2a9fd07275c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41b893bdf4ec474dbfa819c22fc29ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:45:56.639055 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a63de-2814-4976-9fff-2a9fd07275c6 service nova] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:45:56.639343 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a63de-2814-4976-9fff-2a9fd07275c6 service nova] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:45:56.639614 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a63de-2814-4976-9fff-2a9fd07275c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:45:56.641353 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-a41a63de-2814-4976-9fff-2a9fd07275c6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:45:56.767271 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41a63de-2814-4976-9fff-2a9fd07275c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:45:56.769202 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41a63de-2814-4976-9fff-2a9fd07275c6 service nova] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:45:56.791600 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 678/1360] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:45:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:45:59.104584 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11aa204-0bdc-42c9-b5e0-1ed3fb4f27c3 None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:45:59.105538 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11aa204-0bdc-42c9-b5e0-1ed3fb4f27c3 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:45:59.105933 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11aa204-0bdc-42c9-b5e0-1ed3fb4f27c3 None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:45:59.107673 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 683/1361] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:45:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:45:59.112962 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec875f5f-31ab-4c5d-b309-9889ae0a8a9f None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:45:59.113545 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec875f5f-31ab-4c5d-b309-9889ae0a8a9f None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:45:59.113545 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec875f5f-31ab-4c5d-b309-9889ae0a8a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:45:59.188471 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-ec875f5f-31ab-4c5d-b309-9889ae0a8a9f None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:45:59.189695 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-ec875f5f-31ab-4c5d-b309-9889ae0a8a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:45:59.250062 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:45:59.334065 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 679/1362] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:45:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:45:59.381417 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11aa204-0bdc-42c9-b5e0-1ed3fb4f27c3 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:45:59.383230 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-d11aa204-0bdc-42c9-b5e0-1ed3fb4f27c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:45:59.618744 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11aa204-0bdc-42c9-b5e0-1ed3fb4f27c3 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:45:59.628230 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:45:59.751964 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fd57f3-8535-4c29-ba93-a436e2d87b3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41b893bdf4ec474dbfa819c22fc29ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:45:59.752662 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd57f3-8535-4c29-ba93-a436e2d87b3f service nova] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:45:59.752951 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd57f3-8535-4c29-ba93-a436e2d87b3f service nova] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:45:59.753234 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd57f3-8535-4c29-ba93-a436e2d87b3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:45:59.755232 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-d9fd57f3-8535-4c29-ba93-a436e2d87b3f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:45:59.881237 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fd57f3-8535-4c29-ba93-a436e2d87b3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:45:59.883891 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fd57f3-8535-4c29-ba93-a436e2d87b3f service nova] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:45:59.917332 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 684/1363] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:45:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:46:02.322278 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e67a79-cc69-437e-ae85-01b473dcea39 None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:46:02.323159 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e67a79-cc69-437e-ae85-01b473dcea39 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:46:02.323159 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e67a79-cc69-437e-ae85-01b473dcea39 None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:46:02.324192 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 680/1364] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:46:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:46:02.330632 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c332f-d189-4acc-9910-43e40f0854a3 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:46:02.331111 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c332f-d189-4acc-9910-43e40f0854a3 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:46:02.331350 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c332f-d189-4acc-9910-43e40f0854a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:46:02.349545 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:46:02.416197 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-919c332f-d189-4acc-9910-43e40f0854a3 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:46:02.417420 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-919c332f-d189-4acc-9910-43e40f0854a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:46:02.543043 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 685/1365] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:46:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:46:02.592733 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f7ee94-c9f2-4ca7-aa40-d062d3fc1e2c None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:46:02.593407 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f7ee94-c9f2-4ca7-aa40-d062d3fc1e2c None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:46:02.594317 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f7ee94-c9f2-4ca7-aa40-d062d3fc1e2c None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:46:02.596867 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 681/1366] 10.222.0.67 () {54 vars in 961 bytes} [Thu Jul 14 17:46:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:46:02.603771 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa54c912-2e16-4023-988f-d1d0b4658582 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:46:02.604495 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa54c912-2e16-4023-988f-d1d0b4658582 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:46:02.605021 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa54c912-2e16-4023-988f-d1d0b4658582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:46:02.699002 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-fa54c912-2e16-4023-988f-d1d0b4658582 None None] MFA Rules not processed for user `41b893bdf4ec474dbfa819c22fc29ce9`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:46:02.700237 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-fa54c912-2e16-4023-988f-d1d0b4658582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:46:02.742249 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:46:02.847650 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 686/1367] 10.222.0.67 () {58 vars in 1058 bytes} [Thu Jul 14 17:46:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 17:46:02.856786 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f7ee94-c9f2-4ca7-aa40-d062d3fc1e2c None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:46:02.860040 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-12f7ee94-c9f2-4ca7-aa40-d062d3fc1e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:46:03.093011 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f7ee94-c9f2-4ca7-aa40-d062d3fc1e2c None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:46:03.121371 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:46:03.227507 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367dab5e-4f9d-4bfd-af4e-f700ef19d8ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41b893bdf4ec474dbfa819c22fc29ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:46:03.228297 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367dab5e-4f9d-4bfd-af4e-f700ef19d8ea service nova] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:46:03.228584 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367dab5e-4f9d-4bfd-af4e-f700ef19d8ea service nova] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:46:03.228860 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367dab5e-4f9d-4bfd-af4e-f700ef19d8ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:46:03.230592 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-367dab5e-4f9d-4bfd-af4e-f700ef19d8ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:46:03.338326 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367dab5e-4f9d-4bfd-af4e-f700ef19d8ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:46:03.340247 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367dab5e-4f9d-4bfd-af4e-f700ef19d8ea service nova] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:46:03.364755 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 682/1368] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:46:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 17:46:04.087133 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc51e1-208a-49ba-a8f8-d476aa560f04 None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:46:04.087702 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc51e1-208a-49ba-a8f8-d476aa560f04 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:46:04.087702 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc51e1-208a-49ba-a8f8-d476aa560f04 None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:46:04.089568 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 687/1369] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:46:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:46:04.094731 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f90f82-669c-477b-b3da-bcc5b5faea7a None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:46:04.095047 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f90f82-669c-477b-b3da-bcc5b5faea7a None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:46:04.095318 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f90f82-669c-477b-b3da-bcc5b5faea7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:46:04.128845 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:46:04.168132 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-09f90f82-669c-477b-b3da-bcc5b5faea7a None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:46:04.169344 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-09f90f82-669c-477b-b3da-bcc5b5faea7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:46:04.272927 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 683/1370] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:46:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:46:04.642958 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b576be6-3ed1-4e7d-a224-1d9da09d62db None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:46:04.643449 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b576be6-3ed1-4e7d-a224-1d9da09d62db None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:46:04.643772 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b576be6-3ed1-4e7d-a224-1d9da09d62db None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:46:04.645445 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 688/1371] 10.222.0.67 () {54 vars in 963 bytes} [Thu Jul 14 17:46:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:46:04.650563 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe37f0e-259c-4f4e-b5a9-1bc35055e49b None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:46:04.651135 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe37f0e-259c-4f4e-b5a9-1bc35055e49b None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:46:04.651346 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe37f0e-259c-4f4e-b5a9-1bc35055e49b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:46:04.731194 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-9fe37f0e-259c-4f4e-b5a9-1bc35055e49b None None] MFA Rules not processed for user `de55cae1600841889668e36402861203`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:46:04.732492 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-9fe37f0e-259c-4f4e-b5a9-1bc35055e49b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:46:04.786536 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:46:04.825360 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 684/1372] 10.222.0.67 () {58 vars in 1060 bytes} [Thu Jul 14 17:46:04 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:46:04.826356 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b576be6-3ed1-4e7d-a224-1d9da09d62db None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:46:04.827904 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-8b576be6-3ed1-4e7d-a224-1d9da09d62db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:46:04.953318 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b576be6-3ed1-4e7d-a224-1d9da09d62db None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:46:04.998108 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:46:05.044325 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe669a9-d3d1-4c11-bc1e-6f587a14d978 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de55cae1600841889668e36402861203', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:46:05.045123 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe669a9-d3d1-4c11-bc1e-6f587a14d978 service cinder] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:46:05.045411 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe669a9-d3d1-4c11-bc1e-6f587a14d978 service cinder] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:46:05.045832 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe669a9-d3d1-4c11-bc1e-6f587a14d978 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:46:05.047545 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-4fe669a9-d3d1-4c11-bc1e-6f587a14d978 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:46:05.172692 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe669a9-d3d1-4c11-bc1e-6f587a14d978 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:46:05.174492 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe669a9-d3d1-4c11-bc1e-6f587a14d978 service cinder] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:46:05.196152 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 689/1373] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:46:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:46:05.532402 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60ae9bf-29a6-4dda-bfd6-f39591b2314f None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:46:05.532681 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60ae9bf-29a6-4dda-bfd6-f39591b2314f None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:46:05.532965 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60ae9bf-29a6-4dda-bfd6-f39591b2314f None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:46:05.534284 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 685/1374] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:46:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:46:05.540317 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ffbf5-198b-4af8-bdb1-eaf31296c7cb None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:46:05.540610 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ffbf5-198b-4af8-bdb1-eaf31296c7cb None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:46:05.540893 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ffbf5-198b-4af8-bdb1-eaf31296c7cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:46:05.660835 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-851ffbf5-198b-4af8-bdb1-eaf31296c7cb None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:46:05.664499 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-851ffbf5-198b-4af8-bdb1-eaf31296c7cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:46:05.686638 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:46:05.774325 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 690/1375] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:46:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:46:05.821584 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60ae9bf-29a6-4dda-bfd6-f39591b2314f None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:46:05.823164 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-c60ae9bf-29a6-4dda-bfd6-f39591b2314f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:46:06.023798 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60ae9bf-29a6-4dda-bfd6-f39591b2314f None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:46:06.100226 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:46:06.182327 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40655402-b0e6-4bca-934f-bd04e48d3579 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41b893bdf4ec474dbfa819c22fc29ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:46:06.184186 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40655402-b0e6-4bca-934f-bd04e48d3579 service nova] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:46:06.184186 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40655402-b0e6-4bca-934f-bd04e48d3579 service nova] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:46:06.184186 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40655402-b0e6-4bca-934f-bd04e48d3579 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:46:06.185177 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-40655402-b0e6-4bca-934f-bd04e48d3579 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:46:06.301788 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40655402-b0e6-4bca-934f-bd04e48d3579 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:46:06.304038 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40655402-b0e6-4bca-934f-bd04e48d3579 service nova] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:46:06.325279 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 686/1376] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:46:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:46:08.481118 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed90e21b-f6b2-4c67-a764-e5dfe0f9de96 None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:46:08.481763 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed90e21b-f6b2-4c67-a764-e5dfe0f9de96 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:46:08.481763 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed90e21b-f6b2-4c67-a764-e5dfe0f9de96 None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:46:08.485205 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 691/1377] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:46:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:46:08.492868 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfdd7f3-67c3-41d7-a238-c6bb73c04da6 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:46:08.493689 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfdd7f3-67c3-41d7-a238-c6bb73c04da6 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:46:08.493852 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfdd7f3-67c3-41d7-a238-c6bb73c04da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:46:08.588858 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-8dfdd7f3-67c3-41d7-a238-c6bb73c04da6 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:46:08.590018 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-8dfdd7f3-67c3-41d7-a238-c6bb73c04da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:46:08.597045 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:46:08.705403 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 687/1378] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:46:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:46:08.750823 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed90e21b-f6b2-4c67-a764-e5dfe0f9de96 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:46:08.752376 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-ed90e21b-f6b2-4c67-a764-e5dfe0f9de96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:46:08.930597 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed90e21b-f6b2-4c67-a764-e5dfe0f9de96 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:46:08.933917 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:46:09.123916 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f29a05-99b8-41af-ad26-560aa2ded2e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41b893bdf4ec474dbfa819c22fc29ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:46:09.124671 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f29a05-99b8-41af-ad26-560aa2ded2e3 service nova] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:46:09.125021 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f29a05-99b8-41af-ad26-560aa2ded2e3 service nova] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:46:09.125368 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f29a05-99b8-41af-ad26-560aa2ded2e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:46:09.127164 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-30f29a05-99b8-41af-ad26-560aa2ded2e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:46:09.253355 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f29a05-99b8-41af-ad26-560aa2ded2e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:46:09.255538 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f29a05-99b8-41af-ad26-560aa2ded2e3 service nova] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:46:09.278739 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 692/1379] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:46:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:46:11.398684 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf8e818-5ed5-4784-991e-136ba464f079 None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:46:11.399168 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf8e818-5ed5-4784-991e-136ba464f079 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:46:11.399424 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf8e818-5ed5-4784-991e-136ba464f079 None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:46:11.401786 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 688/1380] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:46:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:46:11.406205 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1570eb2-8676-46a6-8812-1f164d789307 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:46:11.406653 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1570eb2-8676-46a6-8812-1f164d789307 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:46:11.406814 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1570eb2-8676-46a6-8812-1f164d789307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:46:11.417966 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:46:11.488649 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-e1570eb2-8676-46a6-8812-1f164d789307 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:46:11.489972 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-e1570eb2-8676-46a6-8812-1f164d789307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:46:11.596848 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 693/1381] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:46:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:46:11.644241 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf8e818-5ed5-4784-991e-136ba464f079 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:46:11.646623 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-2bf8e818-5ed5-4784-991e-136ba464f079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:46:11.832659 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:46:11.847316 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf8e818-5ed5-4784-991e-136ba464f079 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:46:11.988317 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebfb01c-3ada-4bf5-98ec-2644f2f4ead9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41b893bdf4ec474dbfa819c22fc29ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:46:11.989013 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebfb01c-3ada-4bf5-98ec-2644f2f4ead9 service nova] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:46:11.989300 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebfb01c-3ada-4bf5-98ec-2644f2f4ead9 service nova] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:46:11.990195 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebfb01c-3ada-4bf5-98ec-2644f2f4ead9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:46:11.992132 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-5ebfb01c-3ada-4bf5-98ec-2644f2f4ead9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:46:12.097846 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebfb01c-3ada-4bf5-98ec-2644f2f4ead9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:46:12.099481 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebfb01c-3ada-4bf5-98ec-2644f2f4ead9 service nova] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:46:12.111702 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:46:12.122055 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 689/1382] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:46:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:46:14.238078 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb2ef3f-7075-4149-a7b0-b16252261388 None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:46:14.238826 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb2ef3f-7075-4149-a7b0-b16252261388 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:46:14.238826 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb2ef3f-7075-4149-a7b0-b16252261388 None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:46:14.240082 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 694/1383] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:46:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:46:14.245491 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e9b5c-54b7-4f1d-ae8d-6c864276eb08 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:46:14.246052 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e9b5c-54b7-4f1d-ae8d-6c864276eb08 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:46:14.246249 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e9b5c-54b7-4f1d-ae8d-6c864276eb08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:46:14.313969 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-080e9b5c-54b7-4f1d-ae8d-6c864276eb08 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:46:14.315130 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-080e9b5c-54b7-4f1d-ae8d-6c864276eb08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:46:14.416567 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 690/1384] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:46:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:46:14.461997 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb2ef3f-7075-4149-a7b0-b16252261388 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:46:14.463419 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-1cb2ef3f-7075-4149-a7b0-b16252261388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:46:14.549776 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:46:14.637976 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb2ef3f-7075-4149-a7b0-b16252261388 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:46:14.756363 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf2c8db-98d1-478d-b0d2-0d0c947b8094 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41b893bdf4ec474dbfa819c22fc29ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:46:14.757022 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf2c8db-98d1-478d-b0d2-0d0c947b8094 service nova] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:46:14.757314 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf2c8db-98d1-478d-b0d2-0d0c947b8094 service nova] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:46:14.757619 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf2c8db-98d1-478d-b0d2-0d0c947b8094 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:46:14.759511 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-ebf2c8db-98d1-478d-b0d2-0d0c947b8094 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:46:14.816018 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:46:14.857793 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf2c8db-98d1-478d-b0d2-0d0c947b8094 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:46:14.859427 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf2c8db-98d1-478d-b0d2-0d0c947b8094 service nova] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:46:14.879048 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 695/1385] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:46:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:46:16.937412 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c6bae-9774-4e2f-81ef-92ca945d7c56 None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:46:16.938122 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c6bae-9774-4e2f-81ef-92ca945d7c56 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:46:16.938122 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c6bae-9774-4e2f-81ef-92ca945d7c56 None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:46:16.939362 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 691/1386] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:46:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:46:16.945324 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155b2bbb-496a-4546-a9e9-a790c621ebb6 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:46:16.945829 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155b2bbb-496a-4546-a9e9-a790c621ebb6 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:46:16.945919 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155b2bbb-496a-4546-a9e9-a790c621ebb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:46:17.016410 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-155b2bbb-496a-4546-a9e9-a790c621ebb6 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:46:17.017589 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-155b2bbb-496a-4546-a9e9-a790c621ebb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:46:17.118136 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 696/1387] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:46:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:46:17.168337 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2c6bae-9774-4e2f-81ef-92ca945d7c56 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:46:17.169890 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-6c2c6bae-9774-4e2f-81ef-92ca945d7c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:46:17.248676 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:46:17.318345 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2c6bae-9774-4e2f-81ef-92ca945d7c56 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:46:17.442040 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd233114-e8e0-4264-8b19-6b96873063fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41b893bdf4ec474dbfa819c22fc29ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:46:17.442690 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd233114-e8e0-4264-8b19-6b96873063fd service nova] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:46:17.443086 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd233114-e8e0-4264-8b19-6b96873063fd service nova] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:46:17.443475 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd233114-e8e0-4264-8b19-6b96873063fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:46:17.445006 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-fd233114-e8e0-4264-8b19-6b96873063fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:46:17.495590 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:46:17.553786 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd233114-e8e0-4264-8b19-6b96873063fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:46:17.555789 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd233114-e8e0-4264-8b19-6b96873063fd service nova] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:46:17.581656 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 692/1388] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:46:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:46:19.945774 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e3d6bc-2e39-4e3a-b45b-50947f737427 None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:46:19.946381 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e3d6bc-2e39-4e3a-b45b-50947f737427 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:46:19.946381 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e3d6bc-2e39-4e3a-b45b-50947f737427 None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:46:19.947700 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 697/1389] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:46:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:46:19.952962 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56250ed-5447-4cd4-a834-efc5e28bc31f None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:46:19.953426 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56250ed-5447-4cd4-a834-efc5e28bc31f None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:46:19.953649 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56250ed-5447-4cd4-a834-efc5e28bc31f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:46:20.021278 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-c56250ed-5447-4cd4-a834-efc5e28bc31f None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:46:20.022507 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-c56250ed-5447-4cd4-a834-efc5e28bc31f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:46:20.120441 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 693/1390] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:46:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:46:20.165339 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e3d6bc-2e39-4e3a-b45b-50947f737427 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:46:20.168168 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-02e3d6bc-2e39-4e3a-b45b-50947f737427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:46:20.205733 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:46:20.328584 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e3d6bc-2e39-4e3a-b45b-50947f737427 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:46:20.434854 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:46:20.447291 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0b6311-5eaa-4b53-bc9d-e7c2224582c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41b893bdf4ec474dbfa819c22fc29ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:46:20.447951 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b6311-5eaa-4b53-bc9d-e7c2224582c8 service nova] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:46:20.448239 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b6311-5eaa-4b53-bc9d-e7c2224582c8 service nova] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:46:20.448514 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b6311-5eaa-4b53-bc9d-e7c2224582c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:46:20.450493 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-db0b6311-5eaa-4b53-bc9d-e7c2224582c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:46:20.546303 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0b6311-5eaa-4b53-bc9d-e7c2224582c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:46:20.547919 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0b6311-5eaa-4b53-bc9d-e7c2224582c8 service nova] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:46:20.566168 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 698/1391] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:46:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:46:20.798651 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc5c66-f01c-4bba-b747-54b843e78bb4 None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:46:20.798873 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc5c66-f01c-4bba-b747-54b843e78bb4 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:46:20.799128 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc5c66-f01c-4bba-b747-54b843e78bb4 None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:46:20.800520 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 694/1392] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:46:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:46:20.806919 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a44dbda-1a46-4426-adbc-b994b7174a94 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:46:20.807206 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a44dbda-1a46-4426-adbc-b994b7174a94 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:46:20.807480 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a44dbda-1a46-4426-adbc-b994b7174a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:46:20.879885 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-9a44dbda-1a46-4426-adbc-b994b7174a94 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:46:20.881634 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-9a44dbda-1a46-4426-adbc-b994b7174a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:46:20.942196 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:46:20.983250 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 699/1393] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:46:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:46:21.040389 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf69fb27-ebd3-48ae-9bc6-3cfd5f205bd5 None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:46:21.040840 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf69fb27-ebd3-48ae-9bc6-3cfd5f205bd5 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:46:21.040959 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf69fb27-ebd3-48ae-9bc6-3cfd5f205bd5 None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:46:21.042348 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 695/1394] 10.222.0.67 () {54 vars in 962 bytes} [Thu Jul 14 17:46:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:46:21.047402 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8611a5e-472f-44f2-bcf6-5b2d81d77dc3 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:46:21.047700 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8611a5e-472f-44f2-bcf6-5b2d81d77dc3 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:46:21.047980 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8611a5e-472f-44f2-bcf6-5b2d81d77dc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:46:21.126969 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-a8611a5e-472f-44f2-bcf6-5b2d81d77dc3 None None] MFA Rules not processed for user `4eb7180aab4541b4aab6cf8648eac1f1`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:46:21.128198 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-a8611a5e-472f-44f2-bcf6-5b2d81d77dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:46:21.205142 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 700/1395] 10.222.0.67 () {58 vars in 1059 bytes} [Thu Jul 14 17:46:21 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:46:21.213172 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf69fb27-ebd3-48ae-9bc6-3cfd5f205bd5 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:46:21.214753 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-bf69fb27-ebd3-48ae-9bc6-3cfd5f205bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:46:21.229185 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:46:21.320646 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf69fb27-ebd3-48ae-9bc6-3cfd5f205bd5 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:46:21.399247 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad7aa50-4c3b-4f91-a54e-b2963282af1f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eb7180aab4541b4aab6cf8648eac1f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:46:21.399812 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad7aa50-4c3b-4f91-a54e-b2963282af1f service glance] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:46:21.400089 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad7aa50-4c3b-4f91-a54e-b2963282af1f service glance] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:46:21.400362 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad7aa50-4c3b-4f91-a54e-b2963282af1f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:46:21.402141 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-1ad7aa50-4c3b-4f91-a54e-b2963282af1f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:46:21.473057 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:46:21.516848 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad7aa50-4c3b-4f91-a54e-b2963282af1f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:46:21.518959 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad7aa50-4c3b-4f91-a54e-b2963282af1f service glance] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:46:21.538092 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 696/1396] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:46:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:46:22.266713 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4335cd-c05c-4459-b98f-b8b6612c984c None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:46:22.267210 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4335cd-c05c-4459-b98f-b8b6612c984c None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:46:22.267301 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4335cd-c05c-4459-b98f-b8b6612c984c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:46:22.336870 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-bf4335cd-c05c-4459-b98f-b8b6612c984c None None] MFA Rules not processed for user `45542602225b452fa323f5499c1843ec`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:46:22.338107 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-bf4335cd-c05c-4459-b98f-b8b6612c984c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:46:22.346796 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:46:22.432651 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 701/1397] 10.222.0.67 () {58 vars in 1009 bytes} [Thu Jul 14 17:46:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:46:22.479341 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57388db4-a0ec-4b16-979f-88ffa1de9998 None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:46:22.479904 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57388db4-a0ec-4b16-979f-88ffa1de9998 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:46:22.479904 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57388db4-a0ec-4b16-979f-88ffa1de9998 None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:46:22.481366 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 697/1398] 10.222.0.67 () {54 vars in 942 bytes} [Thu Jul 14 17:46:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:46:22.488509 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7320f2-dec4-4896-b55c-3e0f431e0232 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:46:22.489056 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7320f2-dec4-4896-b55c-3e0f431e0232 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:46:22.489364 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7320f2-dec4-4896-b55c-3e0f431e0232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:46:22.567937 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-9c7320f2-dec4-4896-b55c-3e0f431e0232 None None] MFA Rules not processed for user `c65607a396474192a43c374d306ef5ba`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:46:22.569838 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-9c7320f2-dec4-4896-b55c-3e0f431e0232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:46:22.654063 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:46:22.671888 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1f333f-196e-4bb8-a9db-42db13879719 None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:46:22.672174 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1f333f-196e-4bb8-a9db-42db13879719 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:46:22.672457 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1f333f-196e-4bb8-a9db-42db13879719 None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:46:22.673883 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 698/1399] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:46:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 17:46:22.678784 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 702/1400] 10.222.0.67 () {58 vars in 1039 bytes} [Thu Jul 14 17:46:22 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:46:22.679431 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa7a758-9714-4535-8438-cee6bd10f727 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:46:22.679730 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa7a758-9714-4535-8438-cee6bd10f727 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:46:22.679994 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa7a758-9714-4535-8438-cee6bd10f727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:46:22.688049 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7320f2-dec4-4896-b55c-3e0f431e0232 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:46:22.698401 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7320f2-dec4-4896-b55c-3e0f431e0232 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:46:22.748028 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-eaa7a758-9714-4535-8438-cee6bd10f727 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:46:22.749191 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-eaa7a758-9714-4535-8438-cee6bd10f727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:46:22.811070 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc879ed-d1a3-413b-8cbe-e23199e132c8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c65607a396474192a43c374d306ef5ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:46:22.811898 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc879ed-d1a3-413b-8cbe-e23199e132c8 service swift] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:46:22.812311 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc879ed-d1a3-413b-8cbe-e23199e132c8 service swift] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:46:22.812685 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc879ed-d1a3-413b-8cbe-e23199e132c8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:46:22.814510 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-5dc879ed-d1a3-413b-8cbe-e23199e132c8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:46:22.877440 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 699/1401] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:46:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 17:46:22.933639 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa7a758-9714-4535-8438-cee6bd10f727 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:46:22.938135 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc879ed-d1a3-413b-8cbe-e23199e132c8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:46:22.939786 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc879ed-d1a3-413b-8cbe-e23199e132c8 service swift] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:46:22.942729 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-eaa7a758-9714-4535-8438-cee6bd10f727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:46:22.952161 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 703/1402] 10.222.0.67 () {60 vars in 1384 bytes} [Thu Jul 14 17:46:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 14 17:46:22.986327 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:46:23.093855 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa7a758-9714-4535-8438-cee6bd10f727 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:46:23.231614 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1c8255-a9ac-4181-9c74-44f5ee3103de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41b893bdf4ec474dbfa819c22fc29ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:46:23.232280 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1c8255-a9ac-4181-9c74-44f5ee3103de service nova] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:46:23.232591 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1c8255-a9ac-4181-9c74-44f5ee3103de service nova] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:46:23.232866 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1c8255-a9ac-4181-9c74-44f5ee3103de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:46:23.234604 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-2b1c8255-a9ac-4181-9c74-44f5ee3103de service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:46:23.259626 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:46:23.346778 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1c8255-a9ac-4181-9c74-44f5ee3103de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:46:23.348770 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1c8255-a9ac-4181-9c74-44f5ee3103de service nova] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:46:23.369657 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 700/1403] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:46:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 17:46:25.513394 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7db7ade-adab-4021-abb0-84c829ba93a4 None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:46:25.514074 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7db7ade-adab-4021-abb0-84c829ba93a4 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:46:25.514270 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7db7ade-adab-4021-abb0-84c829ba93a4 None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:46:25.515789 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 704/1404] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:46:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:46:25.521176 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee65a56a-01e3-4771-a9eb-54db4d6b87d2 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:46:25.522230 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee65a56a-01e3-4771-a9eb-54db4d6b87d2 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:46:25.522311 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee65a56a-01e3-4771-a9eb-54db4d6b87d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:46:25.614977 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-ee65a56a-01e3-4771-a9eb-54db4d6b87d2 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:46:25.617077 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-ee65a56a-01e3-4771-a9eb-54db4d6b87d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:46:25.733784 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:46:25.741680 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 701/1405] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:46:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:46:25.792787 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7db7ade-adab-4021-abb0-84c829ba93a4 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:46:25.796749 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-f7db7ade-adab-4021-abb0-84c829ba93a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:46:25.808512 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:46:25.971106 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7db7ade-adab-4021-abb0-84c829ba93a4 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:46:26.065105 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:46:26.113937 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167dd2b6-2dca-49dc-86ff-efdb773d512a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41b893bdf4ec474dbfa819c22fc29ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:46:26.114661 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167dd2b6-2dca-49dc-86ff-efdb773d512a service nova] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:46:26.114946 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167dd2b6-2dca-49dc-86ff-efdb773d512a service nova] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:46:26.115836 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167dd2b6-2dca-49dc-86ff-efdb773d512a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:46:26.117621 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-167dd2b6-2dca-49dc-86ff-efdb773d512a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:46:26.228241 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167dd2b6-2dca-49dc-86ff-efdb773d512a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:46:26.230285 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167dd2b6-2dca-49dc-86ff-efdb773d512a service nova] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:46:26.253567 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 705/1406] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:46:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 17:46:28.363489 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af4db2c-c3fc-48e3-8653-62195930d021 None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:46:28.364464 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af4db2c-c3fc-48e3-8653-62195930d021 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:46:28.364746 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af4db2c-c3fc-48e3-8653-62195930d021 None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:46:28.367429 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 702/1407] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:46:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:46:28.372132 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a356ab93-34fa-4a55-8f28-424316068e11 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:46:28.372691 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a356ab93-34fa-4a55-8f28-424316068e11 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:46:28.372691 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a356ab93-34fa-4a55-8f28-424316068e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:46:28.445257 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-a356ab93-34fa-4a55-8f28-424316068e11 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:46:28.446556 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-a356ab93-34fa-4a55-8f28-424316068e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:46:28.508271 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:46:28.562034 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 706/1408] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:46:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:46:28.629851 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af4db2c-c3fc-48e3-8653-62195930d021 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:46:28.632063 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-1af4db2c-c3fc-48e3-8653-62195930d021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:46:28.810209 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af4db2c-c3fc-48e3-8653-62195930d021 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:46:28.886331 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:46:28.938484 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0298659f-4500-4150-818f-6eec43e4d47b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41b893bdf4ec474dbfa819c22fc29ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:46:28.939144 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0298659f-4500-4150-818f-6eec43e4d47b service nova] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:46:28.939558 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0298659f-4500-4150-818f-6eec43e4d47b service nova] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:46:28.940005 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0298659f-4500-4150-818f-6eec43e4d47b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:46:28.941816 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-0298659f-4500-4150-818f-6eec43e4d47b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:46:29.050306 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0298659f-4500-4150-818f-6eec43e4d47b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:46:29.052197 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0298659f-4500-4150-818f-6eec43e4d47b service nova] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:46:29.074428 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 703/1409] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:46:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:46:38.560301 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=23 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:46:39.070413 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=64 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:46:45.080043 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf2ae5-ad65-47b9-bc7f-0b8631bf8465 None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:46:45.080612 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf2ae5-ad65-47b9-bc7f-0b8631bf8465 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:46:45.080612 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf2ae5-ad65-47b9-bc7f-0b8631bf8465 None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:46:45.082013 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 707/1410] 10.222.0.67 () {54 vars in 918 bytes} [Thu Jul 14 17:46:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:46:45.087746 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b9bb02-987d-4816-a707-7f0109fe2c1f None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:46:45.088237 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b9bb02-987d-4816-a707-7f0109fe2c1f None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:46:45.088349 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b9bb02-987d-4816-a707-7f0109fe2c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:46:45.162935 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-32b9bb02-987d-4816-a707-7f0109fe2c1f None None] MFA Rules not processed for user `5324ab45f4a4449980dad920278f5034`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:46:45.164707 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-32b9bb02-987d-4816-a707-7f0109fe2c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:46:45.267916 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 704/1411] 10.222.0.67 () {58 vars in 1015 bytes} [Thu Jul 14 17:46:45 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:46:45.282857 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff32b8-6194-47f3-be9d-12754d90210e None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:46:45.283138 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff32b8-6194-47f3-be9d-12754d90210e None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:46:45.283442 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff32b8-6194-47f3-be9d-12754d90210e None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:46:45.284794 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 708/1412] 10.222.0.67 () {54 vars in 918 bytes} [Thu Jul 14 17:46:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:46:45.290070 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44f486b-32ec-42d3-842c-9a8fb8f013e2 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:46:45.290354 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44f486b-32ec-42d3-842c-9a8fb8f013e2 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:46:45.290627 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44f486b-32ec-42d3-842c-9a8fb8f013e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:46:45.360100 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:46:45.362911 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-e44f486b-32ec-42d3-842c-9a8fb8f013e2 None None] MFA Rules not processed for user `41b893bdf4ec474dbfa819c22fc29ce9`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:46:45.364635 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-e44f486b-32ec-42d3-842c-9a8fb8f013e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:46:45.482066 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 705/1413] 10.222.0.67 () {58 vars in 1015 bytes} [Thu Jul 14 17:46:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:46:47.992816 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0647b65d-af44-4b77-a670-dfede9b01a5d None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:46:47.993380 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0647b65d-af44-4b77-a670-dfede9b01a5d None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:46:47.993380 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0647b65d-af44-4b77-a670-dfede9b01a5d None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:46:47.994741 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 709/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 17:46:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:46:47.999991 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1da218-e7e1-438d-af8b-bc0857ff72ea None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:46:48.000434 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1da218-e7e1-438d-af8b-bc0857ff72ea None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:46:48.000593 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1da218-e7e1-438d-af8b-bc0857ff72ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:46:48.067111 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-be1da218-e7e1-438d-af8b-bc0857ff72ea None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:46:48.068339 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-be1da218-e7e1-438d-af8b-bc0857ff72ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:46:48.123341 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:46:48.165806 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 706/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 17:46:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:46:48.209760 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0647b65d-af44-4b77-a670-dfede9b01a5d None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:46:48.211345 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-0647b65d-af44-4b77-a670-dfede9b01a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:46:48.355183 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0647b65d-af44-4b77-a670-dfede9b01a5d None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:46:48.427767 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:46:48.468633 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cea74d7-9ee0-4e50-b1a2-efb1a02a92cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41b893bdf4ec474dbfa819c22fc29ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:46:48.469289 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cea74d7-9ee0-4e50-b1a2-efb1a02a92cb service nova] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:46:48.469601 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cea74d7-9ee0-4e50-b1a2-efb1a02a92cb service nova] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:46:48.469887 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cea74d7-9ee0-4e50-b1a2-efb1a02a92cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:46:48.471543 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-0cea74d7-9ee0-4e50-b1a2-efb1a02a92cb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:46:48.561449 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cea74d7-9ee0-4e50-b1a2-efb1a02a92cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:46:48.563095 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cea74d7-9ee0-4e50-b1a2-efb1a02a92cb service nova] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:46:48.580905 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 710/1416] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:46:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:46:49.489455 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c03f3-00f8-4cd0-9e39-54bc6baa4d6e None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:46:49.490000 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c03f3-00f8-4cd0-9e39-54bc6baa4d6e None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:46:49.490108 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c03f3-00f8-4cd0-9e39-54bc6baa4d6e None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:46:49.492121 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 707/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 17:46:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:46:49.496988 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b341a63c-2a1b-4fb5-b600-5b0486add4b9 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:46:49.497445 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b341a63c-2a1b-4fb5-b600-5b0486add4b9 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:46:49.497570 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b341a63c-2a1b-4fb5-b600-5b0486add4b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:46:49.573217 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-b341a63c-2a1b-4fb5-b600-5b0486add4b9 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:46:49.574482 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-b341a63c-2a1b-4fb5-b600-5b0486add4b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:46:49.603001 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:46:49.676923 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 711/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 17:46:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 17:46:49.826850 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30c03f3-00f8-4cd0-9e39-54bc6baa4d6e None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:46:49.828297 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-f30c03f3-00f8-4cd0-9e39-54bc6baa4d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:46:49.984636 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30c03f3-00f8-4cd0-9e39-54bc6baa4d6e None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:46:50.028122 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:46:50.106070 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bc43b2-7fc1-4fa5-8948-8473b3be7900 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41b893bdf4ec474dbfa819c22fc29ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:46:50.106731 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc43b2-7fc1-4fa5-8948-8473b3be7900 service nova] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:46:50.107011 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc43b2-7fc1-4fa5-8948-8473b3be7900 service nova] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:46:50.107286 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc43b2-7fc1-4fa5-8948-8473b3be7900 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:46:50.108958 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-f5bc43b2-7fc1-4fa5-8948-8473b3be7900 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:46:50.199665 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bc43b2-7fc1-4fa5-8948-8473b3be7900 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:46:50.201277 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bc43b2-7fc1-4fa5-8948-8473b3be7900 service nova] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:46:50.219310 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 708/1419] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:46:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:46:51.125342 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646d2e53-a6c9-4db6-8e3d-5cb8cdc72c84 None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:46:51.125918 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646d2e53-a6c9-4db6-8e3d-5cb8cdc72c84 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:46:51.126033 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646d2e53-a6c9-4db6-8e3d-5cb8cdc72c84 None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:46:51.127347 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 712/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 17:46:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:46:51.133132 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01594e62-d229-4823-95a7-e1f7540da4c8 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:46:51.133624 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01594e62-d229-4823-95a7-e1f7540da4c8 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:46:51.133752 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01594e62-d229-4823-95a7-e1f7540da4c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:46:51.187317 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:46:51.210282 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-01594e62-d229-4823-95a7-e1f7540da4c8 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:46:51.211519 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-01594e62-d229-4823-95a7-e1f7540da4c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:46:51.307099 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 709/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 17:46:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:46:51.458630 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646d2e53-a6c9-4db6-8e3d-5cb8cdc72c84 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:46:51.460140 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-646d2e53-a6c9-4db6-8e3d-5cb8cdc72c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:46:51.604779 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646d2e53-a6c9-4db6-8e3d-5cb8cdc72c84 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:46:51.617801 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:46:51.723508 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9e6ba5-8ce1-4d2e-8029-30a8c8abc74a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41b893bdf4ec474dbfa819c22fc29ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:46:51.724181 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e6ba5-8ce1-4d2e-8029-30a8c8abc74a service nova] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:46:51.724470 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e6ba5-8ce1-4d2e-8029-30a8c8abc74a service nova] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:46:51.724747 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e6ba5-8ce1-4d2e-8029-30a8c8abc74a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:46:51.727026 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-0a9e6ba5-8ce1-4d2e-8029-30a8c8abc74a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:46:51.825863 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9e6ba5-8ce1-4d2e-8029-30a8c8abc74a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:46:51.827494 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9e6ba5-8ce1-4d2e-8029-30a8c8abc74a service nova] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:46:51.846893 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 713/1422] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:46:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:46:52.730824 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a0952-dce2-4c4c-ada7-8d2e9a266fd2 None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:46:52.731375 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a0952-dce2-4c4c-ada7-8d2e9a266fd2 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:46:52.731375 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a0952-dce2-4c4c-ada7-8d2e9a266fd2 None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:46:52.732670 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 710/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 17:46:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:46:52.737875 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e45795-0ff0-46e4-a987-209e136ddeed None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:46:52.738342 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e45795-0ff0-46e4-a987-209e136ddeed None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:46:52.738449 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e45795-0ff0-46e4-a987-209e136ddeed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:46:52.758093 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:46:52.820930 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-92e45795-0ff0-46e4-a987-209e136ddeed None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:46:52.822212 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-92e45795-0ff0-46e4-a987-209e136ddeed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:46:52.921432 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 714/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 17:46:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:46:53.078407 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5a0952-dce2-4c4c-ada7-8d2e9a266fd2 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:46:53.079982 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-9a5a0952-dce2-4c4c-ada7-8d2e9a266fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:46:53.189709 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:46:53.225024 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5a0952-dce2-4c4c-ada7-8d2e9a266fd2 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:46:53.338583 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c182e9-eaa3-444b-ba56-d5fdad01e1d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41b893bdf4ec474dbfa819c22fc29ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:46:53.339150 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c182e9-eaa3-444b-ba56-d5fdad01e1d2 service nova] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:46:53.339436 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c182e9-eaa3-444b-ba56-d5fdad01e1d2 service nova] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:46:53.339716 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c182e9-eaa3-444b-ba56-d5fdad01e1d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:46:53.341379 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-22c182e9-eaa3-444b-ba56-d5fdad01e1d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:46:53.418719 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:46:53.432642 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c182e9-eaa3-444b-ba56-d5fdad01e1d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:46:53.434311 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c182e9-eaa3-444b-ba56-d5fdad01e1d2 service nova] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:46:53.452280 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 711/1425] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:46:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:46:54.322863 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d594de-cef8-42e3-afa6-90abbbf39b33 None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:46:54.323444 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d594de-cef8-42e3-afa6-90abbbf39b33 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:46:54.323444 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d594de-cef8-42e3-afa6-90abbbf39b33 None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:46:54.324786 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 715/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 17:46:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:46:54.329811 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eab34b7-8c93-4fa7-b645-d109103ed22a None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:46:54.330212 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eab34b7-8c93-4fa7-b645-d109103ed22a None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:46:54.330372 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eab34b7-8c93-4fa7-b645-d109103ed22a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:46:54.406844 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-2eab34b7-8c93-4fa7-b645-d109103ed22a None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:46:54.408065 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-2eab34b7-8c93-4fa7-b645-d109103ed22a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:46:54.506589 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 712/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 17:46:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:46:54.655700 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d594de-cef8-42e3-afa6-90abbbf39b33 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:46:54.657264 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-b7d594de-cef8-42e3-afa6-90abbbf39b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:46:54.740350 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:46:54.803142 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d594de-cef8-42e3-afa6-90abbbf39b33 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:46:54.918631 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f90ed2-596b-44f0-9944-86b3d3786b1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41b893bdf4ec474dbfa819c22fc29ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:46:54.919193 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f90ed2-596b-44f0-9944-86b3d3786b1b service nova] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:46:54.919480 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f90ed2-596b-44f0-9944-86b3d3786b1b service nova] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:46:54.919755 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f90ed2-596b-44f0-9944-86b3d3786b1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:46:54.921410 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-67f90ed2-596b-44f0-9944-86b3d3786b1b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:46:54.968807 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:46:55.010125 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f90ed2-596b-44f0-9944-86b3d3786b1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:46:55.011740 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f90ed2-596b-44f0-9944-86b3d3786b1b service nova] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:46:55.030815 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 716/1428] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:46:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:46:55.847402 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3266a9c-7283-4e26-91c4-944573ef0777 None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:46:55.848002 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3266a9c-7283-4e26-91c4-944573ef0777 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:46:55.848002 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3266a9c-7283-4e26-91c4-944573ef0777 None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:46:55.849337 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 713/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 17:46:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:46:55.855048 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a46167-1fbf-4e14-aafb-815d6a4099be None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:46:55.855471 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a46167-1fbf-4e14-aafb-815d6a4099be None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:46:55.855587 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a46167-1fbf-4e14-aafb-815d6a4099be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:46:55.933445 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-c3a46167-1fbf-4e14-aafb-815d6a4099be None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:46:55.934713 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-c3a46167-1fbf-4e14-aafb-815d6a4099be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:46:56.033150 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 717/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 17:46:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:46:56.182668 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3266a9c-7283-4e26-91c4-944573ef0777 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:46:56.184181 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-b3266a9c-7283-4e26-91c4-944573ef0777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:46:56.232546 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:46:56.332366 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3266a9c-7283-4e26-91c4-944573ef0777 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:46:56.449864 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcef7db6-3b4e-4f75-8d1c-b1a3d082f4bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41b893bdf4ec474dbfa819c22fc29ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:46:56.450511 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef7db6-3b4e-4f75-8d1c-b1a3d082f4bf service nova] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:46:56.450798 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef7db6-3b4e-4f75-8d1c-b1a3d082f4bf service nova] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:46:56.451074 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef7db6-3b4e-4f75-8d1c-b1a3d082f4bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:46:56.452717 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-fcef7db6-3b4e-4f75-8d1c-b1a3d082f4bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:46:56.462047 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:46:56.546083 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcef7db6-3b4e-4f75-8d1c-b1a3d082f4bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:46:56.547699 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcef7db6-3b4e-4f75-8d1c-b1a3d082f4bf service nova] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:46:56.566061 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 714/1431] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:46:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:46:57.371811 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb46469d-eb82-4f1e-8043-593f4d4a4184 None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:46:57.372379 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb46469d-eb82-4f1e-8043-593f4d4a4184 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:46:57.372379 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb46469d-eb82-4f1e-8043-593f4d4a4184 None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:46:57.373786 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 718/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 17:46:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:46:57.378740 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b62185-eb0f-45d6-b4dc-8fa8f14103ab None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:46:57.379154 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b62185-eb0f-45d6-b4dc-8fa8f14103ab None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:46:57.379278 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b62185-eb0f-45d6-b4dc-8fa8f14103ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:46:57.453791 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-76b62185-eb0f-45d6-b4dc-8fa8f14103ab None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:46:57.455015 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-76b62185-eb0f-45d6-b4dc-8fa8f14103ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:46:57.526383 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:46:57.557113 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 715/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 17:46:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:46:57.708965 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb46469d-eb82-4f1e-8043-593f4d4a4184 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:46:57.711046 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-eb46469d-eb82-4f1e-8043-593f4d4a4184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:46:57.728041 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:46:57.861517 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb46469d-eb82-4f1e-8043-593f4d4a4184 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:46:57.947737 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:46:57.973262 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8f96a7-4564-454f-93a6-0ff6bbcc0a56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41b893bdf4ec474dbfa819c22fc29ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:46:57.973884 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f96a7-4564-454f-93a6-0ff6bbcc0a56 service nova] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:46:57.974171 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f96a7-4564-454f-93a6-0ff6bbcc0a56 service nova] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:46:57.974447 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f96a7-4564-454f-93a6-0ff6bbcc0a56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:46:57.976124 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-2b8f96a7-4564-454f-93a6-0ff6bbcc0a56 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:46:58.063621 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8f96a7-4564-454f-93a6-0ff6bbcc0a56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:46:58.065214 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8f96a7-4564-454f-93a6-0ff6bbcc0a56 service nova] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:46:58.083528 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 719/1434] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:46:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:46:58.883104 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70737fe-b251-43d4-9985-67d6728006ce None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:46:58.883669 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70737fe-b251-43d4-9985-67d6728006ce None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:46:58.883669 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70737fe-b251-43d4-9985-67d6728006ce None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:46:58.885113 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 716/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 17:46:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:46:58.890022 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18553da8-e7d4-4447-b012-eab26889c2c3 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:46:58.890441 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18553da8-e7d4-4447-b012-eab26889c2c3 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:46:58.890562 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18553da8-e7d4-4447-b012-eab26889c2c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:46:58.964609 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-18553da8-e7d4-4447-b012-eab26889c2c3 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:46:58.965832 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-18553da8-e7d4-4447-b012-eab26889c2c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:46:59.005696 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:46:59.062041 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 720/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 17:46:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:46:59.212965 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70737fe-b251-43d4-9985-67d6728006ce None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:46:59.214503 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-d70737fe-b251-43d4-9985-67d6728006ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:46:59.364033 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70737fe-b251-43d4-9985-67d6728006ce None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:46:59.419029 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:46:59.483159 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050f5483-325d-4619-b9b7-e6255727cc88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41b893bdf4ec474dbfa819c22fc29ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:46:59.483807 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f5483-325d-4619-b9b7-e6255727cc88 service nova] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:46:59.484085 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f5483-325d-4619-b9b7-e6255727cc88 service nova] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:46:59.484357 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f5483-325d-4619-b9b7-e6255727cc88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:46:59.486019 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-050f5483-325d-4619-b9b7-e6255727cc88 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:46:59.575131 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050f5483-325d-4619-b9b7-e6255727cc88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:46:59.576713 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050f5483-325d-4619-b9b7-e6255727cc88 service nova] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:46:59.594573 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 717/1437] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:46:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:47:00.402616 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f41bc3-fbf5-4538-a4a3-1c56d7999264 None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:47:00.403198 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f41bc3-fbf5-4538-a4a3-1c56d7999264 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:47:00.403198 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f41bc3-fbf5-4538-a4a3-1c56d7999264 None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:47:00.404614 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 721/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 17:47:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:47:00.409707 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb6e1b6-c71a-4781-b9af-c2d553eee373 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:47:00.410111 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb6e1b6-c71a-4781-b9af-c2d553eee373 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:47:00.410269 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb6e1b6-c71a-4781-b9af-c2d553eee373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:47:00.484256 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-ffb6e1b6-c71a-4781-b9af-c2d553eee373 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:47:00.485501 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-ffb6e1b6-c71a-4781-b9af-c2d553eee373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:47:00.487553 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:47:00.581042 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 718/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 17:47:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:47:00.729801 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f41bc3-fbf5-4538-a4a3-1c56d7999264 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:47:00.731237 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-05f41bc3-fbf5-4538-a4a3-1c56d7999264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:47:00.879775 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f41bc3-fbf5-4538-a4a3-1c56d7999264 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:47:00.907098 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:47:00.993078 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7db0d9-3203-4a0d-99ea-c0a10a00431f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41b893bdf4ec474dbfa819c22fc29ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:47:00.993765 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7db0d9-3203-4a0d-99ea-c0a10a00431f service nova] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:47:00.994123 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7db0d9-3203-4a0d-99ea-c0a10a00431f service nova] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:47:00.994304 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7db0d9-3203-4a0d-99ea-c0a10a00431f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:47:00.995944 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-6c7db0d9-3203-4a0d-99ea-c0a10a00431f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:47:01.090199 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7db0d9-3203-4a0d-99ea-c0a10a00431f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:47:01.091814 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7db0d9-3203-4a0d-99ea-c0a10a00431f service nova] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:47:01.110347 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 722/1440] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:47:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:47:03.050255 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b43fed-5382-442b-bef2-63749a49d3d0 None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:47:03.050814 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b43fed-5382-442b-bef2-63749a49d3d0 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:47:03.050814 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b43fed-5382-442b-bef2-63749a49d3d0 None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:47:03.052180 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 719/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 17:47:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:47:03.058223 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091d1062-e442-4fc6-a02a-331a05cd1621 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:47:03.058660 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091d1062-e442-4fc6-a02a-331a05cd1621 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:47:03.058800 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091d1062-e442-4fc6-a02a-331a05cd1621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:47:03.099400 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:47:03.124698 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-091d1062-e442-4fc6-a02a-331a05cd1621 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:47:03.125940 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-091d1062-e442-4fc6-a02a-331a05cd1621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:47:03.220142 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 723/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 17:47:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:47:03.259531 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b43fed-5382-442b-bef2-63749a49d3d0 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:47:03.261094 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-e9b43fed-5382-442b-bef2-63749a49d3d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:47:03.368081 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b43fed-5382-442b-bef2-63749a49d3d0 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:47:03.402078 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:47:03.443957 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f97e17-3894-490e-ac5a-711444ee140b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:47:03.444641 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f97e17-3894-490e-ac5a-711444ee140b service neutron] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:47:03.444923 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f97e17-3894-490e-ac5a-711444ee140b service neutron] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:47:03.445719 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f97e17-3894-490e-ac5a-711444ee140b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:47:03.447422 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-a6f97e17-3894-490e-ac5a-711444ee140b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:47:03.562748 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f97e17-3894-490e-ac5a-711444ee140b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:47:03.564102 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f97e17-3894-490e-ac5a-711444ee140b service neutron] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:47:03.584393 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 720/1443] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:47:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:47:05.774977 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc59a90-1ce5-4f7e-9741-2fe66fc56139 None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:47:05.775516 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc59a90-1ce5-4f7e-9741-2fe66fc56139 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:47:05.775516 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc59a90-1ce5-4f7e-9741-2fe66fc56139 None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:47:05.776855 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 724/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 17:47:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:47:05.782155 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a9a627-14a0-43d7-9437-09794544dccc None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:47:05.782613 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a9a627-14a0-43d7-9437-09794544dccc None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:47:05.782721 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a9a627-14a0-43d7-9437-09794544dccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:47:05.971522 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-57a9a627-14a0-43d7-9437-09794544dccc None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:47:05.972757 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-57a9a627-14a0-43d7-9437-09794544dccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:47:05.985251 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:47:06.072102 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 721/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 17:47:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:47:06.109550 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc59a90-1ce5-4f7e-9741-2fe66fc56139 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:47:06.111094 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-7bc59a90-1ce5-4f7e-9741-2fe66fc56139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:47:06.214158 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc59a90-1ce5-4f7e-9741-2fe66fc56139 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:47:06.226147 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:47:06.288295 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f5e894-33b3-45ab-8e6d-bab18d4a4d47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:47:06.288943 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f5e894-33b3-45ab-8e6d-bab18d4a4d47 service neutron] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:47:06.289222 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f5e894-33b3-45ab-8e6d-bab18d4a4d47 service neutron] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:47:06.289494 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f5e894-33b3-45ab-8e6d-bab18d4a4d47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:47:06.291167 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-04f5e894-33b3-45ab-8e6d-bab18d4a4d47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:47:06.399164 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f5e894-33b3-45ab-8e6d-bab18d4a4d47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:47:06.400600 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f5e894-33b3-45ab-8e6d-bab18d4a4d47 service neutron] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:47:06.418671 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 725/1446] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:47:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:47:08.805727 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d91413-2a7e-4fa5-9f3d-38d43de0dc70 None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:47:08.806301 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d91413-2a7e-4fa5-9f3d-38d43de0dc70 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:47:08.806301 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d91413-2a7e-4fa5-9f3d-38d43de0dc70 None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:47:08.807630 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 722/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 17:47:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:47:08.813763 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de53de7-2018-47dc-8dfe-b62514304f29 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:47:08.814300 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de53de7-2018-47dc-8dfe-b62514304f29 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:47:08.814300 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de53de7-2018-47dc-8dfe-b62514304f29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:47:08.861752 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:47:08.880499 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-1de53de7-2018-47dc-8dfe-b62514304f29 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:47:08.881763 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-1de53de7-2018-47dc-8dfe-b62514304f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:47:08.978339 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 726/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 17:47:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:47:09.017348 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d91413-2a7e-4fa5-9f3d-38d43de0dc70 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:47:09.018923 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-e7d91413-2a7e-4fa5-9f3d-38d43de0dc70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:47:09.122781 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d91413-2a7e-4fa5-9f3d-38d43de0dc70 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:47:09.162047 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:47:09.197953 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c035d8-5e18-44cc-b258-c5837a26a988 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:47:09.198599 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c035d8-5e18-44cc-b258-c5837a26a988 service neutron] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:47:09.198879 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c035d8-5e18-44cc-b258-c5837a26a988 service neutron] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:47:09.199151 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c035d8-5e18-44cc-b258-c5837a26a988 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:47:09.200803 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-50c035d8-5e18-44cc-b258-c5837a26a988 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:47:09.308341 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c035d8-5e18-44cc-b258-c5837a26a988 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:47:09.309799 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c035d8-5e18-44cc-b258-c5837a26a988 service neutron] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:47:09.331871 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 723/1449] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:47:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:47:11.504742 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd2da4d-e3bf-4309-ad0c-1bbf2474a800 None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:47:11.505273 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd2da4d-e3bf-4309-ad0c-1bbf2474a800 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:47:11.505380 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd2da4d-e3bf-4309-ad0c-1bbf2474a800 None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:47:11.506713 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 727/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 17:47:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:47:11.511975 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f85fc-0982-4419-9792-263f06bb5bf7 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:47:11.512454 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f85fc-0982-4419-9792-263f06bb5bf7 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:47:11.512563 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f85fc-0982-4419-9792-263f06bb5bf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:47:11.576094 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-8b6f85fc-0982-4419-9792-263f06bb5bf7 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:47:11.577291 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-8b6f85fc-0982-4419-9792-263f06bb5bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:47:11.597824 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:47:11.675655 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 724/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 17:47:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:47:11.715314 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd2da4d-e3bf-4309-ad0c-1bbf2474a800 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:47:11.716850 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-8cd2da4d-e3bf-4309-ad0c-1bbf2474a800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:47:11.827915 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd2da4d-e3bf-4309-ad0c-1bbf2474a800 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:47:11.848114 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:47:11.901996 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930d4449-d57d-4ecb-9bb2-ce5bde54c4f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:47:11.902651 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930d4449-d57d-4ecb-9bb2-ce5bde54c4f3 service neutron] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:47:11.902934 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930d4449-d57d-4ecb-9bb2-ce5bde54c4f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:47:11.903212 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930d4449-d57d-4ecb-9bb2-ce5bde54c4f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:47:11.904853 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-930d4449-d57d-4ecb-9bb2-ce5bde54c4f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:47:12.011643 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930d4449-d57d-4ecb-9bb2-ce5bde54c4f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:47:12.013023 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930d4449-d57d-4ecb-9bb2-ce5bde54c4f3 service neutron] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:47:12.031417 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 728/1452] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:47:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:47:14.162719 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f9ac1-14e9-4e13-a87d-969b0a8f0da3 None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:47:14.163301 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f9ac1-14e9-4e13-a87d-969b0a8f0da3 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:47:14.163301 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f9ac1-14e9-4e13-a87d-969b0a8f0da3 None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:47:14.165130 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 725/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 17:47:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:47:14.170349 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2402fd06-39fa-4c64-a27c-82f3393a7862 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:47:14.170794 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2402fd06-39fa-4c64-a27c-82f3393a7862 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:47:14.170904 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2402fd06-39fa-4c64-a27c-82f3393a7862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:47:14.231629 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:47:14.234292 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-2402fd06-39fa-4c64-a27c-82f3393a7862 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:47:14.236011 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-2402fd06-39fa-4c64-a27c-82f3393a7862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:47:14.330305 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 729/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 17:47:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:47:14.368529 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28f9ac1-14e9-4e13-a87d-969b0a8f0da3 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:47:14.370070 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-d28f9ac1-14e9-4e13-a87d-969b0a8f0da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:47:14.470105 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28f9ac1-14e9-4e13-a87d-969b0a8f0da3 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:47:14.518121 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:47:14.543282 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e14d63d-cf5c-4113-b065-04b181dac026 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:47:14.543931 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e14d63d-cf5c-4113-b065-04b181dac026 service neutron] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:47:14.544212 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e14d63d-cf5c-4113-b065-04b181dac026 service neutron] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:47:14.544491 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e14d63d-cf5c-4113-b065-04b181dac026 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:47:14.546295 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-7e14d63d-cf5c-4113-b065-04b181dac026 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:47:14.653896 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e14d63d-cf5c-4113-b065-04b181dac026 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:47:14.655325 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e14d63d-cf5c-4113-b065-04b181dac026 service neutron] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:47:14.673437 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 726/1455] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:47:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:47:16.767355 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282ab437-500e-4444-b1a9-8ebcefd9ac1a None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:47:16.767983 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282ab437-500e-4444-b1a9-8ebcefd9ac1a None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:47:16.767983 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282ab437-500e-4444-b1a9-8ebcefd9ac1a None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:47:16.769204 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 730/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 17:47:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 17:47:16.774624 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e771d1a-9fce-43ac-b48d-7b2d6cc6623c None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:47:16.775075 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e771d1a-9fce-43ac-b48d-7b2d6cc6623c None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:47:16.775182 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e771d1a-9fce-43ac-b48d-7b2d6cc6623c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:47:16.840407 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-7e771d1a-9fce-43ac-b48d-7b2d6cc6623c None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:47:16.841631 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-7e771d1a-9fce-43ac-b48d-7b2d6cc6623c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:47:16.870029 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:47:16.938005 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 727/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 17:47:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:47:16.975514 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282ab437-500e-4444-b1a9-8ebcefd9ac1a None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:47:16.977607 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-282ab437-500e-4444-b1a9-8ebcefd9ac1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:47:17.081014 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282ab437-500e-4444-b1a9-8ebcefd9ac1a None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:47:17.110679 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:47:17.156268 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda4118a-6faf-44db-b33a-3e28bbaf76c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:47:17.156922 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4118a-6faf-44db-b33a-3e28bbaf76c1 service neutron] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:47:17.157206 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4118a-6faf-44db-b33a-3e28bbaf76c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:47:17.157486 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4118a-6faf-44db-b33a-3e28bbaf76c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:47:17.159185 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-eda4118a-6faf-44db-b33a-3e28bbaf76c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:47:17.265219 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda4118a-6faf-44db-b33a-3e28bbaf76c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:47:17.266702 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda4118a-6faf-44db-b33a-3e28bbaf76c1 service neutron] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:47:17.285188 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 731/1458] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:47:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:47:19.412537 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d299e925-4c01-4240-965e-b89fccd53262 None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:47:19.413116 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d299e925-4c01-4240-965e-b89fccd53262 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:47:19.413116 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d299e925-4c01-4240-965e-b89fccd53262 None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:47:19.414468 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 728/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 17:47:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:47:19.420310 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183030bf-16c6-4b27-bf16-6c05535b5ca4 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:47:19.420754 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183030bf-16c6-4b27-bf16-6c05535b5ca4 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:47:19.420868 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183030bf-16c6-4b27-bf16-6c05535b5ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:47:19.490175 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-183030bf-16c6-4b27-bf16-6c05535b5ca4 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:47:19.491394 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-183030bf-16c6-4b27-bf16-6c05535b5ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:47:19.500367 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:47:19.588905 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 732/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 17:47:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:47:19.626772 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d299e925-4c01-4240-965e-b89fccd53262 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:47:19.628292 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-d299e925-4c01-4240-965e-b89fccd53262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:47:19.733310 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d299e925-4c01-4240-965e-b89fccd53262 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:47:19.788414 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:47:19.807233 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915382d3-bd72-4f35-8322-7bf38dabcc32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:47:19.807882 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915382d3-bd72-4f35-8322-7bf38dabcc32 service neutron] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:47:19.808161 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915382d3-bd72-4f35-8322-7bf38dabcc32 service neutron] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:47:19.808435 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915382d3-bd72-4f35-8322-7bf38dabcc32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:47:19.810103 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-915382d3-bd72-4f35-8322-7bf38dabcc32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:47:19.916278 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915382d3-bd72-4f35-8322-7bf38dabcc32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:47:19.917725 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915382d3-bd72-4f35-8322-7bf38dabcc32 service neutron] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:47:19.935715 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 729/1461] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:47:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:47:22.026331 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0958fd9-4ecc-43fa-bf32-95163df65bcf None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:47:22.026861 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0958fd9-4ecc-43fa-bf32-95163df65bcf None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:47:22.026861 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0958fd9-4ecc-43fa-bf32-95163df65bcf None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:47:22.028205 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 733/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 17:47:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:47:22.033348 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4b1cfc-102f-4cbb-85fb-9b3671a9dbf8 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:47:22.033799 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4b1cfc-102f-4cbb-85fb-9b3671a9dbf8 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:47:22.033932 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4b1cfc-102f-4cbb-85fb-9b3671a9dbf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:47:22.099591 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-0e4b1cfc-102f-4cbb-85fb-9b3671a9dbf8 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:47:22.100787 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-0e4b1cfc-102f-4cbb-85fb-9b3671a9dbf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:47:22.138752 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:47:22.197932 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 730/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 17:47:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:47:22.235201 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0958fd9-4ecc-43fa-bf32-95163df65bcf None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:47:22.236768 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-d0958fd9-4ecc-43fa-bf32-95163df65bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:47:22.340471 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0958fd9-4ecc-43fa-bf32-95163df65bcf None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:47:22.380548 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:47:22.418130 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9136870a-15a5-4b95-bb0c-228dd9d55e05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:47:22.418781 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9136870a-15a5-4b95-bb0c-228dd9d55e05 service neutron] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:47:22.419064 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9136870a-15a5-4b95-bb0c-228dd9d55e05 service neutron] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:47:22.419339 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9136870a-15a5-4b95-bb0c-228dd9d55e05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:47:22.420991 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-9136870a-15a5-4b95-bb0c-228dd9d55e05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:47:22.531244 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9136870a-15a5-4b95-bb0c-228dd9d55e05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:47:22.532895 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9136870a-15a5-4b95-bb0c-228dd9d55e05 service neutron] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:47:22.550960 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 734/1464] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:47:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:47:24.590525 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb5d6a-2d3c-4277-9344-334cca9fc4c6 None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:47:24.591088 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb5d6a-2d3c-4277-9344-334cca9fc4c6 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:47:24.591088 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb5d6a-2d3c-4277-9344-334cca9fc4c6 None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:47:24.592737 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 731/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 17:47:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:47:24.598877 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099b0c18-fef6-4fd5-be02-9ceb6cc4ab80 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:47:24.599353 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099b0c18-fef6-4fd5-be02-9ceb6cc4ab80 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:47:24.599472 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099b0c18-fef6-4fd5-be02-9ceb6cc4ab80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:47:24.664221 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-099b0c18-fef6-4fd5-be02-9ceb6cc4ab80 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:47:24.665417 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-099b0c18-fef6-4fd5-be02-9ceb6cc4ab80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:47:24.684631 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:47:24.762146 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 735/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 17:47:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:47:24.799733 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefb5d6a-2d3c-4277-9344-334cca9fc4c6 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:47:24.801300 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-aefb5d6a-2d3c-4277-9344-334cca9fc4c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:47:24.906090 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefb5d6a-2d3c-4277-9344-334cca9fc4c6 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:47:24.972498 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:47:24.980091 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f344aed-7f21-48f2-8fb2-42ff8b435e8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:47:24.980735 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f344aed-7f21-48f2-8fb2-42ff8b435e8d service neutron] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:47:24.981017 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f344aed-7f21-48f2-8fb2-42ff8b435e8d service neutron] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:47:24.981292 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f344aed-7f21-48f2-8fb2-42ff8b435e8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:47:24.982976 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-0f344aed-7f21-48f2-8fb2-42ff8b435e8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:47:25.090210 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f344aed-7f21-48f2-8fb2-42ff8b435e8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:47:25.091542 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f344aed-7f21-48f2-8fb2-42ff8b435e8d service neutron] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:47:25.110365 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 732/1467] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:47:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:47:27.152752 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba888679-ea2c-4dee-bbcb-e3b729608a19 None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:47:27.153310 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba888679-ea2c-4dee-bbcb-e3b729608a19 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:47:27.153310 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba888679-ea2c-4dee-bbcb-e3b729608a19 None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:47:27.154697 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 736/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 17:47:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:47:27.159969 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e029e8-1c6b-4214-aa6a-236166910f00 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:47:27.160370 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e029e8-1c6b-4214-aa6a-236166910f00 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:47:27.160517 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e029e8-1c6b-4214-aa6a-236166910f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:47:27.223576 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-b8e029e8-1c6b-4214-aa6a-236166910f00 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:47:27.224785 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-b8e029e8-1c6b-4214-aa6a-236166910f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:47:27.276233 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:47:27.324713 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 733/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 17:47:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:47:27.362860 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba888679-ea2c-4dee-bbcb-e3b729608a19 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:47:27.364429 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-ba888679-ea2c-4dee-bbcb-e3b729608a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:47:27.469682 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba888679-ea2c-4dee-bbcb-e3b729608a19 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:47:27.516644 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:47:27.543539 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba12f98c-df1e-4c01-a0da-1a6b69ba6791 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:47:27.544121 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba12f98c-df1e-4c01-a0da-1a6b69ba6791 service neutron] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:47:27.544400 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba12f98c-df1e-4c01-a0da-1a6b69ba6791 service neutron] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:47:27.544675 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba12f98c-df1e-4c01-a0da-1a6b69ba6791 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:47:27.546356 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-ba12f98c-df1e-4c01-a0da-1a6b69ba6791 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:47:27.656320 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba12f98c-df1e-4c01-a0da-1a6b69ba6791 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:47:27.657776 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba12f98c-df1e-4c01-a0da-1a6b69ba6791 service neutron] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:47:27.675920 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 737/1470] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:47:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:47:37.322382 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=22 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:47:37.673612 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=66 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:47:49.637310 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a6e06-eb25-4883-937a-a01ef794ce9c None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:47:49.637912 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a6e06-eb25-4883-937a-a01ef794ce9c None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:47:49.637912 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a6e06-eb25-4883-937a-a01ef794ce9c None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:47:49.639257 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 734/1471] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:47:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:47:49.644919 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d038bdc-e53a-44dc-80b0-73d53954e81f None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:47:49.645378 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d038bdc-e53a-44dc-80b0-73d53954e81f None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:47:49.645497 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d038bdc-e53a-44dc-80b0-73d53954e81f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:47:49.714996 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-4d038bdc-e53a-44dc-80b0-73d53954e81f None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:47:49.716130 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-4d038bdc-e53a-44dc-80b0-73d53954e81f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:47:49.814512 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 738/1472] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:47:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:47:49.901813 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18de174-1742-4019-b3e4-f44f25df79de None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:47:49.902116 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18de174-1742-4019-b3e4-f44f25df79de None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:47:49.902391 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18de174-1742-4019-b3e4-f44f25df79de None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:47:49.903747 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 735/1473] 10.222.0.67 () {54 vars in 962 bytes} [Thu Jul 14 17:47:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:47:49.908965 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d33815a-9ad5-4eb2-a396-5b40fb29a8f8 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:47:49.909252 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d33815a-9ad5-4eb2-a396-5b40fb29a8f8 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:47:49.909557 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d33815a-9ad5-4eb2-a396-5b40fb29a8f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:47:49.985988 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-0d33815a-9ad5-4eb2-a396-5b40fb29a8f8 None None] MFA Rules not processed for user `4eb7180aab4541b4aab6cf8648eac1f1`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:47:49.986978 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-0d33815a-9ad5-4eb2-a396-5b40fb29a8f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:47:50.008032 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:47:50.065481 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 739/1474] 10.222.0.67 () {58 vars in 1059 bytes} [Thu Jul 14 17:47:49 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:47:50.073079 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18de174-1742-4019-b3e4-f44f25df79de None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:47:50.074682 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-b18de174-1742-4019-b3e4-f44f25df79de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:47:50.184369 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18de174-1742-4019-b3e4-f44f25df79de None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:47:50.257122 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99233939-0b46-46ef-8b56-ec0167b95feb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eb7180aab4541b4aab6cf8648eac1f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:47:50.257709 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99233939-0b46-46ef-8b56-ec0167b95feb service glance] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:47:50.257991 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99233939-0b46-46ef-8b56-ec0167b95feb service glance] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:47:50.258263 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99233939-0b46-46ef-8b56-ec0167b95feb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:47:50.259901 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-99233939-0b46-46ef-8b56-ec0167b95feb service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:47:50.314469 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:47:50.369521 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99233939-0b46-46ef-8b56-ec0167b95feb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:47:50.371400 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99233939-0b46-46ef-8b56-ec0167b95feb service glance] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:47:50.389701 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 736/1475] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:47:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 17:47:52.531647 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e415c-4821-4d8b-a7c1-06ee4ce2f2c0 None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:47:52.532221 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e415c-4821-4d8b-a7c1-06ee4ce2f2c0 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:47:52.532221 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e415c-4821-4d8b-a7c1-06ee4ce2f2c0 None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:47:52.533581 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 740/1476] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:47:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:47:52.539009 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdcf662-229c-4adf-ba9a-17616d03dbfb None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:47:52.539452 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdcf662-229c-4adf-ba9a-17616d03dbfb None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:47:52.539553 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdcf662-229c-4adf-ba9a-17616d03dbfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:47:52.604138 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-ffdcf662-229c-4adf-ba9a-17616d03dbfb None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:47:52.605351 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-ffdcf662-229c-4adf-ba9a-17616d03dbfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:47:52.703628 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 737/1477] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:47:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:47:52.727037 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43e415c-4821-4d8b-a7c1-06ee4ce2f2c0 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:47:52.728516 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-d43e415c-4821-4d8b-a7c1-06ee4ce2f2c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:47:52.857376 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43e415c-4821-4d8b-a7c1-06ee4ce2f2c0 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:47:52.907291 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:47:52.954912 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4cf709-9e48-4b58-b204-62b464e554c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:47:52.955574 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4cf709-9e48-4b58-b204-62b464e554c6 admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:47:52.955851 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4cf709-9e48-4b58-b204-62b464e554c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:47:52.956123 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4cf709-9e48-4b58-b204-62b464e554c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:47:52.956847 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4cf709-9e48-4b58-b204-62b464e554c6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:47:52.958643 dv-cinder-849890-1-smb devstack@keystone.service[86773]: WARNING py.warnings [None req-dc4cf709-9e48-4b58-b204-62b464e554c6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 17:47:52.958643 dv-cinder-849890-1-smb devstack@keystone.service[86773]: warnings.warn(msg) Jul 14 17:47:52.958643 dv-cinder-849890-1-smb devstack@keystone.service[86773]: Jul 14 17:47:52.959802 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4cf709-9e48-4b58-b204-62b464e554c6 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:47:52.978611 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 741/1478] 10.222.0.67 () {56 vars in 1108 bytes} [Thu Jul 14 17:47:52 2022] GET /identity/v3/projects => generated 2553 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:47:55.073188 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d256ac18-646d-4fc5-8218-ce480c918664 None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:47:55.073817 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d256ac18-646d-4fc5-8218-ce480c918664 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:47:55.073817 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d256ac18-646d-4fc5-8218-ce480c918664 None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:47:55.075783 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 738/1479] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:47:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:47:55.081261 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee544da-2a1a-4ad5-8902-6a89372fa622 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:47:55.081763 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee544da-2a1a-4ad5-8902-6a89372fa622 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:47:55.081857 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee544da-2a1a-4ad5-8902-6a89372fa622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:47:55.146639 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-aee544da-2a1a-4ad5-8902-6a89372fa622 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:47:55.147853 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-aee544da-2a1a-4ad5-8902-6a89372fa622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:47:55.242060 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 742/1480] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:47:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:47:55.286822 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d256ac18-646d-4fc5-8218-ce480c918664 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:47:55.288433 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-d256ac18-646d-4fc5-8218-ce480c918664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:47:55.298901 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:47:55.446463 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d256ac18-646d-4fc5-8218-ce480c918664 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:47:55.533355 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:47:55.567805 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb323e7-1876-4270-b8b9-f61382fb4fc6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41b893bdf4ec474dbfa819c22fc29ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:47:55.568563 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb323e7-1876-4270-b8b9-f61382fb4fc6 service nova] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:47:55.568852 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb323e7-1876-4270-b8b9-f61382fb4fc6 service nova] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:47:55.569131 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb323e7-1876-4270-b8b9-f61382fb4fc6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:47:55.570834 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-edb323e7-1876-4270-b8b9-f61382fb4fc6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:47:55.667436 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb323e7-1876-4270-b8b9-f61382fb4fc6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:47:55.669110 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb323e7-1876-4270-b8b9-f61382fb4fc6 service nova] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:47:55.687463 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 739/1481] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:47:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:47:57.912974 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a58b96-98e6-4441-89ab-3361d3e63963 None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:47:57.913568 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a58b96-98e6-4441-89ab-3361d3e63963 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:47:57.913568 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a58b96-98e6-4441-89ab-3361d3e63963 None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:47:57.914937 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 743/1482] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:47:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:47:57.920173 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a93e90-0b10-4b64-b681-912ae4803728 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:47:57.920605 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a93e90-0b10-4b64-b681-912ae4803728 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:47:57.920702 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a93e90-0b10-4b64-b681-912ae4803728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:47:57.984417 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-79a93e90-0b10-4b64-b681-912ae4803728 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:47:57.985638 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-79a93e90-0b10-4b64-b681-912ae4803728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:47:58.031390 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:47:58.081173 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 740/1483] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:47:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:47:58.118607 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a58b96-98e6-4441-89ab-3361d3e63963 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:47:58.120228 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-a5a58b96-98e6-4441-89ab-3361d3e63963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:47:58.144200 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:47:58.231261 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a58b96-98e6-4441-89ab-3361d3e63963 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:47:58.308316 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10da4c48-6e09-4992-baa5-fbe13d32f221 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:47:58.308974 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da4c48-6e09-4992-baa5-fbe13d32f221 service neutron] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:47:58.309257 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da4c48-6e09-4992-baa5-fbe13d32f221 service neutron] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:47:58.309554 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da4c48-6e09-4992-baa5-fbe13d32f221 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:47:58.311233 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-10da4c48-6e09-4992-baa5-fbe13d32f221 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:47:58.388151 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:47:58.423956 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10da4c48-6e09-4992-baa5-fbe13d32f221 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:47:58.425398 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10da4c48-6e09-4992-baa5-fbe13d32f221 service neutron] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:47:58.443147 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 744/1484] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:47:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:48:00.531101 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c3f5d-88ec-47c9-a7dd-fe04bf922480 None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:48:00.531647 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c3f5d-88ec-47c9-a7dd-fe04bf922480 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:48:00.531647 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c3f5d-88ec-47c9-a7dd-fe04bf922480 None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:48:00.533082 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 741/1485] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:48:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:48:00.538321 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69743ce8-aca5-4763-a34c-f31c5ea06e0c None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:48:00.538779 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69743ce8-aca5-4763-a34c-f31c5ea06e0c None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:48:00.538893 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69743ce8-aca5-4763-a34c-f31c5ea06e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:48:00.603997 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-69743ce8-aca5-4763-a34c-f31c5ea06e0c None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:48:00.605209 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-69743ce8-aca5-4763-a34c-f31c5ea06e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:48:00.708751 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 745/1486] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:48:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:48:00.747082 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8c3f5d-88ec-47c9-a7dd-fe04bf922480 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:48:00.748677 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-ce8c3f5d-88ec-47c9-a7dd-fe04bf922480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:48:00.857939 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8c3f5d-88ec-47c9-a7dd-fe04bf922480 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:48:00.928665 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:48:00.930708 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3e95cd-67d2-41e1-8129-43963d10dd01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:48:00.931448 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e95cd-67d2-41e1-8129-43963d10dd01 service neutron] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:48:00.931796 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e95cd-67d2-41e1-8129-43963d10dd01 service neutron] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:48:00.932350 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e95cd-67d2-41e1-8129-43963d10dd01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:48:00.934540 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-fd3e95cd-67d2-41e1-8129-43963d10dd01 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:48:01.044218 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3e95cd-67d2-41e1-8129-43963d10dd01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:48:01.045693 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3e95cd-67d2-41e1-8129-43963d10dd01 service neutron] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:48:01.064241 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 742/1487] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:48:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:48:03.214506 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e704f60-634b-4802-8727-efc41ece6e96 None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:48:03.215055 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e704f60-634b-4802-8727-efc41ece6e96 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:48:03.215159 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e704f60-634b-4802-8727-efc41ece6e96 None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:48:03.216527 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 746/1488] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:48:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:48:03.221767 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf0bd8e-2e2c-4261-b841-0ca88a70849a None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:48:03.222204 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf0bd8e-2e2c-4261-b841-0ca88a70849a None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:48:03.222307 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf0bd8e-2e2c-4261-b841-0ca88a70849a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:48:03.286482 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-faf0bd8e-2e2c-4261-b841-0ca88a70849a None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:48:03.287612 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-faf0bd8e-2e2c-4261-b841-0ca88a70849a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:48:03.344124 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:48:03.389726 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 743/1489] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:48:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 17:48:03.430645 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e704f60-634b-4802-8727-efc41ece6e96 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:48:03.432224 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-5e704f60-634b-4802-8727-efc41ece6e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:48:03.470590 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:48:03.537205 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e704f60-634b-4802-8727-efc41ece6e96 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:48:03.608191 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd85d9fd-56f8-4f88-86db-fbba855b659f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:48:03.608838 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd85d9fd-56f8-4f88-86db-fbba855b659f service neutron] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:48:03.609125 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd85d9fd-56f8-4f88-86db-fbba855b659f service neutron] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:48:03.609395 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd85d9fd-56f8-4f88-86db-fbba855b659f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:48:03.611071 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-cd85d9fd-56f8-4f88-86db-fbba855b659f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:48:03.691616 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:48:03.723586 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd85d9fd-56f8-4f88-86db-fbba855b659f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:48:03.725023 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd85d9fd-56f8-4f88-86db-fbba855b659f service neutron] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:48:03.745042 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 747/1490] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:48:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:48:06.001784 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2ebf05-b314-47f2-aaee-db4138f448ee None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:48:06.002382 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2ebf05-b314-47f2-aaee-db4138f448ee None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:48:06.002382 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2ebf05-b314-47f2-aaee-db4138f448ee None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:48:06.003804 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 744/1491] 10.222.0.67 () {54 vars in 926 bytes} [Thu Jul 14 17:48:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:48:06.009828 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7537d159-7782-42d0-8d4c-683b1e1df2b5 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:48:06.010425 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7537d159-7782-42d0-8d4c-683b1e1df2b5 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:48:06.010425 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7537d159-7782-42d0-8d4c-683b1e1df2b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:48:06.080910 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-7537d159-7782-42d0-8d4c-683b1e1df2b5 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:48:06.082213 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-7537d159-7782-42d0-8d4c-683b1e1df2b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:48:06.177998 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 748/1492] 10.222.0.67 () {58 vars in 1023 bytes} [Thu Jul 14 17:48:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 17:48:06.217568 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2ebf05-b314-47f2-aaee-db4138f448ee None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:48:06.219156 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-6e2ebf05-b314-47f2-aaee-db4138f448ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:48:06.322484 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2ebf05-b314-47f2-aaee-db4138f448ee None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:48:06.394994 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506388fb-e4c0-418a-993a-2aa10a626324 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:48:06.395901 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506388fb-e4c0-418a-993a-2aa10a626324 service neutron] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:48:06.396175 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506388fb-e4c0-418a-993a-2aa10a626324 service neutron] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:48:06.396439 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506388fb-e4c0-418a-993a-2aa10a626324 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:48:06.398109 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-506388fb-e4c0-418a-993a-2aa10a626324 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:48:06.407777 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:48:06.508697 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506388fb-e4c0-418a-993a-2aa10a626324 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:48:06.510148 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506388fb-e4c0-418a-993a-2aa10a626324 service neutron] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:48:06.529209 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 745/1493] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:48:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:48:16.176167 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=82 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:48:16.526343 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=50 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:51:06.393611 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c85d53a-1e67-4505-be10-42f02caf2d6f None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:51:06.394220 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c85d53a-1e67-4505-be10-42f02caf2d6f None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:51:06.394220 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c85d53a-1e67-4505-be10-42f02caf2d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:51:06.474334 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-8c85d53a-1e67-4505-be10-42f02caf2d6f None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:51:06.475555 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-8c85d53a-1e67-4505-be10-42f02caf2d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:51:06.579194 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 749/1494] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:51:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:51:06.587354 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fadc0e-4f4d-4f91-8411-3218781bd2c9 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:51:06.587876 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fadc0e-4f4d-4f91-8411-3218781bd2c9 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:51:06.587977 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fadc0e-4f4d-4f91-8411-3218781bd2c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:51:06.606495 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-d2fadc0e-4f4d-4f91-8411-3218781bd2c9 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:51:06.607711 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-d2fadc0e-4f4d-4f91-8411-3218781bd2c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:51:06.616298 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 746/1495] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:51:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:51:06.621696 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c85d53a-1e67-4505-be10-42f02caf2d6f None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:51:06.631361 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c85d53a-1e67-4505-be10-42f02caf2d6f None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:51:06.636658 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7a23d8-aa6e-4491-8a29-4aa5830bd183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:51:06.637334 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7a23d8-aa6e-4491-8a29-4aa5830bd183 admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:51:06.637662 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7a23d8-aa6e-4491-8a29-4aa5830bd183 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:51:06.637946 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7a23d8-aa6e-4491-8a29-4aa5830bd183 admin admin] PATH_INFO: `/v3/domains` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:51:06.638686 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7a23d8-aa6e-4491-8a29-4aa5830bd183 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:51:06.638998 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7a23d8-aa6e-4491-8a29-4aa5830bd183 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:51:06.640022 dv-cinder-849890-1-smb devstack@keystone.service[86773]: WARNING py.warnings [None req-6b7a23d8-aa6e-4491-8a29-4aa5830bd183 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 17:51:06.640022 dv-cinder-849890-1-smb devstack@keystone.service[86773]: warnings.warn(msg) Jul 14 17:51:06.640022 dv-cinder-849890-1-smb devstack@keystone.service[86773]: Jul 14 17:51:06.640908 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7a23d8-aa6e-4491-8a29-4aa5830bd183 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:51:06.653208 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 750/1496] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 14 17:51:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:51:06.661550 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fadc0e-4f4d-4f91-8411-3218781bd2c9 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:51:06.671271 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fadc0e-4f4d-4f91-8411-3218781bd2c9 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:51:06.675868 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bbb88f-95a5-4ace-aa5d-92b330ad7e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:51:06.676530 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bbb88f-95a5-4ace-aa5d-92b330ad7e94 admin admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:51:06.676813 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bbb88f-95a5-4ace-aa5d-92b330ad7e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:51:06.677088 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bbb88f-95a5-4ace-aa5d-92b330ad7e94 admin admin] PATH_INFO: `/v3/projects` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:51:06.677828 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bbb88f-95a5-4ace-aa5d-92b330ad7e94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:51:06.679571 dv-cinder-849890-1-smb devstack@keystone.service[86772]: WARNING py.warnings [None req-d3bbb88f-95a5-4ace-aa5d-92b330ad7e94 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 17:51:06.679571 dv-cinder-849890-1-smb devstack@keystone.service[86772]: warnings.warn(msg) Jul 14 17:51:06.679571 dv-cinder-849890-1-smb devstack@keystone.service[86772]: Jul 14 17:51:06.680754 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bbb88f-95a5-4ace-aa5d-92b330ad7e94 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:51:06.718325 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 747/1497] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 14 17:51:06 2022] POST /identity/v3/projects => generated 377 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:51:06.722659 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7a23d8-aa6e-4491-8a29-4aa5830bd183 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:51:06.733128 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7a23d8-aa6e-4491-8a29-4aa5830bd183 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:51:06.781766 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:51:06.789655 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d323134-ab0e-44f5-a62f-ad172e83d00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:51:06.790340 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d323134-ab0e-44f5-a62f-ad172e83d00c admin admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:51:06.790631 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d323134-ab0e-44f5-a62f-ad172e83d00c admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:51:06.790908 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d323134-ab0e-44f5-a62f-ad172e83d00c admin admin] PATH_INFO: `/v3/users` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:51:06.792144 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d323134-ab0e-44f5-a62f-ad172e83d00c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:51:06.793164 dv-cinder-849890-1-smb devstack@keystone.service[86773]: WARNING py.warnings [None req-5d323134-ab0e-44f5-a62f-ad172e83d00c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 17:51:06.793164 dv-cinder-849890-1-smb devstack@keystone.service[86773]: warnings.warn(msg) Jul 14 17:51:06.793164 dv-cinder-849890-1-smb devstack@keystone.service[86773]: Jul 14 17:51:06.794421 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d323134-ab0e-44f5-a62f-ad172e83d00c admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:51:06.815243 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 751/1498] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 14 17:51:06 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 17:51:06.819631 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bbb88f-95a5-4ace-aa5d-92b330ad7e94 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:51:06.830170 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bbb88f-95a5-4ace-aa5d-92b330ad7e94 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:51:06.834790 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d5757e-100b-44c4-9b96-a9275b064972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:51:06.835481 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d5757e-100b-44c4-9b96-a9275b064972 admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:51:06.835768 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d5757e-100b-44c4-9b96-a9275b064972 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:51:06.836045 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d5757e-100b-44c4-9b96-a9275b064972 admin admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:51:06.836775 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d5757e-100b-44c4-9b96-a9275b064972 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:51:06.837834 dv-cinder-849890-1-smb devstack@keystone.service[86772]: WARNING py.warnings [None req-34d5757e-100b-44c4-9b96-a9275b064972 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 17:51:06.837834 dv-cinder-849890-1-smb devstack@keystone.service[86772]: warnings.warn(msg) Jul 14 17:51:06.837834 dv-cinder-849890-1-smb devstack@keystone.service[86772]: Jul 14 17:51:06.838723 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d5757e-100b-44c4-9b96-a9275b064972 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:51:06.851692 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 748/1499] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:51:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:51:06.856270 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d323134-ab0e-44f5-a62f-ad172e83d00c admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:51:06.866305 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d323134-ab0e-44f5-a62f-ad172e83d00c admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:51:06.871689 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53752cfa-80e0-479d-a758-cabf5ae0855d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:51:06.872350 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53752cfa-80e0-479d-a758-cabf5ae0855d admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:51:06.872637 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53752cfa-80e0-479d-a758-cabf5ae0855d admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:51:06.872918 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53752cfa-80e0-479d-a758-cabf5ae0855d admin admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:51:06.873707 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53752cfa-80e0-479d-a758-cabf5ae0855d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:51:06.874721 dv-cinder-849890-1-smb devstack@keystone.service[86773]: WARNING py.warnings [None req-53752cfa-80e0-479d-a758-cabf5ae0855d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 17:51:06.874721 dv-cinder-849890-1-smb devstack@keystone.service[86773]: warnings.warn(msg) Jul 14 17:51:06.874721 dv-cinder-849890-1-smb devstack@keystone.service[86773]: Jul 14 17:51:06.875631 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53752cfa-80e0-479d-a758-cabf5ae0855d admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:51:06.888959 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 752/1500] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:51:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:51:06.893083 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d5757e-100b-44c4-9b96-a9275b064972 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:51:06.903173 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d5757e-100b-44c4-9b96-a9275b064972 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:51:06.908094 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7db057b-af43-4f24-9b74-a3678861332f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:51:06.908919 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db057b-af43-4f24-9b74-a3678861332f admin admin] REQUEST_METHOD: `PUT` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:51:06.909204 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db057b-af43-4f24-9b74-a3678861332f admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:51:06.909482 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db057b-af43-4f24-9b74-a3678861332f admin admin] PATH_INFO: `/v3/projects/8ba502a0ddea41e58492b9eb7459c522/users/40e66b6aec9740baaa2e608d178ec02b/roles/95d753870f97426cb1ce32e078621a4c` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:51:06.925075 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7db057b-af43-4f24-9b74-a3678861332f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ba502a0ddea41e58492b9eb7459c522, user_id=40e66b6aec9740baaa2e608d178ec02b, role_id=95d753870f97426cb1ce32e078621a4c)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:51:06.926141 dv-cinder-849890-1-smb devstack@keystone.service[86772]: WARNING py.warnings [None req-e7db057b-af43-4f24-9b74-a3678861332f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 17:51:06.926141 dv-cinder-849890-1-smb devstack@keystone.service[86772]: warnings.warn(msg) Jul 14 17:51:06.926141 dv-cinder-849890-1-smb devstack@keystone.service[86772]: Jul 14 17:51:06.928090 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7db057b-af43-4f24-9b74-a3678861332f admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:51:06.941817 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 749/1501] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 17:51:06 2022] PUT /identity/v3/projects/8ba502a0ddea41e58492b9eb7459c522/users/40e66b6aec9740baaa2e608d178ec02b/roles/95d753870f97426cb1ce32e078621a4c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 17:51:06.954144 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265ff687-026d-4d1b-ac39-e1716540c650 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:51:06.954507 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265ff687-026d-4d1b-ac39-e1716540c650 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:51:06.954790 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265ff687-026d-4d1b-ac39-e1716540c650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:51:06.982733 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-265ff687-026d-4d1b-ac39-e1716540c650 None None] MFA Rules not processed for user `40e66b6aec9740baaa2e608d178ec02b`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:51:06.983986 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-265ff687-026d-4d1b-ac39-e1716540c650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:51:07.050363 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 753/1502] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:51:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:51:07.063685 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a81933-bcbc-43b0-bcb5-4ba60e34b45c None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:51:07.064076 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a81933-bcbc-43b0-bcb5-4ba60e34b45c None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:51:07.064256 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a81933-bcbc-43b0-bcb5-4ba60e34b45c None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:51:07.065687 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 750/1503] 10.222.0.67 () {54 vars in 963 bytes} [Thu Jul 14 17:51:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:51:07.070733 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0bbade-5bef-457e-a521-2224295465da None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:51:07.071024 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0bbade-5bef-457e-a521-2224295465da None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:51:07.071302 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0bbade-5bef-457e-a521-2224295465da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:51:07.135965 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-2a0bbade-5bef-457e-a521-2224295465da None None] MFA Rules not processed for user `de55cae1600841889668e36402861203`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:51:07.137199 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-2a0bbade-5bef-457e-a521-2224295465da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:51:07.216586 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 754/1504] 10.222.0.67 () {58 vars in 1060 bytes} [Thu Jul 14 17:51:07 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:51:07.224363 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a81933-bcbc-43b0-bcb5-4ba60e34b45c None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:51:07.235797 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a81933-bcbc-43b0-bcb5-4ba60e34b45c None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:51:07.239355 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa87bf-ea9a-47b2-9571-e0e535e656e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de55cae1600841889668e36402861203', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:51:07.240000 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa87bf-ea9a-47b2-9571-e0e535e656e1 service cinder] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:51:07.240284 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa87bf-ea9a-47b2-9571-e0e535e656e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:51:07.240564 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa87bf-ea9a-47b2-9571-e0e535e656e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:51:07.248978 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aa87bf-ea9a-47b2-9571-e0e535e656e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:51:07.250438 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aa87bf-ea9a-47b2-9571-e0e535e656e1 service cinder] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:51:07.259474 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 751/1505] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:51:07 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:51:07.302573 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54566f2-e218-4f4d-a69c-bff561310313 None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:51:07.302888 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54566f2-e218-4f4d-a69c-bff561310313 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:51:07.303164 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54566f2-e218-4f4d-a69c-bff561310313 None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:51:07.304453 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 755/1506] 10.222.0.67 () {52 vars in 829 bytes} [Thu Jul 14 17:51:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:51:07.308156 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa87bf-ea9a-47b2-9571-e0e535e656e1 service cinder] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:51:07.368771 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa87bf-ea9a-47b2-9571-e0e535e656e1 service cinder] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:51:07.373348 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3388ce1d-b203-484e-81da-891604a413ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:51:07.374253 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3388ce1d-b203-484e-81da-891604a413ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:51:07.374531 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3388ce1d-b203-484e-81da-891604a413ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:51:07.374802 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3388ce1d-b203-484e-81da-891604a413ec admin admin] PATH_INFO: `/v3/users/40e66b6aec9740baaa2e608d178ec02b` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:51:07.376028 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3388ce1d-b203-484e-81da-891604a413ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=40e66b6aec9740baaa2e608d178ec02b)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:51:07.377040 dv-cinder-849890-1-smb devstack@keystone.service[86772]: WARNING py.warnings [None req-3388ce1d-b203-484e-81da-891604a413ec admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 17:51:07.377040 dv-cinder-849890-1-smb devstack@keystone.service[86772]: warnings.warn(msg) Jul 14 17:51:07.377040 dv-cinder-849890-1-smb devstack@keystone.service[86772]: Jul 14 17:51:07.378275 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3388ce1d-b203-484e-81da-891604a413ec admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:51:07.442926 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-3388ce1d-b203-484e-81da-891604a413ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40e66b6aec9740baaa2e608d178ec02b'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:51:07.453389 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-3388ce1d-b203-484e-81da-891604a413ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40e66b6aec9740baaa2e608d178ec02b'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:51:07.468541 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-3388ce1d-b203-484e-81da-891604a413ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40e66b6aec9740baaa2e608d178ec02b'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:51:07.469206 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-3388ce1d-b203-484e-81da-891604a413ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40e66b6aec9740baaa2e608d178ec02b'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:51:07.484914 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:51:07.487800 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-3388ce1d-b203-484e-81da-891604a413ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40e66b6aec9740baaa2e608d178ec02b'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:51:07.494992 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 752/1507] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 14 17:51:07 2022] DELETE /identity/v3/users/40e66b6aec9740baaa2e608d178ec02b => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:51:07.499531 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3f22c9-79c3-437e-a845-71336df83167 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:51:07.499997 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3f22c9-79c3-437e-a845-71336df83167 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:51:07.500118 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3f22c9-79c3-437e-a845-71336df83167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:51:07.518252 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-7d3f22c9-79c3-437e-a845-71336df83167 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:51:07.519492 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-7d3f22c9-79c3-437e-a845-71336df83167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:51:07.529194 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:51:07.580211 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 756/1508] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:51:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:51:07.591653 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3388ce1d-b203-484e-81da-891604a413ec admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:51:07.593069 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-3388ce1d-b203-484e-81da-891604a413ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:51:07.673872 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3388ce1d-b203-484e-81da-891604a413ec admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:51:07.677508 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6efefb-77a1-42fe-80d0-fe8e022bdf59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:51:07.678193 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6efefb-77a1-42fe-80d0-fe8e022bdf59 service neutron] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:51:07.678479 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6efefb-77a1-42fe-80d0-fe8e022bdf59 service neutron] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:51:07.678757 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6efefb-77a1-42fe-80d0-fe8e022bdf59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:51:07.688988 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6efefb-77a1-42fe-80d0-fe8e022bdf59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:51:07.690459 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6efefb-77a1-42fe-80d0-fe8e022bdf59 service neutron] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:51:07.706393 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 753/1509] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:51:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:51:08.036517 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3f22c9-79c3-437e-a845-71336df83167 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:51:08.038159 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-7d3f22c9-79c3-437e-a845-71336df83167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:51:08.050491 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3f22c9-79c3-437e-a845-71336df83167 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:51:08.055296 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fbfb6c-b982-4abe-b277-3b6d0012461e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:51:08.056040 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fbfb6c-b982-4abe-b277-3b6d0012461e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:51:08.056317 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fbfb6c-b982-4abe-b277-3b6d0012461e admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:51:08.056588 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fbfb6c-b982-4abe-b277-3b6d0012461e admin admin] PATH_INFO: `/v3/projects/8ba502a0ddea41e58492b9eb7459c522` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:51:08.058336 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fbfb6c-b982-4abe-b277-3b6d0012461e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ba502a0ddea41e58492b9eb7459c522)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:51:08.059356 dv-cinder-849890-1-smb devstack@keystone.service[86773]: WARNING py.warnings [None req-89fbfb6c-b982-4abe-b277-3b6d0012461e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 17:51:08.059356 dv-cinder-849890-1-smb devstack@keystone.service[86773]: warnings.warn(msg) Jul 14 17:51:08.059356 dv-cinder-849890-1-smb devstack@keystone.service[86773]: Jul 14 17:51:08.065568 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fbfb6c-b982-4abe-b277-3b6d0012461e admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:51:08.126155 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-89fbfb6c-b982-4abe-b277-3b6d0012461e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ba502a0ddea41e58492b9eb7459c522', 'request_id': 'req-89fbfb6c-b982-4abe-b277-3b6d0012461e'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:51:08.140643 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-89fbfb6c-b982-4abe-b277-3b6d0012461e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ba502a0ddea41e58492b9eb7459c522', 'request_id': 'req-89fbfb6c-b982-4abe-b277-3b6d0012461e'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:51:08.147057 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-89fbfb6c-b982-4abe-b277-3b6d0012461e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ba502a0ddea41e58492b9eb7459c522', 'request_id': 'req-89fbfb6c-b982-4abe-b277-3b6d0012461e'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:51:08.164188 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-89fbfb6c-b982-4abe-b277-3b6d0012461e admin admin] The token cache is being invalidate because project 8ba502a0ddea41e58492b9eb7459c522 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86773) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 17:51:08.164532 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-89fbfb6c-b982-4abe-b277-3b6d0012461e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:51:08.165276 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-89fbfb6c-b982-4abe-b277-3b6d0012461e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:51:08.167413 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 757/1510] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 14 17:51:08 2022] DELETE /identity/v3/projects/8ba502a0ddea41e58492b9eb7459c522 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:51:17.695757 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:DELETE=1,keystone:SELECT=37 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:51:18.159734 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=47,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:52:52.736266 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f5a0f8-baea-4d70-8779-c161a9a91991 None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:52:52.736889 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f5a0f8-baea-4d70-8779-c161a9a91991 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:52:52.736889 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f5a0f8-baea-4d70-8779-c161a9a91991 None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:52:52.738367 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 754/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 17:52:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:52:52.744964 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f48abb0-aef8-448d-992b-21923bd4ab89 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:52:52.745584 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f48abb0-aef8-448d-992b-21923bd4ab89 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:52:52.745993 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f48abb0-aef8-448d-992b-21923bd4ab89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:52:52.778356 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-7f48abb0-aef8-448d-992b-21923bd4ab89 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:52:52.780498 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-7f48abb0-aef8-448d-992b-21923bd4ab89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:52:52.866951 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 758/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 17:52:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:52:53.027570 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f5a0f8-baea-4d70-8779-c161a9a91991 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:52:53.029952 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-16f5a0f8-baea-4d70-8779-c161a9a91991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:52:53.164547 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f5a0f8-baea-4d70-8779-c161a9a91991 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:52:53.170401 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216dd70b-1987-4a71-b8c1-d329ed24c74a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41b893bdf4ec474dbfa819c22fc29ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:52:53.171073 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216dd70b-1987-4a71-b8c1-d329ed24c74a service nova] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:52:53.171404 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216dd70b-1987-4a71-b8c1-d329ed24c74a service nova] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:52:53.172218 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216dd70b-1987-4a71-b8c1-d329ed24c74a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:52:53.182212 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216dd70b-1987-4a71-b8c1-d329ed24c74a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:52:53.184228 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216dd70b-1987-4a71-b8c1-d329ed24c74a service nova] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:52:53.201221 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 755/1513] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:52:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 17:52:54.166035 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb9c05a-d65f-4365-bddc-6e2ad7272209 None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:52:54.166903 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb9c05a-d65f-4365-bddc-6e2ad7272209 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:52:54.166903 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb9c05a-d65f-4365-bddc-6e2ad7272209 None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:52:54.167980 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 759/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 17:52:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:52:54.174305 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43623a5-bf76-4989-a19c-f86277617120 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:52:54.175126 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43623a5-bf76-4989-a19c-f86277617120 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:52:54.175126 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43623a5-bf76-4989-a19c-f86277617120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:52:54.193632 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-c43623a5-bf76-4989-a19c-f86277617120 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:52:54.194888 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-c43623a5-bf76-4989-a19c-f86277617120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:52:54.203012 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 756/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 17:52:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:52:54.362247 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb9c05a-d65f-4365-bddc-6e2ad7272209 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:52:54.386625 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb9c05a-d65f-4365-bddc-6e2ad7272209 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:52:54.395895 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e28998-3feb-41b5-a016-356b0df22b4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41b893bdf4ec474dbfa819c22fc29ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:52:54.396920 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e28998-3feb-41b5-a016-356b0df22b4b service nova] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:52:54.397433 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e28998-3feb-41b5-a016-356b0df22b4b service nova] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:52:54.397923 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e28998-3feb-41b5-a016-356b0df22b4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:52:54.413636 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e28998-3feb-41b5-a016-356b0df22b4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:52:54.417084 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e28998-3feb-41b5-a016-356b0df22b4b service nova] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:52:54.434365 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 760/1516] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:52:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:52:54.621642 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68934242-8be6-416c-bf1e-29017c9fbc2a None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:52:54.621962 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68934242-8be6-416c-bf1e-29017c9fbc2a None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:52:54.622185 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68934242-8be6-416c-bf1e-29017c9fbc2a None None] PATH_INFO: `/v3` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:52:54.623509 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 757/1517] 10.222.0.40 () {54 vars in 925 bytes} [Thu Jul 14 17:52:54 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:52:54.630178 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b882aaa-1fab-40cb-96df-f3de43dacf1b None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:52:54.630491 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b882aaa-1fab-40cb-96df-f3de43dacf1b None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:52:54.630769 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b882aaa-1fab-40cb-96df-f3de43dacf1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:52:54.808612 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-4b882aaa-1fab-40cb-96df-f3de43dacf1b None None] MFA Rules not processed for user `5324ab45f4a4449980dad920278f5034`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:52:54.809823 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-4b882aaa-1fab-40cb-96df-f3de43dacf1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:52:54.912782 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 761/1518] 10.222.0.40 () {58 vars in 1015 bytes} [Thu Jul 14 17:52:54 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 17:53:04.188943 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=49 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:53:04.287031 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554c0a21-d931-4d30-93c1-37e08ec6d408 None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:53:04.287279 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554c0a21-d931-4d30-93c1-37e08ec6d408 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:53:04.287532 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554c0a21-d931-4d30-93c1-37e08ec6d408 None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:53:04.288994 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 758/1519] 10.222.0.67 () {54 vars in 960 bytes} [Thu Jul 14 17:53:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:53:04.294507 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c461f75-b986-4d08-9f8b-ce47268d7c46 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:53:04.295262 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c461f75-b986-4d08-9f8b-ce47268d7c46 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:53:04.295439 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c461f75-b986-4d08-9f8b-ce47268d7c46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:53:04.314175 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-3c461f75-b986-4d08-9f8b-ce47268d7c46 None None] MFA Rules not processed for user `5324ab45f4a4449980dad920278f5034`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:53:04.315345 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-3c461f75-b986-4d08-9f8b-ce47268d7c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:53:04.323886 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 762/1520] 10.222.0.67 () {58 vars in 1057 bytes} [Thu Jul 14 17:53:04 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:53:04.331138 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554c0a21-d931-4d30-93c1-37e08ec6d408 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:53:04.344369 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554c0a21-d931-4d30-93c1-37e08ec6d408 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:53:04.349279 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a49ac66-e2d9-467d-b33c-bb268e2e46de service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5324ab45f4a4449980dad920278f5034', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:53:04.349949 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a49ac66-e2d9-467d-b33c-bb268e2e46de service placement] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:53:04.350239 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a49ac66-e2d9-467d-b33c-bb268e2e46de service placement] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:53:04.350517 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a49ac66-e2d9-467d-b33c-bb268e2e46de service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:53:04.358756 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a49ac66-e2d9-467d-b33c-bb268e2e46de service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:53:04.360835 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a49ac66-e2d9-467d-b33c-bb268e2e46de service placement] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:53:04.370493 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 759/1521] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:53:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:53:05.729947 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b750fc-423f-4a83-9e11-cc0deaa9fd54 None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:53:05.730456 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b750fc-423f-4a83-9e11-cc0deaa9fd54 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:53:05.730456 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b750fc-423f-4a83-9e11-cc0deaa9fd54 None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:53:05.731781 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 763/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 17:53:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:53:05.737022 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72094aa-87f9-4474-a08c-9e9b696ef9ed None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:53:05.737438 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72094aa-87f9-4474-a08c-9e9b696ef9ed None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:53:05.737608 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72094aa-87f9-4474-a08c-9e9b696ef9ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:53:05.755687 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-a72094aa-87f9-4474-a08c-9e9b696ef9ed None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:53:05.756934 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-a72094aa-87f9-4474-a08c-9e9b696ef9ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:53:05.764843 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 760/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 17:53:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:53:05.924153 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b750fc-423f-4a83-9e11-cc0deaa9fd54 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:53:05.940498 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b750fc-423f-4a83-9e11-cc0deaa9fd54 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:53:05.948738 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bdfc10-cf2a-419c-a43e-8b7ca04f9cb0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41b893bdf4ec474dbfa819c22fc29ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:53:05.949919 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bdfc10-cf2a-419c-a43e-8b7ca04f9cb0 service nova] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:53:05.950595 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bdfc10-cf2a-419c-a43e-8b7ca04f9cb0 service nova] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:53:05.951092 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bdfc10-cf2a-419c-a43e-8b7ca04f9cb0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:53:05.967239 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bdfc10-cf2a-419c-a43e-8b7ca04f9cb0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:53:05.970279 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bdfc10-cf2a-419c-a43e-8b7ca04f9cb0 service nova] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:53:05.990050 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 764/1524] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:53:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 17:53:06.854103 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8dc4bd-9729-4349-bf00-1dc2c729a064 None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:53:06.854639 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8dc4bd-9729-4349-bf00-1dc2c729a064 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:53:06.854639 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8dc4bd-9729-4349-bf00-1dc2c729a064 None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:53:06.855964 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 761/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 17:53:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:53:06.861859 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6a421b-86d2-4b61-8647-b7afff42fa88 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:53:06.862372 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6a421b-86d2-4b61-8647-b7afff42fa88 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:53:06.862673 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6a421b-86d2-4b61-8647-b7afff42fa88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:53:06.880729 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-7d6a421b-86d2-4b61-8647-b7afff42fa88 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:53:06.881990 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-7d6a421b-86d2-4b61-8647-b7afff42fa88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:53:06.889835 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 765/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 17:53:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:53:07.043870 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8dc4bd-9729-4349-bf00-1dc2c729a064 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:53:07.058088 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8dc4bd-9729-4349-bf00-1dc2c729a064 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:53:07.063477 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b1fe1d-8701-43ba-8e70-dc9596fbcb11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41b893bdf4ec474dbfa819c22fc29ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:53:07.064116 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b1fe1d-8701-43ba-8e70-dc9596fbcb11 service nova] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:53:07.064403 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b1fe1d-8701-43ba-8e70-dc9596fbcb11 service nova] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:53:07.064682 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b1fe1d-8701-43ba-8e70-dc9596fbcb11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:53:07.073242 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b1fe1d-8701-43ba-8e70-dc9596fbcb11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:53:07.074863 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b1fe1d-8701-43ba-8e70-dc9596fbcb11 service nova] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:53:07.084941 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 762/1527] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:53:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 17:53:11.099873 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222cd5b9-8b86-4a65-b97f-a298a83cca78 None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:53:11.100458 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222cd5b9-8b86-4a65-b97f-a298a83cca78 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:53:11.100458 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222cd5b9-8b86-4a65-b97f-a298a83cca78 None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:53:11.101816 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 766/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 17:53:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:53:11.107257 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e3c766-b8b5-4979-88bc-74ba64b6d856 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:53:11.107748 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e3c766-b8b5-4979-88bc-74ba64b6d856 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:53:11.107858 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e3c766-b8b5-4979-88bc-74ba64b6d856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:53:11.127329 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-55e3c766-b8b5-4979-88bc-74ba64b6d856 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:53:11.128539 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-55e3c766-b8b5-4979-88bc-74ba64b6d856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:53:11.136650 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 763/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 17:53:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:53:11.213863 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222cd5b9-8b86-4a65-b97f-a298a83cca78 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:53:11.215549 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-222cd5b9-8b86-4a65-b97f-a298a83cca78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:53:11.244857 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:53:11.274915 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222cd5b9-8b86-4a65-b97f-a298a83cca78 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:53:11.278981 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff00379-c016-46e9-9ec7-f2eeb4df1d61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:53:11.279681 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff00379-c016-46e9-9ec7-f2eeb4df1d61 service neutron] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:53:11.279966 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff00379-c016-46e9-9ec7-f2eeb4df1d61 service neutron] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:53:11.280253 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff00379-c016-46e9-9ec7-f2eeb4df1d61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:53:11.290466 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff00379-c016-46e9-9ec7-f2eeb4df1d61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:53:11.291812 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff00379-c016-46e9-9ec7-f2eeb4df1d61 service neutron] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:53:11.302331 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 767/1530] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:53:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:53:13.373326 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae50158-a6ff-48ca-8c64-b56a72401e80 None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:53:13.373925 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae50158-a6ff-48ca-8c64-b56a72401e80 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:53:13.373925 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae50158-a6ff-48ca-8c64-b56a72401e80 None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:53:13.375300 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 764/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 17:53:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:53:13.381221 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7473c7-0f93-4860-9754-62f9d0c5f890 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:53:13.381772 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7473c7-0f93-4860-9754-62f9d0c5f890 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:53:13.381772 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7473c7-0f93-4860-9754-62f9d0c5f890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:53:13.400434 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-5f7473c7-0f93-4860-9754-62f9d0c5f890 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:53:13.401679 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-5f7473c7-0f93-4860-9754-62f9d0c5f890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:53:13.409672 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 768/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 17:53:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 17:53:13.446632 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae50158-a6ff-48ca-8c64-b56a72401e80 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:53:13.459296 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae50158-a6ff-48ca-8c64-b56a72401e80 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:53:13.462948 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beb4ff6-5059-4e0f-bc89-7aa4986288a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:53:13.463681 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beb4ff6-5059-4e0f-bc89-7aa4986288a2 service neutron] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:53:13.463975 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beb4ff6-5059-4e0f-bc89-7aa4986288a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:53:13.464254 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beb4ff6-5059-4e0f-bc89-7aa4986288a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:53:13.474222 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beb4ff6-5059-4e0f-bc89-7aa4986288a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:53:13.475655 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beb4ff6-5059-4e0f-bc89-7aa4986288a2 service neutron] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:53:13.485659 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 765/1533] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:53:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:53:17.094384 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ca16d0-0c3b-4cf1-ab94-22276f0faade None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:53:17.094956 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ca16d0-0c3b-4cf1-ab94-22276f0faade None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:53:17.094956 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ca16d0-0c3b-4cf1-ab94-22276f0faade None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:53:17.096331 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 769/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 17:53:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:53:17.101920 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b66dce2-a8e1-43c8-9a27-e6f261bedd25 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:53:17.102363 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b66dce2-a8e1-43c8-9a27-e6f261bedd25 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:53:17.102488 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b66dce2-a8e1-43c8-9a27-e6f261bedd25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:53:17.120611 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-3b66dce2-a8e1-43c8-9a27-e6f261bedd25 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:53:17.121834 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-3b66dce2-a8e1-43c8-9a27-e6f261bedd25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:53:17.130383 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 766/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 17:53:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:53:17.437141 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ca16d0-0c3b-4cf1-ab94-22276f0faade None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:53:17.438818 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-08ca16d0-0c3b-4cf1-ab94-22276f0faade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:53:17.494916 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ca16d0-0c3b-4cf1-ab94-22276f0faade None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:53:17.498411 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887a169b-b6f1-4e44-9197-6f298af193f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de55cae1600841889668e36402861203', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:53:17.499050 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887a169b-b6f1-4e44-9197-6f298af193f2 service cinder] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:53:17.499329 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887a169b-b6f1-4e44-9197-6f298af193f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:53:17.499600 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887a169b-b6f1-4e44-9197-6f298af193f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:53:17.508348 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887a169b-b6f1-4e44-9197-6f298af193f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:53:17.509797 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887a169b-b6f1-4e44-9197-6f298af193f2 service cinder] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:53:17.519537 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 770/1536] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:53:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:53:19.629733 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0746f3-830b-4c29-9076-c969952a4061 None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:53:19.630302 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0746f3-830b-4c29-9076-c969952a4061 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:53:19.630302 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0746f3-830b-4c29-9076-c969952a4061 None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:53:19.631674 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 767/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 17:53:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:53:19.637083 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c966ce-d150-4a2a-b1fc-6e2e3eaa7e18 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:53:19.637592 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c966ce-d150-4a2a-b1fc-6e2e3eaa7e18 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:53:19.637699 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c966ce-d150-4a2a-b1fc-6e2e3eaa7e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:53:19.656063 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-b6c966ce-d150-4a2a-b1fc-6e2e3eaa7e18 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:53:19.657240 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-b6c966ce-d150-4a2a-b1fc-6e2e3eaa7e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:53:19.665075 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 771/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 17:53:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:53:19.975447 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0746f3-830b-4c29-9076-c969952a4061 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:53:19.977134 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-8f0746f3-830b-4c29-9076-c969952a4061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:53:19.991322 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0746f3-830b-4c29-9076-c969952a4061 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:53:19.996140 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014b5a76-6524-43a9-b337-df3935685716 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de55cae1600841889668e36402861203', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:53:19.996809 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b5a76-6524-43a9-b337-df3935685716 service cinder] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:53:19.997076 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b5a76-6524-43a9-b337-df3935685716 service cinder] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:53:19.997358 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b5a76-6524-43a9-b337-df3935685716 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:53:20.007108 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014b5a76-6524-43a9-b337-df3935685716 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:53:20.008536 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014b5a76-6524-43a9-b337-df3935685716 service cinder] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:53:20.018720 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 768/1539] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:53:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:53:29.650878 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=47 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:53:30.013920 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=33 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:55:04.821223 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49951449-d9eb-40fb-ac53-b1c7f813a672 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:04.822372 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49951449-d9eb-40fb-ac53-b1c7f813a672 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:04.822372 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49951449-d9eb-40fb-ac53-b1c7f813a672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:04.846588 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-49951449-d9eb-40fb-ac53-b1c7f813a672 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:55:04.848265 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-49951449-d9eb-40fb-ac53-b1c7f813a672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:04.862637 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 772/1540] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:55:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 17:55:04.872633 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1466f3-6ace-4043-97d6-589e6830b7b7 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:04.873302 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1466f3-6ace-4043-97d6-589e6830b7b7 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:04.873302 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1466f3-6ace-4043-97d6-589e6830b7b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:04.908055 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-8f1466f3-6ace-4043-97d6-589e6830b7b7 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:55:04.909302 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-8f1466f3-6ace-4043-97d6-589e6830b7b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:04.922874 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 769/1541] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:55:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:55:04.927589 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49951449-d9eb-40fb-ac53-b1c7f813a672 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:04.940954 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49951449-d9eb-40fb-ac53-b1c7f813a672 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:04.950041 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34298ea-1c21-49b7-9c32-06d7bdf28849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:04.950739 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34298ea-1c21-49b7-9c32-06d7bdf28849 admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:04.951032 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34298ea-1c21-49b7-9c32-06d7bdf28849 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:04.951321 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34298ea-1c21-49b7-9c32-06d7bdf28849 admin admin] PATH_INFO: `/v3/domains` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:04.952049 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34298ea-1c21-49b7-9c32-06d7bdf28849 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:55:04.952369 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34298ea-1c21-49b7-9c32-06d7bdf28849 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:04.954073 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34298ea-1c21-49b7-9c32-06d7bdf28849 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:04.973225 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 773/1542] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 14 17:55:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:55:04.982596 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1466f3-6ace-4043-97d6-589e6830b7b7 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:04.999737 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1466f3-6ace-4043-97d6-589e6830b7b7 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:05.010956 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd51ac7-8efe-4d50-807e-9066a1ccdb7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:05.011673 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd51ac7-8efe-4d50-807e-9066a1ccdb7b admin admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:05.012123 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd51ac7-8efe-4d50-807e-9066a1ccdb7b admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:05.012313 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd51ac7-8efe-4d50-807e-9066a1ccdb7b admin admin] PATH_INFO: `/v3/projects` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:05.012995 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd51ac7-8efe-4d50-807e-9066a1ccdb7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:05.015042 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd51ac7-8efe-4d50-807e-9066a1ccdb7b admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:05.057132 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 770/1543] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 14 17:55:04 2022] POST /identity/v3/projects => generated 387 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:55:05.061705 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34298ea-1c21-49b7-9c32-06d7bdf28849 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:05.076013 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34298ea-1c21-49b7-9c32-06d7bdf28849 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:05.093132 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a172498e-19fb-4fe7-b286-120407939339 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:05.093424 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a172498e-19fb-4fe7-b286-120407939339 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:05.093755 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a172498e-19fb-4fe7-b286-120407939339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:05.130777 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-a172498e-19fb-4fe7-b286-120407939339 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:55:05.132084 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-a172498e-19fb-4fe7-b286-120407939339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:05.175947 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5ec0c4-ea8a-4909-9cc4-ccb44d84f4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:05.176654 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5ec0c4-ea8a-4909-9cc4-ccb44d84f4bf admin admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:05.176935 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5ec0c4-ea8a-4909-9cc4-ccb44d84f4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:05.177210 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5ec0c4-ea8a-4909-9cc4-ccb44d84f4bf admin admin] PATH_INFO: `/v3/users` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:05.177943 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5ec0c4-ea8a-4909-9cc4-ccb44d84f4bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:05.181704 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5ec0c4-ea8a-4909-9cc4-ccb44d84f4bf admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:05.229453 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 774/1544] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 14 17:55:05 2022] POST /identity/v3/users => generated 294 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:55:05.234620 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5ec0c4-ea8a-4909-9cc4-ccb44d84f4bf admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:05.258993 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5ec0c4-ea8a-4909-9cc4-ccb44d84f4bf admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:05.269719 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6710eac3-16d8-4b89-b450-85f5fe38aafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:05.270827 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6710eac3-16d8-4b89-b450-85f5fe38aafc admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:05.271113 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6710eac3-16d8-4b89-b450-85f5fe38aafc admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:05.271595 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6710eac3-16d8-4b89-b450-85f5fe38aafc admin admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:05.272442 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6710eac3-16d8-4b89-b450-85f5fe38aafc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:05.274207 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6710eac3-16d8-4b89-b450-85f5fe38aafc admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:05.274472 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 771/1545] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:55:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:55:05.283967 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e630fe-6780-4681-9a3e-13c230864b63 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:05.284237 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e630fe-6780-4681-9a3e-13c230864b63 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:05.284529 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e630fe-6780-4681-9a3e-13c230864b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:05.294069 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 775/1546] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:55:05 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:55:05.295854 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d9a4f-22d2-4c63-9aa4-bb4f60783312 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:05.296151 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d9a4f-22d2-4c63-9aa4-bb4f60783312 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:05.296439 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d9a4f-22d2-4c63-9aa4-bb4f60783312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:05.325116 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-11e630fe-6780-4681-9a3e-13c230864b63 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:55:05.327983 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-11e630fe-6780-4681-9a3e-13c230864b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:05.347955 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-f15d9a4f-22d2-4c63-9aa4-bb4f60783312 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:55:05.351547 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-f15d9a4f-22d2-4c63-9aa4-bb4f60783312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:05.358878 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 772/1547] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:55:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 17:55:05.361603 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a4f16-1035-41ad-bdc8-0fd8ae90cfcb None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:05.362033 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a4f16-1035-41ad-bdc8-0fd8ae90cfcb None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:05.362324 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a4f16-1035-41ad-bdc8-0fd8ae90cfcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:05.373521 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 776/1548] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:55:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:55:05.374474 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15d9a4f-22d2-4c63-9aa4-bb4f60783312 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:05.392231 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15d9a4f-22d2-4c63-9aa4-bb4f60783312 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:05.395157 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-003a4f16-1035-41ad-bdc8-0fd8ae90cfcb None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:55:05.396498 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-003a4f16-1035-41ad-bdc8-0fd8ae90cfcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:05.397655 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba30c03-d1ac-49d7-9efa-896ca5737471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:05.398538 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba30c03-d1ac-49d7-9efa-896ca5737471 admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:05.398859 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba30c03-d1ac-49d7-9efa-896ca5737471 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:05.399129 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba30c03-d1ac-49d7-9efa-896ca5737471 admin admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:05.400081 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba30c03-d1ac-49d7-9efa-896ca5737471 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:05.401995 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba30c03-d1ac-49d7-9efa-896ca5737471 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:05.406342 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 773/1549] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:55:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:55:05.407667 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f1792b-9759-4499-b5fc-3412158dde5e None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:05.407935 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f1792b-9759-4499-b5fc-3412158dde5e None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:05.408204 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f1792b-9759-4499-b5fc-3412158dde5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:05.424022 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 777/1550] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:55:05 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:55:05.425846 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0552c8-fe08-4bb2-8b6a-45e037e76b00 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:05.426272 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0552c8-fe08-4bb2-8b6a-45e037e76b00 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:05.426565 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0552c8-fe08-4bb2-8b6a-45e037e76b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:05.441611 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-45f1792b-9759-4499-b5fc-3412158dde5e None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:55:05.444118 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-45f1792b-9759-4499-b5fc-3412158dde5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:05.449332 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-ef0552c8-fe08-4bb2-8b6a-45e037e76b00 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:55:05.450960 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-ef0552c8-fe08-4bb2-8b6a-45e037e76b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:05.456317 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 774/1551] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:55:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:55:05.460523 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f1792b-9759-4499-b5fc-3412158dde5e None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:05.460895 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 778/1552] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:55:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:55:05.467085 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d9dd1b-b8ac-4824-bcac-a7e7e5472358 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:05.467413 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d9dd1b-b8ac-4824-bcac-a7e7e5472358 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:05.467678 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d9dd1b-b8ac-4824-bcac-a7e7e5472358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:05.481090 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f1792b-9759-4499-b5fc-3412158dde5e None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:05.488402 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b9d162-a724-4b09-b1a3-e79f0ee3a345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:05.489124 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b9d162-a724-4b09-b1a3-e79f0ee3a345 admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:05.489417 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b9d162-a724-4b09-b1a3-e79f0ee3a345 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:05.489873 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b9d162-a724-4b09-b1a3-e79f0ee3a345 admin admin] PATH_INFO: `/v3/domains` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:05.490814 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b9d162-a724-4b09-b1a3-e79f0ee3a345 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:55:05.491166 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b9d162-a724-4b09-b1a3-e79f0ee3a345 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:05.492241 dv-cinder-849890-1-smb devstack@keystone.service[86772]: WARNING py.warnings [None req-03b9d162-a724-4b09-b1a3-e79f0ee3a345 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 17:55:05.492241 dv-cinder-849890-1-smb devstack@keystone.service[86772]: warnings.warn(msg) Jul 14 17:55:05.492241 dv-cinder-849890-1-smb devstack@keystone.service[86772]: Jul 14 17:55:05.494191 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b9d162-a724-4b09-b1a3-e79f0ee3a345 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:05.502840 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-d1d9dd1b-b8ac-4824-bcac-a7e7e5472358 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:55:05.504857 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-d1d9dd1b-b8ac-4824-bcac-a7e7e5472358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:05.511808 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 775/1553] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 14 17:55:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:55:05.517555 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5343dba-8be9-4cad-b294-89926c4e187e None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:05.517555 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5343dba-8be9-4cad-b294-89926c4e187e None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:05.517555 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5343dba-8be9-4cad-b294-89926c4e187e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:05.521273 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 779/1554] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:55:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:55:05.522529 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d9dd1b-b8ac-4824-bcac-a7e7e5472358 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:05.540684 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d9dd1b-b8ac-4824-bcac-a7e7e5472358 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:05.545101 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-e5343dba-8be9-4cad-b294-89926c4e187e None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:55:05.546843 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91e7cf6-8b50-4e23-87f7-701cf04d829e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:05.548264 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e7cf6-8b50-4e23-87f7-701cf04d829e admin admin] REQUEST_METHOD: `PUT` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:05.548868 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-e5343dba-8be9-4cad-b294-89926c4e187e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:05.549171 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e7cf6-8b50-4e23-87f7-701cf04d829e admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:05.549664 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e7cf6-8b50-4e23-87f7-701cf04d829e admin admin] PATH_INFO: `/v3/projects/3690dbb8683244128e547bf65677c776/users/dc2eceb8989543d4bdbbcd706ddbe676/roles/95d753870f97426cb1ce32e078621a4c` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:05.570402 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 776/1555] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:55:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:55:05.576151 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137694af-3a4e-4b5d-a99b-e63f2a9a43d4 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:05.578658 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137694af-3a4e-4b5d-a99b-e63f2a9a43d4 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:05.579336 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137694af-3a4e-4b5d-a99b-e63f2a9a43d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:05.582598 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91e7cf6-8b50-4e23-87f7-701cf04d829e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3690dbb8683244128e547bf65677c776, user_id=dc2eceb8989543d4bdbbcd706ddbe676, role_id=95d753870f97426cb1ce32e078621a4c)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:05.584766 dv-cinder-849890-1-smb devstack@keystone.service[86773]: WARNING py.warnings [None req-f91e7cf6-8b50-4e23-87f7-701cf04d829e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 17:55:05.584766 dv-cinder-849890-1-smb devstack@keystone.service[86773]: warnings.warn(msg) Jul 14 17:55:05.584766 dv-cinder-849890-1-smb devstack@keystone.service[86773]: Jul 14 17:55:05.589600 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91e7cf6-8b50-4e23-87f7-701cf04d829e admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:05.614052 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 780/1556] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 17:55:05 2022] PUT /identity/v3/projects/3690dbb8683244128e547bf65677c776/users/dc2eceb8989543d4bdbbcd706ddbe676/roles/95d753870f97426cb1ce32e078621a4c => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:55:05.617054 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb411537-9931-46e5-a10e-ded22c7b7f14 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:05.618166 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb411537-9931-46e5-a10e-ded22c7b7f14 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:05.619367 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb411537-9931-46e5-a10e-ded22c7b7f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:05.623069 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-137694af-3a4e-4b5d-a99b-e63f2a9a43d4 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:55:05.625933 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-137694af-3a4e-4b5d-a99b-e63f2a9a43d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:05.656303 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-eb411537-9931-46e5-a10e-ded22c7b7f14 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:55:05.658311 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-eb411537-9931-46e5-a10e-ded22c7b7f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:05.715774 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 777/1557] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:55:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:55:05.717071 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137694af-3a4e-4b5d-a99b-e63f2a9a43d4 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:05.734064 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137694af-3a4e-4b5d-a99b-e63f2a9a43d4 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:05.740848 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de17f789-969c-4a80-a493-117c2bc23d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:05.741908 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de17f789-969c-4a80-a493-117c2bc23d3f admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:05.742365 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de17f789-969c-4a80-a493-117c2bc23d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:05.742831 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de17f789-969c-4a80-a493-117c2bc23d3f admin admin] PATH_INFO: `/v3/domains` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:05.743834 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de17f789-969c-4a80-a493-117c2bc23d3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:55:05.744269 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de17f789-969c-4a80-a493-117c2bc23d3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:05.746293 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de17f789-969c-4a80-a493-117c2bc23d3f admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:05.764282 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 778/1558] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 14 17:55:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:55:05.764282 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de17f789-969c-4a80-a493-117c2bc23d3f admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:05.775581 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de17f789-969c-4a80-a493-117c2bc23d3f admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:05.776305 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 781/1559] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:55:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:55:05.777300 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb411537-9931-46e5-a10e-ded22c7b7f14 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:05.786118 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:55:05.788800 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152a5850-87ac-46b3-9923-a7f46de62ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:05.790487 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a5850-87ac-46b3-9923-a7f46de62ee7 admin admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:05.790968 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a5850-87ac-46b3-9923-a7f46de62ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:05.791443 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a5850-87ac-46b3-9923-a7f46de62ee7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:05.791806 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb411537-9931-46e5-a10e-ded22c7b7f14 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:05.792389 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152a5850-87ac-46b3-9923-a7f46de62ee7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:05.796011 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152a5850-87ac-46b3-9923-a7f46de62ee7 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:05.799203 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6c629f-338a-4085-99cc-6bdc2774d0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:05.799892 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c629f-338a-4085-99cc-6bdc2774d0f3 admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:05.800178 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c629f-338a-4085-99cc-6bdc2774d0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:05.800453 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c629f-338a-4085-99cc-6bdc2774d0f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:05.801204 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6c629f-338a-4085-99cc-6bdc2774d0f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:55:05.801546 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6c629f-338a-4085-99cc-6bdc2774d0f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:05.804018 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6c629f-338a-4085-99cc-6bdc2774d0f3 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:05.819242 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 782/1560] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 14 17:55:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:55:05.820824 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0cfb95-c37f-4a68-80f7-724f88011c86 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:05.821128 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0cfb95-c37f-4a68-80f7-724f88011c86 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:05.821406 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0cfb95-c37f-4a68-80f7-724f88011c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:05.831550 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:55:05.843293 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-0f0cfb95-c37f-4a68-80f7-724f88011c86 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:55:05.844176 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 779/1561] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 14 17:55:05 2022] POST /identity/v3/projects => generated 391 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:55:05.844770 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-0f0cfb95-c37f-4a68-80f7-724f88011c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:05.845998 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e5d6a3-0b01-485b-8723-51d7182e28f8 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:05.846570 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e5d6a3-0b01-485b-8723-51d7182e28f8 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:05.847033 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e5d6a3-0b01-485b-8723-51d7182e28f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:05.872384 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-81e5d6a3-0b01-485b-8723-51d7182e28f8 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:55:05.873883 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-81e5d6a3-0b01-485b-8723-51d7182e28f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:05.922918 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 783/1562] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:55:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:55:05.927641 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ed188-0c57-4ca4-a79e-c70984badbe2 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:05.927959 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ed188-0c57-4ca4-a79e-c70984badbe2 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:05.928248 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ed188-0c57-4ca4-a79e-c70984badbe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:05.941654 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 780/1563] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:55:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:55:05.942525 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e5d6a3-0b01-485b-8723-51d7182e28f8 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:05.948805 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-0b3ed188-0c57-4ca4-a79e-c70984badbe2 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:55:05.950488 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-0b3ed188-0c57-4ca4-a79e-c70984badbe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:05.954397 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e5d6a3-0b01-485b-8723-51d7182e28f8 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:05.959209 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc532b3-5345-4429-b5d7-9367105ec3b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:05.959471 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 784/1564] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:55:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:55:05.967960 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc532b3-5345-4429-b5d7-9367105ec3b5 admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:05.967960 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc532b3-5345-4429-b5d7-9367105ec3b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:05.968190 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3ed188-0c57-4ca4-a79e-c70984badbe2 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:05.968296 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc532b3-5345-4429-b5d7-9367105ec3b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:05.968296 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc532b3-5345-4429-b5d7-9367105ec3b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:55:05.968296 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc532b3-5345-4429-b5d7-9367105ec3b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:05.968296 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc532b3-5345-4429-b5d7-9367105ec3b5 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:05.987941 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 781/1565] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 14 17:55:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:55:05.987941 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc532b3-5345-4429-b5d7-9367105ec3b5 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:05.988277 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3ed188-0c57-4ca4-a79e-c70984badbe2 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:05.988792 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd49ec67-f6cc-4ebb-ac86-44a6f8a26152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:05.989465 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd49ec67-f6cc-4ebb-ac86-44a6f8a26152 admin admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:05.989775 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd49ec67-f6cc-4ebb-ac86-44a6f8a26152 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:05.990050 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd49ec67-f6cc-4ebb-ac86-44a6f8a26152 admin admin] PATH_INFO: `/v3/projects` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:05.990755 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd49ec67-f6cc-4ebb-ac86-44a6f8a26152 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:05.991783 dv-cinder-849890-1-smb devstack@keystone.service[86773]: WARNING py.warnings [None req-bd49ec67-f6cc-4ebb-ac86-44a6f8a26152 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 17:55:05.991783 dv-cinder-849890-1-smb devstack@keystone.service[86773]: warnings.warn(msg) Jul 14 17:55:05.991783 dv-cinder-849890-1-smb devstack@keystone.service[86773]: Jul 14 17:55:05.992999 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd49ec67-f6cc-4ebb-ac86-44a6f8a26152 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:06.000911 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc532b3-5345-4429-b5d7-9367105ec3b5 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:06.008048 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c556b480-d5e0-4fa7-b09d-559ed02b5693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:06.009665 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c556b480-d5e0-4fa7-b09d-559ed02b5693 admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:06.009975 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c556b480-d5e0-4fa7-b09d-559ed02b5693 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:06.010294 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c556b480-d5e0-4fa7-b09d-559ed02b5693 admin admin] PATH_INFO: `/v3/domains` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:06.011353 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c556b480-d5e0-4fa7-b09d-559ed02b5693 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:55:06.011759 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c556b480-d5e0-4fa7-b09d-559ed02b5693 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:06.013855 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c556b480-d5e0-4fa7-b09d-559ed02b5693 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:06.020529 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 785/1566] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 14 17:55:05 2022] POST /identity/v3/projects => generated 377 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:55:06.025118 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd49ec67-f6cc-4ebb-ac86-44a6f8a26152 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:06.028551 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 782/1567] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 14 17:55:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:55:06.029601 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c556b480-d5e0-4fa7-b09d-559ed02b5693 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:06.040340 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c556b480-d5e0-4fa7-b09d-559ed02b5693 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:06.104019 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd49ec67-f6cc-4ebb-ac86-44a6f8a26152 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:06.111053 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d1f365-6628-4141-9e34-53f556d8c4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:06.111396 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b809c216-4fd4-454d-baca-364cb0ffea3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:06.112193 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d1f365-6628-4141-9e34-53f556d8c4e8 admin admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:06.112306 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b809c216-4fd4-454d-baca-364cb0ffea3d admin admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:06.112597 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b809c216-4fd4-454d-baca-364cb0ffea3d admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:06.112713 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d1f365-6628-4141-9e34-53f556d8c4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:06.112957 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b809c216-4fd4-454d-baca-364cb0ffea3d admin admin] PATH_INFO: `/v3/users` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:06.113174 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d1f365-6628-4141-9e34-53f556d8c4e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:06.114127 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b809c216-4fd4-454d-baca-364cb0ffea3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:06.114475 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d1f365-6628-4141-9e34-53f556d8c4e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:06.115881 dv-cinder-849890-1-smb devstack@keystone.service[86772]: WARNING py.warnings [None req-b809c216-4fd4-454d-baca-364cb0ffea3d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 17:55:06.115881 dv-cinder-849890-1-smb devstack@keystone.service[86772]: warnings.warn(msg) Jul 14 17:55:06.115881 dv-cinder-849890-1-smb devstack@keystone.service[86772]: Jul 14 17:55:06.117777 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d1f365-6628-4141-9e34-53f556d8c4e8 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:06.117911 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b809c216-4fd4-454d-baca-364cb0ffea3d admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:06.150099 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 786/1568] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 14 17:55:06 2022] POST /identity/v3/projects => generated 371 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:55:06.151005 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d1f365-6628-4141-9e34-53f556d8c4e8 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:06.151532 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 783/1569] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 14 17:55:06 2022] POST /identity/v3/users => generated 296 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:55:06.153903 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3526e34-150d-4a29-a901-370e9353afaf None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:06.154708 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3526e34-150d-4a29-a901-370e9353afaf None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:06.155205 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3526e34-150d-4a29-a901-370e9353afaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:06.186360 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-f3526e34-150d-4a29-a901-370e9353afaf None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:55:06.188471 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-f3526e34-150d-4a29-a901-370e9353afaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:06.211398 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:55:06.217716 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d1f365-6628-4141-9e34-53f556d8c4e8 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:06.223848 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02249f1c-019e-4019-b5fd-e785ca1c6bce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:06.224835 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02249f1c-019e-4019-b5fd-e785ca1c6bce service neutron] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:06.225250 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02249f1c-019e-4019-b5fd-e785ca1c6bce service neutron] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:06.225922 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02249f1c-019e-4019-b5fd-e785ca1c6bce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:06.263224 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 784/1570] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:55:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:55:06.264556 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6718b55a-c152-42f0-8ae6-4a572cad9b20 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:06.264842 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6718b55a-c152-42f0-8ae6-4a572cad9b20 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:06.265160 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6718b55a-c152-42f0-8ae6-4a572cad9b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:06.271681 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:55:06.286558 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-6718b55a-c152-42f0-8ae6-4a572cad9b20 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:55:06.287808 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-6718b55a-c152-42f0-8ae6-4a572cad9b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:06.296835 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 785/1571] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:55:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:55:06.298331 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6718b55a-c152-42f0-8ae6-4a572cad9b20 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:06.308440 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6718b55a-c152-42f0-8ae6-4a572cad9b20 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:06.314218 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fb3a04-e1fa-476c-9b56-86b603201f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:06.315071 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fb3a04-e1fa-476c-9b56-86b603201f98 admin admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:06.315568 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fb3a04-e1fa-476c-9b56-86b603201f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:06.315950 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fb3a04-e1fa-476c-9b56-86b603201f98 admin admin] PATH_INFO: `/v3/projects` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:06.316761 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fb3a04-e1fa-476c-9b56-86b603201f98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:06.317182 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02249f1c-019e-4019-b5fd-e785ca1c6bce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:06.318683 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02249f1c-019e-4019-b5fd-e785ca1c6bce service neutron] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:06.319197 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fb3a04-e1fa-476c-9b56-86b603201f98 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:06.329894 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 787/1572] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:55:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:55:06.330769 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02249f1c-019e-4019-b5fd-e785ca1c6bce service neutron] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:06.342239 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02249f1c-019e-4019-b5fd-e785ca1c6bce service neutron] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:06.347971 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed1690e-2578-44a2-b79e-b0ef63a91a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:06.349141 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed1690e-2578-44a2-b79e-b0ef63a91a4a admin admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:06.349141 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed1690e-2578-44a2-b79e-b0ef63a91a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:06.349381 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed1690e-2578-44a2-b79e-b0ef63a91a4a admin admin] PATH_INFO: `/v3/users` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:06.350680 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed1690e-2578-44a2-b79e-b0ef63a91a4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:06.352067 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed1690e-2578-44a2-b79e-b0ef63a91a4a admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:06.353459 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 786/1573] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 14 17:55:06 2022] POST /identity/v3/projects => generated 383 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:55:06.358130 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fb3a04-e1fa-476c-9b56-86b603201f98 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:06.376771 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 788/1574] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 14 17:55:06 2022] POST /identity/v3/users => generated 289 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:55:06.377732 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed1690e-2578-44a2-b79e-b0ef63a91a4a admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:06.388187 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed1690e-2578-44a2-b79e-b0ef63a91a4a admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:06.443173 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fb3a04-e1fa-476c-9b56-86b603201f98 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:06.449161 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25605ff-00d4-4905-8543-c6993502143f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:06.449925 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25605ff-00d4-4905-8543-c6993502143f admin admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:06.450273 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25605ff-00d4-4905-8543-c6993502143f admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:06.450740 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25605ff-00d4-4905-8543-c6993502143f admin admin] PATH_INFO: `/v3/projects` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:06.451264 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25605ff-00d4-4905-8543-c6993502143f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:06.454203 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25605ff-00d4-4905-8543-c6993502143f admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:06.487118 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f28629f-08e2-4486-9430-ab532219d50b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:06.487827 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f28629f-08e2-4486-9430-ab532219d50b admin admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:06.488107 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f28629f-08e2-4486-9430-ab532219d50b admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:06.488399 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f28629f-08e2-4486-9430-ab532219d50b admin admin] PATH_INFO: `/v3/users` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:06.489123 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f28629f-08e2-4486-9430-ab532219d50b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:06.491353 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f28629f-08e2-4486-9430-ab532219d50b admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:06.505080 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 787/1575] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 14 17:55:06 2022] POST /identity/v3/projects => generated 375 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:55:06.506318 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25605ff-00d4-4905-8543-c6993502143f admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:06.520381 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 789/1576] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 14 17:55:06 2022] POST /identity/v3/users => generated 286 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:55:06.521649 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f28629f-08e2-4486-9430-ab532219d50b admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:06.536541 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f28629f-08e2-4486-9430-ab532219d50b admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:06.611354 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25605ff-00d4-4905-8543-c6993502143f admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:06.617686 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c11ff03-287e-4ceb-a8a9-2298cd06de8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:06.618520 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11ff03-287e-4ceb-a8a9-2298cd06de8e admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:06.618959 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11ff03-287e-4ceb-a8a9-2298cd06de8e admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:06.619315 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11ff03-287e-4ceb-a8a9-2298cd06de8e admin admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:06.619495 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3312e70-4c43-48ae-b687-df29a7bba881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:06.620081 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c11ff03-287e-4ceb-a8a9-2298cd06de8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:06.620232 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3312e70-4c43-48ae-b687-df29a7bba881 admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:06.620392 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3312e70-4c43-48ae-b687-df29a7bba881 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:06.620748 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3312e70-4c43-48ae-b687-df29a7bba881 admin admin] PATH_INFO: `/v3/domains` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:06.621389 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3312e70-4c43-48ae-b687-df29a7bba881 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:55:06.621731 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3312e70-4c43-48ae-b687-df29a7bba881 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:06.622097 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c11ff03-287e-4ceb-a8a9-2298cd06de8e admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:06.623537 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3312e70-4c43-48ae-b687-df29a7bba881 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:06.645217 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 788/1577] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:55:06 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:55:06.645755 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 790/1578] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 14 17:55:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:55:06.645939 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c11ff03-287e-4ceb-a8a9-2298cd06de8e admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:06.646107 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3312e70-4c43-48ae-b687-df29a7bba881 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:06.651251 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:55:06.656957 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3312e70-4c43-48ae-b687-df29a7bba881 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:06.664830 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feed6cc4-3940-4211-8698-fb162cedb879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:06.665156 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed6cc4-3940-4211-8698-fb162cedb879 admin admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:06.665323 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed6cc4-3940-4211-8698-fb162cedb879 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:06.665716 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed6cc4-3940-4211-8698-fb162cedb879 admin admin] PATH_INFO: `/v3/users` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:06.666446 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feed6cc4-3940-4211-8698-fb162cedb879 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:06.668980 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feed6cc4-3940-4211-8698-fb162cedb879 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:06.669490 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c11ff03-287e-4ceb-a8a9-2298cd06de8e admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:06.677230 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c4ac50-7114-4233-b387-2fbc7861875a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:06.679069 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c4ac50-7114-4233-b387-2fbc7861875a admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:06.679458 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c4ac50-7114-4233-b387-2fbc7861875a admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:06.680986 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c4ac50-7114-4233-b387-2fbc7861875a admin admin] PATH_INFO: `/v3/domains` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:06.682166 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c4ac50-7114-4233-b387-2fbc7861875a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:55:06.682671 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c4ac50-7114-4233-b387-2fbc7861875a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:06.685945 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c4ac50-7114-4233-b387-2fbc7861875a admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:06.696812 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 791/1579] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 14 17:55:06 2022] POST /identity/v3/users => generated 292 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:55:06.701406 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feed6cc4-3940-4211-8698-fb162cedb879 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:06.717558 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 789/1580] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 14 17:55:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:55:06.717558 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c4ac50-7114-4233-b387-2fbc7861875a admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:06.718006 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feed6cc4-3940-4211-8698-fb162cedb879 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:06.723628 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9aca8d-8362-41a6-a4b9-0eb3429c8821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:06.724580 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9aca8d-8362-41a6-a4b9-0eb3429c8821 admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:06.724915 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9aca8d-8362-41a6-a4b9-0eb3429c8821 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:06.725270 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9aca8d-8362-41a6-a4b9-0eb3429c8821 admin admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:06.726150 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9aca8d-8362-41a6-a4b9-0eb3429c8821 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:06.728672 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9aca8d-8362-41a6-a4b9-0eb3429c8821 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:06.732430 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c4ac50-7114-4233-b387-2fbc7861875a admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:06.738502 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755382ed-b5c9-4452-b02b-2c3647203f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:06.739203 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755382ed-b5c9-4452-b02b-2c3647203f56 admin admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:06.739485 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755382ed-b5c9-4452-b02b-2c3647203f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:06.739769 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755382ed-b5c9-4452-b02b-2c3647203f56 admin admin] PATH_INFO: `/v3/users` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:06.745944 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 792/1581] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:55:06 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:55:06.746228 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755382ed-b5c9-4452-b02b-2c3647203f56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:06.746414 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9aca8d-8362-41a6-a4b9-0eb3429c8821 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:06.746570 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755382ed-b5c9-4452-b02b-2c3647203f56 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:06.758549 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9aca8d-8362-41a6-a4b9-0eb3429c8821 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:06.764952 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fed592-fa63-4324-b04e-add25544cab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:06.765825 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fed592-fa63-4324-b04e-add25544cab7 admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:06.766160 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fed592-fa63-4324-b04e-add25544cab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:06.766516 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fed592-fa63-4324-b04e-add25544cab7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:06.767351 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fed592-fa63-4324-b04e-add25544cab7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:06.769669 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fed592-fa63-4324-b04e-add25544cab7 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:06.774518 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 790/1582] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 14 17:55:06 2022] POST /identity/v3/users => generated 288 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:55:06.775332 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755382ed-b5c9-4452-b02b-2c3647203f56 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:06.785256 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 793/1583] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:55:06 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:55:06.786191 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fed592-fa63-4324-b04e-add25544cab7 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:06.788360 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755382ed-b5c9-4452-b02b-2c3647203f56 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:06.794880 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9326b8d3-1ba1-4416-8f26-970b15df2fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:06.795748 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9326b8d3-1ba1-4416-8f26-970b15df2fc8 admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:06.796037 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9326b8d3-1ba1-4416-8f26-970b15df2fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:06.796311 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9326b8d3-1ba1-4416-8f26-970b15df2fc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:06.797061 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9326b8d3-1ba1-4416-8f26-970b15df2fc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:06.798417 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fed592-fa63-4324-b04e-add25544cab7 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:06.798975 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9326b8d3-1ba1-4416-8f26-970b15df2fc8 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:06.804072 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3912a97-2352-4f55-a479-14505eeba9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:06.804986 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3912a97-2352-4f55-a479-14505eeba9e5 admin admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:06.806035 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3912a97-2352-4f55-a479-14505eeba9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:06.806472 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3912a97-2352-4f55-a479-14505eeba9e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:06.807775 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3912a97-2352-4f55-a479-14505eeba9e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:06.809886 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3912a97-2352-4f55-a479-14505eeba9e5 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:06.818697 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 791/1584] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:55:06 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:55:06.819647 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9326b8d3-1ba1-4416-8f26-970b15df2fc8 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:06.835988 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9326b8d3-1ba1-4416-8f26-970b15df2fc8 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:06.840691 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c64838-1c01-4188-9f74-83b796781df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:06.841397 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c64838-1c01-4188-9f74-83b796781df2 admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:06.842254 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c64838-1c01-4188-9f74-83b796781df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:06.842880 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c64838-1c01-4188-9f74-83b796781df2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:06.843852 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c64838-1c01-4188-9f74-83b796781df2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:06.846015 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c64838-1c01-4188-9f74-83b796781df2 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:06.864887 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 792/1585] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:55:06 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:55:06.864887 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c64838-1c01-4188-9f74-83b796781df2 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:06.868783 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:55:06.877293 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 794/1586] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 14 17:55:06 2022] POST /identity/v3/projects => generated 379 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:55:06.877293 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3912a97-2352-4f55-a479-14505eeba9e5 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:06.879572 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c64838-1c01-4188-9f74-83b796781df2 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:06.959450 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb122d6e-faad-4a98-927a-7c384c1d3788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:06.960244 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb122d6e-faad-4a98-927a-7c384c1d3788 admin admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:06.960529 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb122d6e-faad-4a98-927a-7c384c1d3788 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:06.960936 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb122d6e-faad-4a98-927a-7c384c1d3788 admin admin] PATH_INFO: `/v3/projects` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:06.962597 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb122d6e-faad-4a98-927a-7c384c1d3788 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:06.964652 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb122d6e-faad-4a98-927a-7c384c1d3788 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:06.985224 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3912a97-2352-4f55-a479-14505eeba9e5 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:06.994258 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d87212-aaaf-4586-9011-bce67acb693e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:06.995086 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d87212-aaaf-4586-9011-bce67acb693e admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:06.995545 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d87212-aaaf-4586-9011-bce67acb693e admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:06.995921 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d87212-aaaf-4586-9011-bce67acb693e admin admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:06.996890 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d87212-aaaf-4586-9011-bce67acb693e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:06.998656 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d87212-aaaf-4586-9011-bce67acb693e admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:07.014572 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 793/1587] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 14 17:55:06 2022] POST /identity/v3/projects => generated 365 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:55:07.014572 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb122d6e-faad-4a98-927a-7c384c1d3788 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:07.014874 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 795/1588] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:55:06 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:55:07.014874 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d87212-aaaf-4586-9011-bce67acb693e admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:07.033982 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d87212-aaaf-4586-9011-bce67acb693e admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:07.095570 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb122d6e-faad-4a98-927a-7c384c1d3788 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:07.106164 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969f2ff3-a5da-4a0a-bd56-bfbaa4f71e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:07.108706 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969f2ff3-a5da-4a0a-bd56-bfbaa4f71e5f admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:07.109026 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969f2ff3-a5da-4a0a-bd56-bfbaa4f71e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:07.109308 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969f2ff3-a5da-4a0a-bd56-bfbaa4f71e5f admin admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:07.110236 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969f2ff3-a5da-4a0a-bd56-bfbaa4f71e5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:07.111901 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969f2ff3-a5da-4a0a-bd56-bfbaa4f71e5f admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:07.131328 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 794/1589] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:55:07 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:55:07.131328 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969f2ff3-a5da-4a0a-bd56-bfbaa4f71e5f admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:07.137055 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eecde8-1ce8-457f-b3a7-929e5fb512bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:07.137782 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eecde8-1ce8-457f-b3a7-929e5fb512bf admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:07.138066 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eecde8-1ce8-457f-b3a7-929e5fb512bf admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:07.138342 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eecde8-1ce8-457f-b3a7-929e5fb512bf admin admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:07.139249 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eecde8-1ce8-457f-b3a7-929e5fb512bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:07.141096 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eecde8-1ce8-457f-b3a7-929e5fb512bf admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:07.143074 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969f2ff3-a5da-4a0a-bd56-bfbaa4f71e5f admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:07.149392 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6250918-a078-4055-8960-9210ed5442c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:07.150357 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6250918-a078-4055-8960-9210ed5442c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:07.150732 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6250918-a078-4055-8960-9210ed5442c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:07.151013 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6250918-a078-4055-8960-9210ed5442c7 admin admin] PATH_INFO: `/v3/projects/f7487b126eed4c2f9f571d3e94b3ae6a/users/eb82471499754e30a4dc121c40b208a3/roles/95d753870f97426cb1ce32e078621a4c` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:07.151855 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 796/1590] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:55:07 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:55:07.152958 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eecde8-1ce8-457f-b3a7-929e5fb512bf admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:07.168414 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eecde8-1ce8-457f-b3a7-929e5fb512bf admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:07.172042 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6250918-a078-4055-8960-9210ed5442c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7487b126eed4c2f9f571d3e94b3ae6a, user_id=eb82471499754e30a4dc121c40b208a3, role_id=95d753870f97426cb1ce32e078621a4c)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:07.175060 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df32370-cba7-4389-b753-2f6293fc8cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:07.175338 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6250918-a078-4055-8960-9210ed5442c7 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:07.175937 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df32370-cba7-4389-b753-2f6293fc8cf9 admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:07.176278 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df32370-cba7-4389-b753-2f6293fc8cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:07.176581 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df32370-cba7-4389-b753-2f6293fc8cf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:07.177345 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df32370-cba7-4389-b753-2f6293fc8cf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:07.180558 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df32370-cba7-4389-b753-2f6293fc8cf9 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:07.193261 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 795/1591] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 17:55:07 2022] PUT /identity/v3/projects/f7487b126eed4c2f9f571d3e94b3ae6a/users/eb82471499754e30a4dc121c40b208a3/roles/95d753870f97426cb1ce32e078621a4c => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:55:07.194416 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6250918-a078-4055-8960-9210ed5442c7 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:07.198596 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 797/1592] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:55:07 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:55:07.203923 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df32370-cba7-4389-b753-2f6293fc8cf9 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:07.233255 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df32370-cba7-4389-b753-2f6293fc8cf9 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:07.265718 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:55:07.289298 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6250918-a078-4055-8960-9210ed5442c7 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:07.297520 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d7bede-8217-4aaa-8258-19f050f8a812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:07.301192 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d7bede-8217-4aaa-8258-19f050f8a812 admin admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:07.301192 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d7bede-8217-4aaa-8258-19f050f8a812 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:07.301192 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d7bede-8217-4aaa-8258-19f050f8a812 admin admin] PATH_INFO: `/v3/users` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:07.301192 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d7bede-8217-4aaa-8258-19f050f8a812 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:07.302009 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d7bede-8217-4aaa-8258-19f050f8a812 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:07.309224 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:55:07.332861 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 796/1593] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 14 17:55:07 2022] POST /identity/v3/users => generated 290 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:55:07.333753 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d7bede-8217-4aaa-8258-19f050f8a812 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:07.344444 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d7bede-8217-4aaa-8258-19f050f8a812 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:07.349197 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f2cab9-54ac-40c2-b678-4f6ad154fc00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:07.350148 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f2cab9-54ac-40c2-b678-4f6ad154fc00 admin admin] REQUEST_METHOD: `PUT` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:07.350425 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f2cab9-54ac-40c2-b678-4f6ad154fc00 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:07.351170 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f2cab9-54ac-40c2-b678-4f6ad154fc00 admin admin] PATH_INFO: `/v3/projects/cb388fad852f435bb3d451ee421726ab/users/d66a790ca51f45dcb16812011445f31b/roles/95d753870f97426cb1ce32e078621a4c` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:07.357876 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e8515a-3032-4248-8a6c-156db5f45dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:07.358947 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8515a-3032-4248-8a6c-156db5f45dd5 admin admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:07.359554 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8515a-3032-4248-8a6c-156db5f45dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:07.360067 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8515a-3032-4248-8a6c-156db5f45dd5 admin admin] PATH_INFO: `/v3/users` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:07.361058 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e8515a-3032-4248-8a6c-156db5f45dd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:07.363891 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e8515a-3032-4248-8a6c-156db5f45dd5 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:07.377555 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f2cab9-54ac-40c2-b678-4f6ad154fc00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb388fad852f435bb3d451ee421726ab, user_id=d66a790ca51f45dcb16812011445f31b, role_id=95d753870f97426cb1ce32e078621a4c)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:07.381702 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f2cab9-54ac-40c2-b678-4f6ad154fc00 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:07.390200 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 798/1594] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 14 17:55:07 2022] POST /identity/v3/users => generated 283 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:55:07.391439 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e8515a-3032-4248-8a6c-156db5f45dd5 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:07.406722 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e8515a-3032-4248-8a6c-156db5f45dd5 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:07.408450 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 797/1595] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 17:55:07 2022] PUT /identity/v3/projects/cb388fad852f435bb3d451ee421726ab/users/d66a790ca51f45dcb16812011445f31b/roles/95d753870f97426cb1ce32e078621a4c => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:55:07.409283 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f2cab9-54ac-40c2-b678-4f6ad154fc00 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:07.496644 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702ab75e-5058-4bc9-a681-b43c47b499ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:07.497943 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702ab75e-5058-4bc9-a681-b43c47b499ad admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:07.498584 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702ab75e-5058-4bc9-a681-b43c47b499ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:07.499076 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702ab75e-5058-4bc9-a681-b43c47b499ad admin admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:07.500028 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702ab75e-5058-4bc9-a681-b43c47b499ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:07.502085 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702ab75e-5058-4bc9-a681-b43c47b499ad admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:07.508013 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f2cab9-54ac-40c2-b678-4f6ad154fc00 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:07.515282 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 799/1596] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:55:07 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:55:07.515492 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a93b1f7-1b84-412e-a1ce-8a9c3b0cdf07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:07.516456 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a93b1f7-1b84-412e-a1ce-8a9c3b0cdf07 admin admin] REQUEST_METHOD: `PUT` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:07.516807 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a93b1f7-1b84-412e-a1ce-8a9c3b0cdf07 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:07.517154 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a93b1f7-1b84-412e-a1ce-8a9c3b0cdf07 admin admin] PATH_INFO: `/v3/projects/5dbcbe1f42664e898abc29a32ce8b8d6/users/4c84f6acbaed471ea84a82eacb1342e5/roles/95d753870f97426cb1ce32e078621a4c` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:07.518065 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c64ba37-3656-43b4-b226-11a6b6170061 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:07.518571 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c64ba37-3656-43b4-b226-11a6b6170061 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:07.518958 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c64ba37-3656-43b4-b226-11a6b6170061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:07.540377 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a93b1f7-1b84-412e-a1ce-8a9c3b0cdf07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dbcbe1f42664e898abc29a32ce8b8d6, user_id=4c84f6acbaed471ea84a82eacb1342e5, role_id=95d753870f97426cb1ce32e078621a4c)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:07.542346 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-0c64ba37-3656-43b4-b226-11a6b6170061 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:55:07.543720 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-0c64ba37-3656-43b4-b226-11a6b6170061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:07.546118 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a93b1f7-1b84-412e-a1ce-8a9c3b0cdf07 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:07.556969 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 800/1597] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:55:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:55:07.556969 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c64ba37-3656-43b4-b226-11a6b6170061 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:07.572909 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 798/1598] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 17:55:07 2022] PUT /identity/v3/projects/5dbcbe1f42664e898abc29a32ce8b8d6/users/4c84f6acbaed471ea84a82eacb1342e5/roles/95d753870f97426cb1ce32e078621a4c => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:55:07.574582 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a93b1f7-1b84-412e-a1ce-8a9c3b0cdf07 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:07.579753 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c64ba37-3656-43b4-b226-11a6b6170061 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:07.667932 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a93b1f7-1b84-412e-a1ce-8a9c3b0cdf07 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:07.674520 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbec83ca-8cff-427f-abda-fc3be9fe3228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:07.675245 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbec83ca-8cff-427f-abda-fc3be9fe3228 admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:07.675538 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbec83ca-8cff-427f-abda-fc3be9fe3228 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:07.675683 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a429859f-2848-435c-a3dc-97b9947e2c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:07.675830 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbec83ca-8cff-427f-abda-fc3be9fe3228 admin admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:07.676636 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbec83ca-8cff-427f-abda-fc3be9fe3228 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:07.677340 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a429859f-2848-435c-a3dc-97b9947e2c54 admin admin] REQUEST_METHOD: `PUT` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:07.677733 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a429859f-2848-435c-a3dc-97b9947e2c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:07.678081 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a429859f-2848-435c-a3dc-97b9947e2c54 admin admin] PATH_INFO: `/v3/projects/9f95d535e3a34fe78406efd7512b87ef/users/f3d7c4031bc34814bb4f0a5a78dc4ad1/roles/95d753870f97426cb1ce32e078621a4c` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:07.678418 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbec83ca-8cff-427f-abda-fc3be9fe3228 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:07.696365 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 799/1599] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:55:07 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:55:07.696365 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbec83ca-8cff-427f-abda-fc3be9fe3228 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:07.699200 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a429859f-2848-435c-a3dc-97b9947e2c54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f95d535e3a34fe78406efd7512b87ef, user_id=f3d7c4031bc34814bb4f0a5a78dc4ad1, role_id=95d753870f97426cb1ce32e078621a4c)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:07.703343 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a429859f-2848-435c-a3dc-97b9947e2c54 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:07.709159 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbec83ca-8cff-427f-abda-fc3be9fe3228 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:07.722188 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd59ad9-a790-4ce4-8c16-92b235fa01ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:07.723454 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd59ad9-a790-4ce4-8c16-92b235fa01ee admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:07.723961 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd59ad9-a790-4ce4-8c16-92b235fa01ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:07.725681 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd59ad9-a790-4ce4-8c16-92b235fa01ee admin admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:07.727405 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd59ad9-a790-4ce4-8c16-92b235fa01ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:07.728192 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 801/1600] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 17:55:07 2022] PUT /identity/v3/projects/9f95d535e3a34fe78406efd7512b87ef/users/f3d7c4031bc34814bb4f0a5a78dc4ad1/roles/95d753870f97426cb1ce32e078621a4c => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:55:07.729975 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826453c1-df55-4c70-8e15-b0cfa087ab04 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:07.730520 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826453c1-df55-4c70-8e15-b0cfa087ab04 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:07.731009 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826453c1-df55-4c70-8e15-b0cfa087ab04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:07.732847 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd59ad9-a790-4ce4-8c16-92b235fa01ee admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:07.759971 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 800/1601] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:55:07 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:55:07.761829 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd59ad9-a790-4ce4-8c16-92b235fa01ee admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:07.765482 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-826453c1-df55-4c70-8e15-b0cfa087ab04 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:55:07.766995 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-826453c1-df55-4c70-8e15-b0cfa087ab04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:07.781179 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd59ad9-a790-4ce4-8c16-92b235fa01ee admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:07.799762 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:55:07.832127 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:55:07.875921 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ba5958-2cba-4762-9c93-7b42e534d095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:07.877425 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba5958-2cba-4762-9c93-7b42e534d095 admin admin] REQUEST_METHOD: `PUT` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:07.878657 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba5958-2cba-4762-9c93-7b42e534d095 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:07.879205 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba5958-2cba-4762-9c93-7b42e534d095 admin admin] PATH_INFO: `/v3/projects/713638d1d7e14911bff5a08a9f8c39a2/users/e8657a2ece214529ae946574fa183849/roles/95d753870f97426cb1ce32e078621a4c` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:07.886834 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 802/1602] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:55:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:55:07.886834 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826453c1-df55-4c70-8e15-b0cfa087ab04 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:07.886834 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-826453c1-df55-4c70-8e15-b0cfa087ab04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:07.910185 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ba5958-2cba-4762-9c93-7b42e534d095 admin admin] RBAC: Authorizing `identity:create_grant(project_id=713638d1d7e14911bff5a08a9f8c39a2, user_id=e8657a2ece214529ae946574fa183849, role_id=95d753870f97426cb1ce32e078621a4c)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:07.914393 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ba5958-2cba-4762-9c93-7b42e534d095 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:07.940630 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 801/1603] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 17:55:07 2022] PUT /identity/v3/projects/713638d1d7e14911bff5a08a9f8c39a2/users/e8657a2ece214529ae946574fa183849/roles/95d753870f97426cb1ce32e078621a4c => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:55:07.947768 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a2eca1-f566-4631-aedd-2a7020077618 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:07.949325 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a2eca1-f566-4631-aedd-2a7020077618 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:07.949682 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a2eca1-f566-4631-aedd-2a7020077618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:07.976926 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826453c1-df55-4c70-8e15-b0cfa087ab04 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:07.994097 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-f0a2eca1-f566-4631-aedd-2a7020077618 None None] MFA Rules not processed for user `4c84f6acbaed471ea84a82eacb1342e5`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:55:07.995844 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-f0a2eca1-f566-4631-aedd-2a7020077618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:08.060387 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e4a8c9-5cf2-4720-b623-18b9e1bd72db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:08.061107 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e4a8c9-5cf2-4720-b623-18b9e1bd72db service neutron] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:08.061497 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e4a8c9-5cf2-4720-b623-18b9e1bd72db service neutron] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:08.061821 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e4a8c9-5cf2-4720-b623-18b9e1bd72db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:08.135571 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 802/1604] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:55:07 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:55:08.137182 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a2eca1-f566-4631-aedd-2a7020077618 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:08.161024 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e4a8c9-5cf2-4720-b623-18b9e1bd72db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:08.163055 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e4a8c9-5cf2-4720-b623-18b9e1bd72db service neutron] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:08.178561 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 803/1605] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:55:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:55:08.181293 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e754e7c-b2c0-4604-bcc0-13457d638a7f None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:08.181816 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e754e7c-b2c0-4604-bcc0-13457d638a7f None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:08.182225 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e754e7c-b2c0-4604-bcc0-13457d638a7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:08.218239 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-4e754e7c-b2c0-4604-bcc0-13457d638a7f None None] MFA Rules not processed for user `f3d7c4031bc34814bb4f0a5a78dc4ad1`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:55:08.219363 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-4e754e7c-b2c0-4604-bcc0-13457d638a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:08.252501 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:55:08.333152 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 804/1606] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:55:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:55:08.334373 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e754e7c-b2c0-4604-bcc0-13457d638a7f None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:08.353110 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a2eca1-f566-4631-aedd-2a7020077618 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:08.359001 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5773b37-c02c-4b0d-87e6-346b167d8fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:08.359869 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5773b37-c02c-4b0d-87e6-346b167d8fb1 admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:08.360367 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5773b37-c02c-4b0d-87e6-346b167d8fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:08.361269 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5773b37-c02c-4b0d-87e6-346b167d8fb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:08.362076 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5773b37-c02c-4b0d-87e6-346b167d8fb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:08.364444 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5773b37-c02c-4b0d-87e6-346b167d8fb1 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:08.370480 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e754e7c-b2c0-4604-bcc0-13457d638a7f None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:08.380887 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 803/1607] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:55:08 2022] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:55:08.382551 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5773b37-c02c-4b0d-87e6-346b167d8fb1 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:08.386877 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849d75b6-fce5-482e-aa3a-d7995fc1a2d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:08.387618 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849d75b6-fce5-482e-aa3a-d7995fc1a2d4 admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:08.388079 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849d75b6-fce5-482e-aa3a-d7995fc1a2d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:08.388391 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849d75b6-fce5-482e-aa3a-d7995fc1a2d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:08.389559 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849d75b6-fce5-482e-aa3a-d7995fc1a2d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:08.393761 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849d75b6-fce5-482e-aa3a-d7995fc1a2d4 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:08.395711 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5773b37-c02c-4b0d-87e6-346b167d8fb1 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:08.400468 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a4af56-dc8b-4338-b7e1-3b5bcdc60a09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:08.401381 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a4af56-dc8b-4338-b7e1-3b5bcdc60a09 service neutron] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:08.401819 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a4af56-dc8b-4338-b7e1-3b5bcdc60a09 service neutron] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:08.402411 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a4af56-dc8b-4338-b7e1-3b5bcdc60a09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:08.415880 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a4af56-dc8b-4338-b7e1-3b5bcdc60a09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:08.417843 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a4af56-dc8b-4338-b7e1-3b5bcdc60a09 service neutron] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:08.426317 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 805/1608] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:55:08 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:55:08.431696 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f55b67-d11b-4dd3-8bb4-871632522b52 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:08.431987 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f55b67-d11b-4dd3-8bb4-871632522b52 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:08.435207 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f55b67-d11b-4dd3-8bb4-871632522b52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:08.437615 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 804/1609] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:55:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:55:08.439183 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc390619-4eee-4bdc-91b9-1bb6fe148651 None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:08.440191 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc390619-4eee-4bdc-91b9-1bb6fe148651 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:08.440191 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc390619-4eee-4bdc-91b9-1bb6fe148651 None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:08.448237 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 805/1610] 10.222.0.67 () {54 vars in 961 bytes} [Thu Jul 14 17:55:08 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:55:08.449408 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc390619-4eee-4bdc-91b9-1bb6fe148651 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:08.469511 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc390619-4eee-4bdc-91b9-1bb6fe148651 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:08.476320 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018ddfad-3ddc-4534-ba24-573ffa2536ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:08.478160 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ddfad-3ddc-4534-ba24-573ffa2536ac admin admin] REQUEST_METHOD: `PUT` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:08.478482 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ddfad-3ddc-4534-ba24-573ffa2536ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:08.478821 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ddfad-3ddc-4534-ba24-573ffa2536ac admin admin] PATH_INFO: `/v3/projects/9383d769d3b5441ca8a91161c6f36a93/users/a5a7061dd1154fcf891c2c8af16d7841/roles/95d753870f97426cb1ce32e078621a4c` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:08.504646 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018ddfad-3ddc-4534-ba24-573ffa2536ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=9383d769d3b5441ca8a91161c6f36a93, user_id=a5a7061dd1154fcf891c2c8af16d7841, role_id=95d753870f97426cb1ce32e078621a4c)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:08.513800 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-c0f55b67-d11b-4dd3-8bb4-871632522b52 None None] MFA Rules not processed for user `e8657a2ece214529ae946574fa183849`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:55:08.515089 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-c0f55b67-d11b-4dd3-8bb4-871632522b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:08.519282 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018ddfad-3ddc-4534-ba24-573ffa2536ac admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:08.556828 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 806/1611] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 17:55:08 2022] PUT /identity/v3/projects/9383d769d3b5441ca8a91161c6f36a93/users/a5a7061dd1154fcf891c2c8af16d7841/roles/95d753870f97426cb1ce32e078621a4c => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:55:08.559686 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa40012-d5da-4594-9bac-7d6ed65acb18 None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:08.559686 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa40012-d5da-4594-9bac-7d6ed65acb18 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:08.560373 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa40012-d5da-4594-9bac-7d6ed65acb18 None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:08.562622 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 807/1612] 10.222.0.67 () {54 vars in 961 bytes} [Thu Jul 14 17:55:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:55:08.564035 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa40012-d5da-4594-9bac-7d6ed65acb18 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:08.590905 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:55:08.632320 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 806/1613] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:55:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:55:08.634095 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14283fb-fde5-4828-82ca-8f1b49e27674 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:08.634392 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14283fb-fde5-4828-82ca-8f1b49e27674 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:08.634839 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14283fb-fde5-4828-82ca-8f1b49e27674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:08.723647 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-b14283fb-fde5-4828-82ca-8f1b49e27674 None None] MFA Rules not processed for user `41b893bdf4ec474dbfa819c22fc29ce9`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:55:08.725459 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-b14283fb-fde5-4828-82ca-8f1b49e27674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:08.758421 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa40012-d5da-4594-9bac-7d6ed65acb18 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:08.769048 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a13ce8a-7cbc-4455-bf98-4ae829e23cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:08.771877 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a13ce8a-7cbc-4455-bf98-4ae829e23cc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:08.772309 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a13ce8a-7cbc-4455-bf98-4ae829e23cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:08.772690 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a13ce8a-7cbc-4455-bf98-4ae829e23cc0 admin admin] PATH_INFO: `/v3/projects/3b40a3330d8445dc89f4c2054bc2c91e/users/372fb5ec1bee4b4fbcb133a40b64375a/roles/95d753870f97426cb1ce32e078621a4c` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:08.812543 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a13ce8a-7cbc-4455-bf98-4ae829e23cc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b40a3330d8445dc89f4c2054bc2c91e, user_id=372fb5ec1bee4b4fbcb133a40b64375a, role_id=95d753870f97426cb1ce32e078621a4c)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:08.817203 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a13ce8a-7cbc-4455-bf98-4ae829e23cc0 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:08.859302 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 808/1614] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 17:55:08 2022] PUT /identity/v3/projects/3b40a3330d8445dc89f4c2054bc2c91e/users/372fb5ec1bee4b4fbcb133a40b64375a/roles/95d753870f97426cb1ce32e078621a4c => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:55:08.870051 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d7670-fa21-4f76-83d0-39d55299740f None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:08.872809 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d7670-fa21-4f76-83d0-39d55299740f None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:08.873891 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d7670-fa21-4f76-83d0-39d55299740f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:08.946838 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-839d7670-fa21-4f76-83d0-39d55299740f None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:55:08.949735 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-839d7670-fa21-4f76-83d0-39d55299740f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:08.967952 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 807/1615] 10.222.0.67 () {58 vars in 1058 bytes} [Thu Jul 14 17:55:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:55:08.969565 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aacbf6a-835c-4505-a441-1028695f65ec None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:08.969843 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aacbf6a-835c-4505-a441-1028695f65ec None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:08.970123 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aacbf6a-835c-4505-a441-1028695f65ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:09.004999 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-3aacbf6a-835c-4505-a441-1028695f65ec None None] MFA Rules not processed for user `41b893bdf4ec474dbfa819c22fc29ce9`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:55:09.006708 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-3aacbf6a-835c-4505-a441-1028695f65ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:09.054200 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:55:09.157247 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 809/1616] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:55:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:55:09.162085 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a62679b-26af-4487-b25d-20bf41178dfe None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:09.162377 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a62679b-26af-4487-b25d-20bf41178dfe None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:09.162660 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a62679b-26af-4487-b25d-20bf41178dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:09.190811 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 808/1617] 10.222.0.67 () {58 vars in 1058 bytes} [Thu Jul 14 17:55:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:55:09.191612 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aacbf6a-835c-4505-a441-1028695f65ec None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:09.201693 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-4a62679b-26af-4487-b25d-20bf41178dfe None None] MFA Rules not processed for user `372fb5ec1bee4b4fbcb133a40b64375a`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:55:09.203723 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-4a62679b-26af-4487-b25d-20bf41178dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:09.213992 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aacbf6a-835c-4505-a441-1028695f65ec None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:09.225935 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b7caa3-3424-4481-8f2b-4a87928304db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41b893bdf4ec474dbfa819c22fc29ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:09.228744 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b7caa3-3424-4481-8f2b-4a87928304db service nova] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:09.229336 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b7caa3-3424-4481-8f2b-4a87928304db service nova] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:09.229827 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b7caa3-3424-4481-8f2b-4a87928304db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:09.308762 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 810/1618] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:55:09 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:55:09.309956 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a62679b-26af-4487-b25d-20bf41178dfe None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:09.321737 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b7caa3-3424-4481-8f2b-4a87928304db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:09.324260 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b7caa3-3424-4481-8f2b-4a87928304db service nova] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:09.337592 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 809/1619] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:55:09 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:55:09.338434 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b7caa3-3424-4481-8f2b-4a87928304db service nova] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:09.350438 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b7caa3-3424-4481-8f2b-4a87928304db service nova] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:09.358008 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfca6d6f-fd8f-46c1-a571-3e4c08af56f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41b893bdf4ec474dbfa819c22fc29ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:09.358690 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca6d6f-fd8f-46c1-a571-3e4c08af56f7 service nova] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:09.358975 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca6d6f-fd8f-46c1-a571-3e4c08af56f7 service nova] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:09.359255 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca6d6f-fd8f-46c1-a571-3e4c08af56f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:09.372141 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:55:09.447072 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfca6d6f-fd8f-46c1-a571-3e4c08af56f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:09.449026 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfca6d6f-fd8f-46c1-a571-3e4c08af56f7 service nova] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:09.469928 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a62679b-26af-4487-b25d-20bf41178dfe None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:09.479513 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2458eaad-8d9a-4aa7-9349-6c1e2ab21627 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:09.481432 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2458eaad-8d9a-4aa7-9349-6c1e2ab21627 service neutron] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:09.482474 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2458eaad-8d9a-4aa7-9349-6c1e2ab21627 service neutron] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:09.482866 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2458eaad-8d9a-4aa7-9349-6c1e2ab21627 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:09.486284 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 810/1620] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:55:09 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:55:09.487356 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfca6d6f-fd8f-46c1-a571-3e4c08af56f7 service nova] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:09.511042 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfca6d6f-fd8f-46c1-a571-3e4c08af56f7 service nova] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:09.511835 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2458eaad-8d9a-4aa7-9349-6c1e2ab21627 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:09.517357 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2458eaad-8d9a-4aa7-9349-6c1e2ab21627 service neutron] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:09.528345 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a5d6f0-f493-4b14-9a06-352232114f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:09.529062 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a5d6f0-f493-4b14-9a06-352232114f22 admin admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:09.530072 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a5d6f0-f493-4b14-9a06-352232114f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:09.530375 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a5d6f0-f493-4b14-9a06-352232114f22 admin admin] PATH_INFO: `/v3/projects` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:09.531127 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a5d6f0-f493-4b14-9a06-352232114f22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:09.533425 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a5d6f0-f493-4b14-9a06-352232114f22 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:09.539727 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 811/1621] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:55:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:55:09.600177 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 811/1622] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 14 17:55:09 2022] POST /identity/v3/projects => generated 363 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:55:09.601788 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2458eaad-8d9a-4aa7-9349-6c1e2ab21627 service neutron] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:09.614089 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2458eaad-8d9a-4aa7-9349-6c1e2ab21627 service neutron] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:09.753716 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76850a07-fc82-4abb-8993-ac557107ad83 None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:09.753943 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76850a07-fc82-4abb-8993-ac557107ad83 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:09.754216 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76850a07-fc82-4abb-8993-ac557107ad83 None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:09.755590 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 812/1623] 10.222.0.67 () {54 vars in 912 bytes} [Thu Jul 14 17:55:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:55:09.761761 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ade675-1f4d-4079-a15d-6e657a208099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:09.764908 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ade675-1f4d-4079-a15d-6e657a208099 admin admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:09.765095 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ade675-1f4d-4079-a15d-6e657a208099 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:09.765370 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ade675-1f4d-4079-a15d-6e657a208099 admin admin] PATH_INFO: `/v3/users` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:09.766192 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ade675-1f4d-4079-a15d-6e657a208099 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:09.766405 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43096f10-b811-4f76-9231-cc631568e185 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:09.766675 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43096f10-b811-4f76-9231-cc631568e185 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:09.766933 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43096f10-b811-4f76-9231-cc631568e185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:09.782873 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ade675-1f4d-4079-a15d-6e657a208099 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:09.810748 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-43096f10-b811-4f76-9231-cc631568e185 None None] MFA Rules not processed for user `41b893bdf4ec474dbfa819c22fc29ce9`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:55:09.811990 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-43096f10-b811-4f76-9231-cc631568e185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:09.836587 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 812/1624] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 14 17:55:09 2022] POST /identity/v3/users => generated 288 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:55:09.839529 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ade675-1f4d-4079-a15d-6e657a208099 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:09.863557 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ade675-1f4d-4079-a15d-6e657a208099 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:09.876866 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:55:09.877089 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74761dc-61c4-44b8-a53d-0b3dda5cf20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:09.877907 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74761dc-61c4-44b8-a53d-0b3dda5cf20c admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:09.878198 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74761dc-61c4-44b8-a53d-0b3dda5cf20c admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:09.880811 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74761dc-61c4-44b8-a53d-0b3dda5cf20c admin admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:09.884402 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74761dc-61c4-44b8-a53d-0b3dda5cf20c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:09.889173 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74761dc-61c4-44b8-a53d-0b3dda5cf20c admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:09.919815 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 813/1625] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:55:09 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 17:55:09.922226 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74761dc-61c4-44b8-a53d-0b3dda5cf20c admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:09.951996 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74761dc-61c4-44b8-a53d-0b3dda5cf20c admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:09.969043 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43ab58d-e27f-49d1-9e47-7353766dcdcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:09.970520 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ab58d-e27f-49d1-9e47-7353766dcdcd admin admin] REQUEST_METHOD: `PUT` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:09.972410 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ab58d-e27f-49d1-9e47-7353766dcdcd admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:09.973030 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ab58d-e27f-49d1-9e47-7353766dcdcd admin admin] PATH_INFO: `/v3/projects/3bd5c5a94c2145f0837c686c4d9626c0/users/5dc272ea2a364f4e9db87319818bc457/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:09.990427 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 813/1626] 10.222.0.67 () {58 vars in 1009 bytes} [Thu Jul 14 17:55:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jul 14 17:55:10.000199 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa05094e-488b-444f-9d6d-120bf597f95e None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:10.000500 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa05094e-488b-444f-9d6d-120bf597f95e None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:10.000905 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa05094e-488b-444f-9d6d-120bf597f95e None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:10.015222 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 814/1627] 10.222.0.67 () {54 vars in 912 bytes} [Thu Jul 14 17:55:09 2022] GET /identity => generated 270 bytes in 24 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:55:10.016504 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa05094e-488b-444f-9d6d-120bf597f95e None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:10.016892 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43ab58d-e27f-49d1-9e47-7353766dcdcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bd5c5a94c2145f0837c686c4d9626c0, user_id=5dc272ea2a364f4e9db87319818bc457, role_id=4651a1cc7b4d4ab7a7a9ca1e77e58e71)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:10.021287 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43ab58d-e27f-49d1-9e47-7353766dcdcd admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:10.055462 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 814/1628] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 17:55:09 2022] PUT /identity/v3/projects/3bd5c5a94c2145f0837c686c4d9626c0/users/5dc272ea2a364f4e9db87319818bc457/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 17:55:10.056854 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d9b27f-b6f1-406c-8faa-c497d4826bfa None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:10.057203 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d9b27f-b6f1-406c-8faa-c497d4826bfa None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:10.057489 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d9b27f-b6f1-406c-8faa-c497d4826bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:10.108280 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-75d9b27f-b6f1-406c-8faa-c497d4826bfa None None] MFA Rules not processed for user `41b893bdf4ec474dbfa819c22fc29ce9`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:55:10.112021 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-75d9b27f-b6f1-406c-8faa-c497d4826bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:10.144022 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa05094e-488b-444f-9d6d-120bf597f95e None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:10.228771 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68abacc0-1dab-4837-bf11-c7152b12cc2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de55cae1600841889668e36402861203', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:10.229566 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68abacc0-1dab-4837-bf11-c7152b12cc2b service cinder] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:10.230219 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68abacc0-1dab-4837-bf11-c7152b12cc2b service cinder] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:10.230578 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68abacc0-1dab-4837-bf11-c7152b12cc2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:10.272383 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 815/1629] 10.222.0.67 () {58 vars in 1009 bytes} [Thu Jul 14 17:55:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:55:10.273260 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d9b27f-b6f1-406c-8faa-c497d4826bfa None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:10.284627 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:55:10.371073 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68abacc0-1dab-4837-bf11-c7152b12cc2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:10.372793 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68abacc0-1dab-4837-bf11-c7152b12cc2b service cinder] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:10.375607 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d9b27f-b6f1-406c-8faa-c497d4826bfa None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:10.381274 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9deb2cf-23d6-4052-9033-83070925af9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:10.382217 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9deb2cf-23d6-4052-9033-83070925af9b admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:10.382818 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9deb2cf-23d6-4052-9033-83070925af9b admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:10.383099 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9deb2cf-23d6-4052-9033-83070925af9b admin admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:10.385625 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9deb2cf-23d6-4052-9033-83070925af9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:10.387629 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9deb2cf-23d6-4052-9033-83070925af9b admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:10.394883 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 815/1630] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:55:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:55:10.395784 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68abacc0-1dab-4837-bf11-c7152b12cc2b service cinder] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:10.412046 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68abacc0-1dab-4837-bf11-c7152b12cc2b service cinder] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:10.418921 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c29c4e-41f3-4741-9543-6d950e66cb56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de55cae1600841889668e36402861203', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:10.420037 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c29c4e-41f3-4741-9543-6d950e66cb56 service cinder] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:10.420776 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c29c4e-41f3-4741-9543-6d950e66cb56 service cinder] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:10.421034 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c29c4e-41f3-4741-9543-6d950e66cb56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:10.424795 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 816/1631] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:55:10 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:55:10.426635 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9deb2cf-23d6-4052-9033-83070925af9b admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:10.444531 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c29c4e-41f3-4741-9543-6d950e66cb56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:10.451469 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c29c4e-41f3-4741-9543-6d950e66cb56 service cinder] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:10.459731 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9deb2cf-23d6-4052-9033-83070925af9b admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:10.474299 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058f5350-cb71-478c-967f-11f48f84db63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:10.475564 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058f5350-cb71-478c-967f-11f48f84db63 admin admin] REQUEST_METHOD: `PUT` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:10.475855 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058f5350-cb71-478c-967f-11f48f84db63 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:10.476137 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058f5350-cb71-478c-967f-11f48f84db63 admin admin] PATH_INFO: `/v3/projects/3bd5c5a94c2145f0837c686c4d9626c0/users/5dc272ea2a364f4e9db87319818bc457/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:10.483123 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058f5350-cb71-478c-967f-11f48f84db63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bd5c5a94c2145f0837c686c4d9626c0, user_id=5dc272ea2a364f4e9db87319818bc457, role_id=4651a1cc7b4d4ab7a7a9ca1e77e58e71)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:10.498239 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 816/1632] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:55:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:55:10.502875 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058f5350-cb71-478c-967f-11f48f84db63 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:10.551587 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 817/1633] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 17:55:10 2022] PUT /identity/v3/projects/3bd5c5a94c2145f0837c686c4d9626c0/users/5dc272ea2a364f4e9db87319818bc457/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:55:10.553825 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6797beeb-e264-4bd4-9452-b58ccf5646c6 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:10.554240 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6797beeb-e264-4bd4-9452-b58ccf5646c6 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:10.554733 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6797beeb-e264-4bd4-9452-b58ccf5646c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:10.563489 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:55:10.636327 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-6797beeb-e264-4bd4-9452-b58ccf5646c6 None None] MFA Rules not processed for user `5dc272ea2a364f4e9db87319818bc457`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:55:10.643902 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-6797beeb-e264-4bd4-9452-b58ccf5646c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:10.875764 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 817/1634] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:55:10 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:55:11.439706 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058f5350-cb71-478c-967f-11f48f84db63 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:11.596536 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058f5350-cb71-478c-967f-11f48f84db63 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:11.603693 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3079874-aca6-4192-b9d1-0e7238ce39c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de55cae1600841889668e36402861203', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:11.604379 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3079874-aca6-4192-b9d1-0e7238ce39c7 service cinder] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:11.604660 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3079874-aca6-4192-b9d1-0e7238ce39c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:11.604934 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3079874-aca6-4192-b9d1-0e7238ce39c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:11.639872 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3079874-aca6-4192-b9d1-0e7238ce39c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:11.643890 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3079874-aca6-4192-b9d1-0e7238ce39c7 service cinder] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:11.661036 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6797beeb-e264-4bd4-9452-b58ccf5646c6 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:11.687018 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 818/1635] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:55:11 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:55:11.899284 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6797beeb-e264-4bd4-9452-b58ccf5646c6 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:11.917117 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a934a5-5ff3-4395-8b40-9cd5146d59b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41b893bdf4ec474dbfa819c22fc29ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:11.918272 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a934a5-5ff3-4395-8b40-9cd5146d59b9 service nova] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:11.918951 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a934a5-5ff3-4395-8b40-9cd5146d59b9 service nova] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:11.919351 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a934a5-5ff3-4395-8b40-9cd5146d59b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:12.004276 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3079874-aca6-4192-b9d1-0e7238ce39c7 service cinder] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:12.018001 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3079874-aca6-4192-b9d1-0e7238ce39c7 service cinder] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:12.042036 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3599adbc-d8f8-4fe3-8dda-e2593c0b389d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de55cae1600841889668e36402861203', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:12.043962 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3599adbc-d8f8-4fe3-8dda-e2593c0b389d service cinder] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:12.049371 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3599adbc-d8f8-4fe3-8dda-e2593c0b389d service cinder] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:12.057673 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3599adbc-d8f8-4fe3-8dda-e2593c0b389d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:12.102198 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a934a5-5ff3-4395-8b40-9cd5146d59b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:12.107099 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a934a5-5ff3-4395-8b40-9cd5146d59b9 service nova] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:12.143446 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 818/1636] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:55:11 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:55:12.187427 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3599adbc-d8f8-4fe3-8dda-e2593c0b389d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:12.187427 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3599adbc-d8f8-4fe3-8dda-e2593c0b389d service cinder] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:12.237855 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 819/1637] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:55:11 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 17:55:12.547914 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a934a5-5ff3-4395-8b40-9cd5146d59b9 service nova] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:12.636624 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:55:12.719586 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a934a5-5ff3-4395-8b40-9cd5146d59b9 service nova] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:12.730944 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63e5d63-453f-4096-b080-6b459471051a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:12.731976 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e5d63-453f-4096-b080-6b459471051a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:12.732280 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e5d63-453f-4096-b080-6b459471051a admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:12.732591 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e5d63-453f-4096-b080-6b459471051a admin admin] PATH_INFO: `/v3/users/e8657a2ece214529ae946574fa183849` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:12.742581 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63e5d63-453f-4096-b080-6b459471051a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8657a2ece214529ae946574fa183849)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:12.743764 dv-cinder-849890-1-smb devstack@keystone.service[86773]: WARNING py.warnings [None req-d63e5d63-453f-4096-b080-6b459471051a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 17:55:12.743764 dv-cinder-849890-1-smb devstack@keystone.service[86773]: warnings.warn(msg) Jul 14 17:55:12.743764 dv-cinder-849890-1-smb devstack@keystone.service[86773]: Jul 14 17:55:12.744992 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63e5d63-453f-4096-b080-6b459471051a admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:12.890748 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-d63e5d63-453f-4096-b080-6b459471051a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8657a2ece214529ae946574fa183849'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:12.914308 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-d63e5d63-453f-4096-b080-6b459471051a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8657a2ece214529ae946574fa183849'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:12.936831 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-d63e5d63-453f-4096-b080-6b459471051a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8657a2ece214529ae946574fa183849'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:12.938468 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-d63e5d63-453f-4096-b080-6b459471051a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8657a2ece214529ae946574fa183849'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:12.939454 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-d63e5d63-453f-4096-b080-6b459471051a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8657a2ece214529ae946574fa183849'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:12.967489 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 819/1638] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 14 17:55:12 2022] DELETE /identity/v3/users/e8657a2ece214529ae946574fa183849 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:55:12.969086 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c75a1a4-7849-49fd-8c29-3d347ac0b318 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:12.969582 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c75a1a4-7849-49fd-8c29-3d347ac0b318 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:12.969718 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c75a1a4-7849-49fd-8c29-3d347ac0b318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:13.012810 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-3c75a1a4-7849-49fd-8c29-3d347ac0b318 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:55:13.014878 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-3c75a1a4-7849-49fd-8c29-3d347ac0b318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:13.108995 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:55:13.203185 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 820/1639] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:55:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 17:55:13.218487 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63e5d63-453f-4096-b080-6b459471051a admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:13.220046 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-d63e5d63-453f-4096-b080-6b459471051a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:13.378180 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63e5d63-453f-4096-b080-6b459471051a admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:13.392403 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bf7a07-1088-408e-b258-60568cfd8ca8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:13.393143 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bf7a07-1088-408e-b258-60568cfd8ca8 service neutron] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:13.393428 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bf7a07-1088-408e-b258-60568cfd8ca8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:13.393765 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bf7a07-1088-408e-b258-60568cfd8ca8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:13.418521 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bf7a07-1088-408e-b258-60568cfd8ca8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:13.420163 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bf7a07-1088-408e-b258-60568cfd8ca8 service neutron] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:13.445462 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 820/1640] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:55:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:55:15.761710 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c75a1a4-7849-49fd-8c29-3d347ac0b318 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:15.763950 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-3c75a1a4-7849-49fd-8c29-3d347ac0b318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:15.832645 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c75a1a4-7849-49fd-8c29-3d347ac0b318 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:15.850594 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bf7a07-1088-408e-b258-60568cfd8ca8 service neutron] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:15.853034 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-34bf7a07-1088-408e-b258-60568cfd8ca8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:15.876744 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e0115f-7aa5-4989-b46f-dad6bc776aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:15.881922 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bf7a07-1088-408e-b258-60568cfd8ca8 service neutron] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:15.883506 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e0115f-7aa5-4989-b46f-dad6bc776aa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:15.885342 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e0115f-7aa5-4989-b46f-dad6bc776aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:15.885701 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e0115f-7aa5-4989-b46f-dad6bc776aa7 admin admin] PATH_INFO: `/v3/projects/713638d1d7e14911bff5a08a9f8c39a2` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:15.888855 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e0115f-7aa5-4989-b46f-dad6bc776aa7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=713638d1d7e14911bff5a08a9f8c39a2)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:15.890224 dv-cinder-849890-1-smb devstack@keystone.service[86772]: WARNING py.warnings [None req-70e0115f-7aa5-4989-b46f-dad6bc776aa7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 17:55:15.890224 dv-cinder-849890-1-smb devstack@keystone.service[86772]: warnings.warn(msg) Jul 14 17:55:15.890224 dv-cinder-849890-1-smb devstack@keystone.service[86772]: Jul 14 17:55:15.891434 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e0115f-7aa5-4989-b46f-dad6bc776aa7 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:15.892145 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f597133-0735-4bbf-b12b-b83f64b6f92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:15.903802 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f597133-0735-4bbf-b12b-b83f64b6f92b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:15.904371 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f597133-0735-4bbf-b12b-b83f64b6f92b admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:15.904815 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f597133-0735-4bbf-b12b-b83f64b6f92b admin admin] PATH_INFO: `/v3/users/4c84f6acbaed471ea84a82eacb1342e5` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:15.906549 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f597133-0735-4bbf-b12b-b83f64b6f92b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c84f6acbaed471ea84a82eacb1342e5)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:15.908949 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f597133-0735-4bbf-b12b-b83f64b6f92b admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:16.032612 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:55:16.051160 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-1f597133-0735-4bbf-b12b-b83f64b6f92b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c84f6acbaed471ea84a82eacb1342e5'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:16.079633 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-1f597133-0735-4bbf-b12b-b83f64b6f92b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c84f6acbaed471ea84a82eacb1342e5'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:16.134896 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-1f597133-0735-4bbf-b12b-b83f64b6f92b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c84f6acbaed471ea84a82eacb1342e5'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:16.135908 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-1f597133-0735-4bbf-b12b-b83f64b6f92b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c84f6acbaed471ea84a82eacb1342e5'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:16.137358 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-1f597133-0735-4bbf-b12b-b83f64b6f92b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c84f6acbaed471ea84a82eacb1342e5'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:16.145154 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-70e0115f-7aa5-4989-b46f-dad6bc776aa7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '713638d1d7e14911bff5a08a9f8c39a2', 'request_id': 'req-70e0115f-7aa5-4989-b46f-dad6bc776aa7'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:16.160461 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-70e0115f-7aa5-4989-b46f-dad6bc776aa7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '713638d1d7e14911bff5a08a9f8c39a2', 'request_id': 'req-70e0115f-7aa5-4989-b46f-dad6bc776aa7'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:16.171469 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 821/1641] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 14 17:55:15 2022] DELETE /identity/v3/users/4c84f6acbaed471ea84a82eacb1342e5 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 17:55:16.177262 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec9ffe6-fb5b-4c47-b416-1115f1e37b5f None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:16.177677 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec9ffe6-fb5b-4c47-b416-1115f1e37b5f None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:16.177805 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-70e0115f-7aa5-4989-b46f-dad6bc776aa7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '713638d1d7e14911bff5a08a9f8c39a2', 'request_id': 'req-70e0115f-7aa5-4989-b46f-dad6bc776aa7'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:16.178302 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec9ffe6-fb5b-4c47-b416-1115f1e37b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:16.225822 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-70e0115f-7aa5-4989-b46f-dad6bc776aa7 admin admin] The token cache is being invalidate because project 713638d1d7e14911bff5a08a9f8c39a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86772) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 17:55:16.226113 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-70e0115f-7aa5-4989-b46f-dad6bc776aa7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:16.227557 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-aec9ffe6-fb5b-4c47-b416-1115f1e37b5f None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:55:16.229074 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-aec9ffe6-fb5b-4c47-b416-1115f1e37b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:16.229642 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-70e0115f-7aa5-4989-b46f-dad6bc776aa7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:16.248104 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 821/1642] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 14 17:55:15 2022] DELETE /identity/v3/projects/713638d1d7e14911bff5a08a9f8c39a2 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:55:16.252553 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc853e8-5cf1-4fc4-92d9-f7fb0a742b53 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:16.257849 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc853e8-5cf1-4fc4-92d9-f7fb0a742b53 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:16.259765 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc853e8-5cf1-4fc4-92d9-f7fb0a742b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:16.342157 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-fdc853e8-5cf1-4fc4-92d9-f7fb0a742b53 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:55:16.349029 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-fdc853e8-5cf1-4fc4-92d9-f7fb0a742b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:16.465735 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 822/1643] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:55:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 17:55:16.515043 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 822/1644] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:55:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:55:16.522515 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc64a330-0691-476c-9286-30114aa74a11 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:16.523060 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc64a330-0691-476c-9286-30114aa74a11 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:16.523336 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc64a330-0691-476c-9286-30114aa74a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:16.544956 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-cc64a330-0691-476c-9286-30114aa74a11 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:55:16.546544 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-cc64a330-0691-476c-9286-30114aa74a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:16.558029 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 823/1645] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:55:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:55:16.563158 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc853e8-5cf1-4fc4-92d9-f7fb0a742b53 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:16.575060 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc853e8-5cf1-4fc4-92d9-f7fb0a742b53 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:16.585471 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2645d941-071a-42f1-bf47-47848fe2ec0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:16.587974 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2645d941-071a-42f1-bf47-47848fe2ec0e admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:16.588118 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2645d941-071a-42f1-bf47-47848fe2ec0e admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:16.589198 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2645d941-071a-42f1-bf47-47848fe2ec0e admin admin] PATH_INFO: `/v3/domains` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:16.589198 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2645d941-071a-42f1-bf47-47848fe2ec0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:55:16.589441 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2645d941-071a-42f1-bf47-47848fe2ec0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:16.591131 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2645d941-071a-42f1-bf47-47848fe2ec0e admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:16.619078 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc64a330-0691-476c-9286-30114aa74a11 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:16.639477 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc64a330-0691-476c-9286-30114aa74a11 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:16.640462 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 823/1646] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 14 17:55:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:55:16.661607 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c25b1f8-1c99-4f54-ad5b-bedf7ffbcff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:16.662321 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c25b1f8-1c99-4f54-ad5b-bedf7ffbcff4 admin admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:16.662623 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c25b1f8-1c99-4f54-ad5b-bedf7ffbcff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:16.662906 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c25b1f8-1c99-4f54-ad5b-bedf7ffbcff4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:16.663817 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c25b1f8-1c99-4f54-ad5b-bedf7ffbcff4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:16.667564 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c25b1f8-1c99-4f54-ad5b-bedf7ffbcff4 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:16.735402 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 824/1647] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 14 17:55:16 2022] POST /identity/v3/projects => generated 387 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:55:16.737643 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2645d941-071a-42f1-bf47-47848fe2ec0e admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:16.754963 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2645d941-071a-42f1-bf47-47848fe2ec0e admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:16.847297 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c25b1f8-1c99-4f54-ad5b-bedf7ffbcff4 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:16.851624 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-3c25b1f8-1c99-4f54-ad5b-bedf7ffbcff4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:16.896565 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:55:16.951337 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e95fb46-db25-43d8-84c9-eb60991abccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:16.952119 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e95fb46-db25-43d8-84c9-eb60991abccd admin admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:16.952583 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e95fb46-db25-43d8-84c9-eb60991abccd admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:16.953015 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e95fb46-db25-43d8-84c9-eb60991abccd admin admin] PATH_INFO: `/v3/users` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:16.954177 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e95fb46-db25-43d8-84c9-eb60991abccd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:16.956865 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e95fb46-db25-43d8-84c9-eb60991abccd admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:17.017922 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 824/1648] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 14 17:55:16 2022] POST /identity/v3/users => generated 294 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:55:17.021655 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e95fb46-db25-43d8-84c9-eb60991abccd admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:17.038875 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e95fb46-db25-43d8-84c9-eb60991abccd admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:17.039191 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c25b1f8-1c99-4f54-ad5b-bedf7ffbcff4 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:17.055326 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271537be-602d-440a-8a2f-12d56483c6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:17.056321 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beaf03c-84fe-4578-959b-660bd1f5edb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:17.058122 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271537be-602d-440a-8a2f-12d56483c6d8 admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:17.058416 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271537be-602d-440a-8a2f-12d56483c6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:17.058701 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271537be-602d-440a-8a2f-12d56483c6d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:17.061027 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beaf03c-84fe-4578-959b-660bd1f5edb6 service neutron] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:17.061601 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271537be-602d-440a-8a2f-12d56483c6d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:17.063452 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271537be-602d-440a-8a2f-12d56483c6d8 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:17.077712 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beaf03c-84fe-4578-959b-660bd1f5edb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:17.078249 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beaf03c-84fe-4578-959b-660bd1f5edb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:17.090779 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 825/1649] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:55:17 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:55:17.095051 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271537be-602d-440a-8a2f-12d56483c6d8 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:17.115463 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271537be-602d-440a-8a2f-12d56483c6d8 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:17.123430 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beaf03c-84fe-4578-959b-660bd1f5edb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:17.124929 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beaf03c-84fe-4578-959b-660bd1f5edb6 service neutron] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:17.131280 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6b277c-c0fb-4b5a-bd9a-8572e3e1f55c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:17.135268 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6b277c-c0fb-4b5a-bd9a-8572e3e1f55c admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:17.137662 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6b277c-c0fb-4b5a-bd9a-8572e3e1f55c admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:17.138341 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6b277c-c0fb-4b5a-bd9a-8572e3e1f55c admin admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:17.140238 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6b277c-c0fb-4b5a-bd9a-8572e3e1f55c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:17.147999 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6b277c-c0fb-4b5a-bd9a-8572e3e1f55c admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:17.173965 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 825/1650] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:55:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 17:55:17.177064 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 826/1651] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:55:17 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:55:17.181602 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beaf03c-84fe-4578-959b-660bd1f5edb6 service neutron] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:17.226749 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beaf03c-84fe-4578-959b-660bd1f5edb6 service neutron] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:17.236529 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7e5dc0-df18-4b20-a411-0a5496211571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:17.238259 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e5dc0-df18-4b20-a411-0a5496211571 admin admin] REQUEST_METHOD: `PUT` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:17.238709 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e5dc0-df18-4b20-a411-0a5496211571 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:17.239138 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e5dc0-df18-4b20-a411-0a5496211571 admin admin] PATH_INFO: `/v3/projects/643148ded2b84ada91874576426ba477/users/8798c9005fa048d9aaf5196542cdc44d/roles/95d753870f97426cb1ce32e078621a4c` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:17.274045 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7e5dc0-df18-4b20-a411-0a5496211571 admin admin] RBAC: Authorizing `identity:create_grant(project_id=643148ded2b84ada91874576426ba477, user_id=8798c9005fa048d9aaf5196542cdc44d, role_id=95d753870f97426cb1ce32e078621a4c)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:17.284197 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7e5dc0-df18-4b20-a411-0a5496211571 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:17.357195 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 826/1652] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 17:55:17 2022] PUT /identity/v3/projects/643148ded2b84ada91874576426ba477/users/8798c9005fa048d9aaf5196542cdc44d/roles/95d753870f97426cb1ce32e078621a4c => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:55:17.359629 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4deb00b-0a85-45ec-8773-2e22afca8dbb None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:17.360142 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4deb00b-0a85-45ec-8773-2e22afca8dbb None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:17.360563 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4deb00b-0a85-45ec-8773-2e22afca8dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:17.438833 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-b4deb00b-0a85-45ec-8773-2e22afca8dbb None None] MFA Rules not processed for user `8798c9005fa048d9aaf5196542cdc44d`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:55:17.440691 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-b4deb00b-0a85-45ec-8773-2e22afca8dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:17.731226 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 827/1653] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:55:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:55:17.733584 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7e5dc0-df18-4b20-a411-0a5496211571 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:17.755308 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:55:17.979326 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7e5dc0-df18-4b20-a411-0a5496211571 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:17.995703 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d94f3e-976b-457e-84d2-1b901087dfa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:17.996664 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d94f3e-976b-457e-84d2-1b901087dfa4 admin admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:17.997101 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d94f3e-976b-457e-84d2-1b901087dfa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:17.997572 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d94f3e-976b-457e-84d2-1b901087dfa4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:17.998444 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d94f3e-976b-457e-84d2-1b901087dfa4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:18.001418 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d94f3e-976b-457e-84d2-1b901087dfa4 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:18.067155 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 827/1654] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 14 17:55:17 2022] POST /identity/v3/projects => generated 387 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 17:55:18.071964 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4deb00b-0a85-45ec-8773-2e22afca8dbb None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:18.102147 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4deb00b-0a85-45ec-8773-2e22afca8dbb None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:18.301090 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad16394-8005-4a8e-b3ee-2f9301547243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:18.302304 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad16394-8005-4a8e-b3ee-2f9301547243 admin admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:18.302602 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad16394-8005-4a8e-b3ee-2f9301547243 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:18.302884 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad16394-8005-4a8e-b3ee-2f9301547243 admin admin] PATH_INFO: `/v3/users` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:18.303588 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad16394-8005-4a8e-b3ee-2f9301547243 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:18.307877 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad16394-8005-4a8e-b3ee-2f9301547243 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:18.359927 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d94f3e-976b-457e-84d2-1b901087dfa4 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:18.366890 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 828/1655] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 14 17:55:18 2022] POST /identity/v3/users => generated 300 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:55:18.384504 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d94f3e-976b-457e-84d2-1b901087dfa4 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:18.398068 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e2468a-7143-459b-9d6b-2705d293b59f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:18.401557 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e2468a-7143-459b-9d6b-2705d293b59f admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:18.404022 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e2468a-7143-459b-9d6b-2705d293b59f admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:18.404471 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e2468a-7143-459b-9d6b-2705d293b59f admin admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:18.405428 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e2468a-7143-459b-9d6b-2705d293b59f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:18.407702 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e2468a-7143-459b-9d6b-2705d293b59f admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:18.465096 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad16394-8005-4a8e-b3ee-2f9301547243 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:18.469440 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 828/1656] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:55:18 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:55:18.469440 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e2468a-7143-459b-9d6b-2705d293b59f admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:18.485805 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-72e2468a-7143-459b-9d6b-2705d293b59f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:18.486866 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad16394-8005-4a8e-b3ee-2f9301547243 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:18.531376 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37c019b-17e1-41cb-b59f-8c830ba8de59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:18.531376 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37c019b-17e1-41cb-b59f-8c830ba8de59 admin admin] REQUEST_METHOD: `PUT` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:18.531376 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37c019b-17e1-41cb-b59f-8c830ba8de59 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:18.531376 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37c019b-17e1-41cb-b59f-8c830ba8de59 admin admin] PATH_INFO: `/v3/projects/833210b6d93044f098184fad64abdeaa/users/d97e3df37d964f7cbed9e61bebc8042b/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:18.539434 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e2468a-7143-459b-9d6b-2705d293b59f admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:18.550274 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b81f1e-4df1-4e34-a680-ba5f6c68eb27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:18.550882 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b81f1e-4df1-4e34-a680-ba5f6c68eb27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:18.551165 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b81f1e-4df1-4e34-a680-ba5f6c68eb27 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:18.551473 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b81f1e-4df1-4e34-a680-ba5f6c68eb27 admin admin] PATH_INFO: `/v3/users/f3d7c4031bc34814bb4f0a5a78dc4ad1` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:18.553699 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b81f1e-4df1-4e34-a680-ba5f6c68eb27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3d7c4031bc34814bb4f0a5a78dc4ad1)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:18.557517 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b81f1e-4df1-4e34-a680-ba5f6c68eb27 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:18.562074 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37c019b-17e1-41cb-b59f-8c830ba8de59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=833210b6d93044f098184fad64abdeaa, user_id=d97e3df37d964f7cbed9e61bebc8042b, role_id=4651a1cc7b4d4ab7a7a9ca1e77e58e71)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:18.566383 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37c019b-17e1-41cb-b59f-8c830ba8de59 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:18.607460 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 829/1657] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 17:55:18 2022] PUT /identity/v3/projects/833210b6d93044f098184fad64abdeaa/users/d97e3df37d964f7cbed9e61bebc8042b/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:55:18.612190 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37c019b-17e1-41cb-b59f-8c830ba8de59 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:18.627544 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:55:18.717838 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-25b81f1e-4df1-4e34-a680-ba5f6c68eb27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3d7c4031bc34814bb4f0a5a78dc4ad1'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:18.742475 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-25b81f1e-4df1-4e34-a680-ba5f6c68eb27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3d7c4031bc34814bb4f0a5a78dc4ad1'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:18.774049 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-25b81f1e-4df1-4e34-a680-ba5f6c68eb27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3d7c4031bc34814bb4f0a5a78dc4ad1'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:18.775710 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-25b81f1e-4df1-4e34-a680-ba5f6c68eb27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3d7c4031bc34814bb4f0a5a78dc4ad1'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:18.777445 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-25b81f1e-4df1-4e34-a680-ba5f6c68eb27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3d7c4031bc34814bb4f0a5a78dc4ad1'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:18.817159 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 829/1658] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 14 17:55:18 2022] DELETE /identity/v3/users/f3d7c4031bc34814bb4f0a5a78dc4ad1 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:55:18.817503 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37c019b-17e1-41cb-b59f-8c830ba8de59 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:18.819442 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c370c-682d-4c6a-a1ee-35a1328f0466 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:18.819782 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c370c-682d-4c6a-a1ee-35a1328f0466 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:18.820149 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c370c-682d-4c6a-a1ee-35a1328f0466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:18.860543 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-7e8c370c-682d-4c6a-a1ee-35a1328f0466 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:55:18.862874 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-7e8c370c-682d-4c6a-a1ee-35a1328f0466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:19.007218 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dc81f9-b42a-401d-be96-21fb0bb67037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:19.008468 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc81f9-b42a-401d-be96-21fb0bb67037 admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:19.011164 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc81f9-b42a-401d-be96-21fb0bb67037 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:19.011672 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc81f9-b42a-401d-be96-21fb0bb67037 admin admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:19.015355 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dc81f9-b42a-401d-be96-21fb0bb67037 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:19.022749 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dc81f9-b42a-401d-be96-21fb0bb67037 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:19.036112 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:55:19.050180 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 830/1659] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:55:18 2022] GET /identity/v3/roles => generated 1420 bytes in 436 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:55:19.052202 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dc81f9-b42a-401d-be96-21fb0bb67037 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:19.055107 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-43dc81f9-b42a-401d-be96-21fb0bb67037 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:19.081748 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 830/1660] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:55:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:55:19.083126 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5c2c10-3b0f-4a84-a867-3f070dd221e8 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:19.083419 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5c2c10-3b0f-4a84-a867-3f070dd221e8 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:19.083698 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5c2c10-3b0f-4a84-a867-3f070dd221e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:19.109222 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dc81f9-b42a-401d-be96-21fb0bb67037 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:19.128297 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a3bc2c-9797-42a2-9d41-80b89f08da73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:19.129905 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a3bc2c-9797-42a2-9d41-80b89f08da73 admin admin] REQUEST_METHOD: `PUT` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:19.130199 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a3bc2c-9797-42a2-9d41-80b89f08da73 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:19.130482 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a3bc2c-9797-42a2-9d41-80b89f08da73 admin admin] PATH_INFO: `/v3/projects/833210b6d93044f098184fad64abdeaa/users/d97e3df37d964f7cbed9e61bebc8042b/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:19.136534 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a3bc2c-9797-42a2-9d41-80b89f08da73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=833210b6d93044f098184fad64abdeaa, user_id=d97e3df37d964f7cbed9e61bebc8042b, role_id=4651a1cc7b4d4ab7a7a9ca1e77e58e71)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:19.139356 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a3bc2c-9797-42a2-9d41-80b89f08da73 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:19.163964 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-8d5c2c10-3b0f-4a84-a867-3f070dd221e8 None None] MFA Rules not processed for user `dc2eceb8989543d4bdbbcd706ddbe676`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:55:19.178667 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 831/1661] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 17:55:19 2022] PUT /identity/v3/projects/833210b6d93044f098184fad64abdeaa/users/d97e3df37d964f7cbed9e61bebc8042b/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 17:55:19.178882 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-8d5c2c10-3b0f-4a84-a867-3f070dd221e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:19.181749 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc2ef3-0965-4557-b715-5e401b4a43bf None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:19.182200 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc2ef3-0965-4557-b715-5e401b4a43bf None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:19.182529 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc2ef3-0965-4557-b715-5e401b4a43bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:19.247747 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-c2dc2ef3-0965-4557-b715-5e401b4a43bf None None] MFA Rules not processed for user `d97e3df37d964f7cbed9e61bebc8042b`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:55:19.251538 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-c2dc2ef3-0965-4557-b715-5e401b4a43bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:19.380300 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 831/1662] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:55:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:55:19.381381 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5c2c10-3b0f-4a84-a867-3f070dd221e8 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:19.382868 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-8d5c2c10-3b0f-4a84-a867-3f070dd221e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:19.464779 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 832/1663] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:55:19 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:55:19.467947 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5c2c10-3b0f-4a84-a867-3f070dd221e8 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:19.469575 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dc2ef3-0965-4557-b715-5e401b4a43bf None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:19.478296 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-c2dc2ef3-0965-4557-b715-5e401b4a43bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:19.483974 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4994beba-f19d-4126-8fc8-5999c3e4e145 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:19.484388 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4994beba-f19d-4126-8fc8-5999c3e4e145 service neutron] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:19.484658 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4994beba-f19d-4126-8fc8-5999c3e4e145 service neutron] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:19.484940 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4994beba-f19d-4126-8fc8-5999c3e4e145 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:19.544414 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:55:19.568308 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4994beba-f19d-4126-8fc8-5999c3e4e145 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:19.572447 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4994beba-f19d-4126-8fc8-5999c3e4e145 service neutron] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:19.583974 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 832/1664] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:55:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:55:19.584876 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4994beba-f19d-4126-8fc8-5999c3e4e145 service neutron] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:19.587399 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-4994beba-f19d-4126-8fc8-5999c3e4e145 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:19.654955 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:55:19.680784 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4994beba-f19d-4126-8fc8-5999c3e4e145 service neutron] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:19.689681 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52e39a2-ea1e-4a31-8028-d76ac0fde85e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de55cae1600841889668e36402861203', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:19.691125 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e39a2-ea1e-4a31-8028-d76ac0fde85e service cinder] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:19.691675 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e39a2-ea1e-4a31-8028-d76ac0fde85e service cinder] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:19.693355 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e39a2-ea1e-4a31-8028-d76ac0fde85e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:19.710351 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52e39a2-ea1e-4a31-8028-d76ac0fde85e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:19.713299 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52e39a2-ea1e-4a31-8028-d76ac0fde85e service cinder] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:19.743313 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dc2ef3-0965-4557-b715-5e401b4a43bf None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:19.750901 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 833/1665] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:55:19 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:55:19.751891 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52e39a2-ea1e-4a31-8028-d76ac0fde85e service cinder] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:19.756677 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-f52e39a2-ea1e-4a31-8028-d76ac0fde85e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:19.764480 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2c96bf-4fe8-4e26-b8df-d1b1d2d8739b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41b893bdf4ec474dbfa819c22fc29ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:19.768634 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c96bf-4fe8-4e26-b8df-d1b1d2d8739b service nova] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:19.769591 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c96bf-4fe8-4e26-b8df-d1b1d2d8739b service nova] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:19.772504 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c96bf-4fe8-4e26-b8df-d1b1d2d8739b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:19.804001 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2c96bf-4fe8-4e26-b8df-d1b1d2d8739b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:19.805915 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2c96bf-4fe8-4e26-b8df-d1b1d2d8739b service nova] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:19.825246 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 833/1666] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:55:19 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:55:19.829718 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52e39a2-ea1e-4a31-8028-d76ac0fde85e service cinder] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:19.836168 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c46f251-cff4-49a4-b067-e0368a813ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:19.838611 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c46f251-cff4-49a4-b067-e0368a813ac3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:19.839025 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c46f251-cff4-49a4-b067-e0368a813ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:19.839315 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c46f251-cff4-49a4-b067-e0368a813ac3 admin admin] PATH_INFO: `/v3/projects/5dbcbe1f42664e898abc29a32ce8b8d6` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:19.840897 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c46f251-cff4-49a4-b067-e0368a813ac3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5dbcbe1f42664e898abc29a32ce8b8d6)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:19.843968 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c46f251-cff4-49a4-b067-e0368a813ac3 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:19.907328 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2c96bf-4fe8-4e26-b8df-d1b1d2d8739b service nova] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:19.926039 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2c96bf-4fe8-4e26-b8df-d1b1d2d8739b service nova] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:19.936556 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9c3fe2-f3b2-466b-8cc9-1984e71baef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:19.937922 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9c3fe2-f3b2-466b-8cc9-1984e71baef3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:19.938312 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9c3fe2-f3b2-466b-8cc9-1984e71baef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:19.938696 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9c3fe2-f3b2-466b-8cc9-1984e71baef3 admin admin] PATH_INFO: `/v3/users/8798c9005fa048d9aaf5196542cdc44d` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:19.943726 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9c3fe2-f3b2-466b-8cc9-1984e71baef3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8798c9005fa048d9aaf5196542cdc44d)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:19.945860 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9c3fe2-f3b2-466b-8cc9-1984e71baef3 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:20.049986 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-6c46f251-cff4-49a4-b067-e0368a813ac3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5dbcbe1f42664e898abc29a32ce8b8d6', 'request_id': 'req-6c46f251-cff4-49a4-b067-e0368a813ac3'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:20.058052 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-5c9c3fe2-f3b2-466b-8cc9-1984e71baef3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8798c9005fa048d9aaf5196542cdc44d'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:20.082484 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-5c9c3fe2-f3b2-466b-8cc9-1984e71baef3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8798c9005fa048d9aaf5196542cdc44d'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:20.085850 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-6c46f251-cff4-49a4-b067-e0368a813ac3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5dbcbe1f42664e898abc29a32ce8b8d6', 'request_id': 'req-6c46f251-cff4-49a4-b067-e0368a813ac3'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:20.095922 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-5c9c3fe2-f3b2-466b-8cc9-1984e71baef3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8798c9005fa048d9aaf5196542cdc44d'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:20.096916 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-5c9c3fe2-f3b2-466b-8cc9-1984e71baef3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8798c9005fa048d9aaf5196542cdc44d'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:20.130304 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-5c9c3fe2-f3b2-466b-8cc9-1984e71baef3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8798c9005fa048d9aaf5196542cdc44d'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:20.133002 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-6c46f251-cff4-49a4-b067-e0368a813ac3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5dbcbe1f42664e898abc29a32ce8b8d6', 'request_id': 'req-6c46f251-cff4-49a4-b067-e0368a813ac3'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:20.147621 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 834/1667] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 14 17:55:19 2022] DELETE /identity/v3/users/8798c9005fa048d9aaf5196542cdc44d => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 17:55:20.156126 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3420b40e-7190-4c11-8d63-56334a584c69 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:20.157846 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3420b40e-7190-4c11-8d63-56334a584c69 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:20.158285 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3420b40e-7190-4c11-8d63-56334a584c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:20.189839 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-6c46f251-cff4-49a4-b067-e0368a813ac3 admin admin] The token cache is being invalidate because project 5dbcbe1f42664e898abc29a32ce8b8d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86773) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 17:55:20.190134 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-6c46f251-cff4-49a4-b067-e0368a813ac3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:20.195251 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-6c46f251-cff4-49a4-b067-e0368a813ac3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:20.202290 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 834/1668] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 14 17:55:19 2022] DELETE /identity/v3/projects/5dbcbe1f42664e898abc29a32ce8b8d6 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:55:20.210739 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39928dc-748f-4ff8-980d-77f57ec4f759 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:20.211073 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39928dc-748f-4ff8-980d-77f57ec4f759 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:20.213776 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39928dc-748f-4ff8-980d-77f57ec4f759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:20.219294 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-3420b40e-7190-4c11-8d63-56334a584c69 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:55:20.230133 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-3420b40e-7190-4c11-8d63-56334a584c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:20.293552 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-f39928dc-748f-4ff8-980d-77f57ec4f759 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:55:20.299808 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-f39928dc-748f-4ff8-980d-77f57ec4f759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:20.401275 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 835/1669] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:55:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:55:20.453998 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3420b40e-7190-4c11-8d63-56334a584c69 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:20.458750 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-3420b40e-7190-4c11-8d63-56334a584c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:20.500946 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:55:20.582682 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3420b40e-7190-4c11-8d63-56334a584c69 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:20.594319 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86e6759-2991-4bcf-aa05-9c4f4e4ae573 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:20.595181 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e6759-2991-4bcf-aa05-9c4f4e4ae573 service neutron] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:20.595542 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e6759-2991-4bcf-aa05-9c4f4e4ae573 service neutron] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:20.595929 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e6759-2991-4bcf-aa05-9c4f4e4ae573 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:20.616954 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 835/1670] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:55:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 410 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:55:20.625641 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3262801-9b3c-4243-88f4-1b18c3feb4f3 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:20.625934 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3262801-9b3c-4243-88f4-1b18c3feb4f3 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:20.626173 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86e6759-2991-4bcf-aa05-9c4f4e4ae573 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:20.626291 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3262801-9b3c-4243-88f4-1b18c3feb4f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:20.627826 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86e6759-2991-4bcf-aa05-9c4f4e4ae573 service neutron] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:20.638979 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 836/1671] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:55:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:55:20.653092 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-d3262801-9b3c-4243-88f4-1b18c3feb4f3 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:55:20.654742 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-d3262801-9b3c-4243-88f4-1b18c3feb4f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:20.663766 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 836/1672] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:55:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:55:20.669354 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86e6759-2991-4bcf-aa05-9c4f4e4ae573 service neutron] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:20.681902 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86e6759-2991-4bcf-aa05-9c4f4e4ae573 service neutron] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:20.688592 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b59fdf3-474d-4e06-9057-910f1f7efe38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:20.690025 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b59fdf3-474d-4e06-9057-910f1f7efe38 admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:20.690500 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b59fdf3-474d-4e06-9057-910f1f7efe38 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:20.690983 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b59fdf3-474d-4e06-9057-910f1f7efe38 admin admin] PATH_INFO: `/v3/domains` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:20.692717 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b59fdf3-474d-4e06-9057-910f1f7efe38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:55:20.693181 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b59fdf3-474d-4e06-9057-910f1f7efe38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:20.695245 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b59fdf3-474d-4e06-9057-910f1f7efe38 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:20.717963 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3262801-9b3c-4243-88f4-1b18c3feb4f3 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:20.723572 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 837/1673] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 14 17:55:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:55:20.733376 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3262801-9b3c-4243-88f4-1b18c3feb4f3 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:20.739434 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7202b85e-8add-447b-8e0d-1eed2b904ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:20.740219 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7202b85e-8add-447b-8e0d-1eed2b904ab4 admin admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:20.740511 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7202b85e-8add-447b-8e0d-1eed2b904ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:20.740844 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7202b85e-8add-447b-8e0d-1eed2b904ab4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:20.742216 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7202b85e-8add-447b-8e0d-1eed2b904ab4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:20.744323 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7202b85e-8add-447b-8e0d-1eed2b904ab4 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:20.809061 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 837/1674] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 14 17:55:20 2022] POST /identity/v3/projects => generated 367 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:55:20.812883 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b59fdf3-474d-4e06-9057-910f1f7efe38 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:20.828347 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b59fdf3-474d-4e06-9057-910f1f7efe38 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:20.934560 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7202b85e-8add-447b-8e0d-1eed2b904ab4 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:20.936317 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-7202b85e-8add-447b-8e0d-1eed2b904ab4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:20.980003 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321c80db-34d5-4e26-a0cf-64fb9b3a0bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:20.982279 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c80db-34d5-4e26-a0cf-64fb9b3a0bae admin admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:20.982909 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c80db-34d5-4e26-a0cf-64fb9b3a0bae admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:20.983419 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c80db-34d5-4e26-a0cf-64fb9b3a0bae admin admin] PATH_INFO: `/v3/users` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:20.984536 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321c80db-34d5-4e26-a0cf-64fb9b3a0bae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:20.988518 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321c80db-34d5-4e26-a0cf-64fb9b3a0bae admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:21.015908 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:55:21.027432 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 838/1675] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 14 17:55:20 2022] POST /identity/v3/users => generated 284 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 17:55:21.031590 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321c80db-34d5-4e26-a0cf-64fb9b3a0bae admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:21.047262 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321c80db-34d5-4e26-a0cf-64fb9b3a0bae admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:21.057173 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a01199-b8af-4ddf-be9b-aebf0f3123e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:21.058275 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a01199-b8af-4ddf-be9b-aebf0f3123e3 admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:21.058813 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a01199-b8af-4ddf-be9b-aebf0f3123e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:21.059201 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a01199-b8af-4ddf-be9b-aebf0f3123e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:21.060325 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a01199-b8af-4ddf-be9b-aebf0f3123e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:21.063037 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a01199-b8af-4ddf-be9b-aebf0f3123e3 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:21.081252 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 839/1676] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:55:21 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:55:21.086067 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a01199-b8af-4ddf-be9b-aebf0f3123e3 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:21.086707 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7202b85e-8add-447b-8e0d-1eed2b904ab4 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:21.098188 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9046581-447d-4460-a06a-23468e6bb04a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:21.100840 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9046581-447d-4460-a06a-23468e6bb04a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:21.104954 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9046581-447d-4460-a06a-23468e6bb04a admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:21.105449 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9046581-447d-4460-a06a-23468e6bb04a admin admin] PATH_INFO: `/v3/projects/9f95d535e3a34fe78406efd7512b87ef` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:21.107581 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9046581-447d-4460-a06a-23468e6bb04a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f95d535e3a34fe78406efd7512b87ef)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:21.111806 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9046581-447d-4460-a06a-23468e6bb04a admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:21.151807 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a01199-b8af-4ddf-be9b-aebf0f3123e3 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:21.166353 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceba2c4-5cd3-4deb-a8a2-ba1e28318665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:21.167687 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceba2c4-5cd3-4deb-a8a2-ba1e28318665 admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:21.167967 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceba2c4-5cd3-4deb-a8a2-ba1e28318665 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:21.168246 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceba2c4-5cd3-4deb-a8a2-ba1e28318665 admin admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:21.169007 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceba2c4-5cd3-4deb-a8a2-ba1e28318665 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:21.170680 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceba2c4-5cd3-4deb-a8a2-ba1e28318665 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:21.204032 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 840/1677] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:55:21 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 17:55:21.208008 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceba2c4-5cd3-4deb-a8a2-ba1e28318665 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:21.231405 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceba2c4-5cd3-4deb-a8a2-ba1e28318665 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:21.236602 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-a9046581-447d-4460-a06a-23468e6bb04a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f95d535e3a34fe78406efd7512b87ef', 'request_id': 'req-a9046581-447d-4460-a06a-23468e6bb04a'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:21.252081 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-a9046581-447d-4460-a06a-23468e6bb04a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f95d535e3a34fe78406efd7512b87ef', 'request_id': 'req-a9046581-447d-4460-a06a-23468e6bb04a'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:21.271135 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-a9046581-447d-4460-a06a-23468e6bb04a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f95d535e3a34fe78406efd7512b87ef', 'request_id': 'req-a9046581-447d-4460-a06a-23468e6bb04a'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:21.294977 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-a9046581-447d-4460-a06a-23468e6bb04a admin admin] The token cache is being invalidate because project 9f95d535e3a34fe78406efd7512b87ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86773) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 17:55:21.295314 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-a9046581-447d-4460-a06a-23468e6bb04a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:21.296410 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-a9046581-447d-4460-a06a-23468e6bb04a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:21.301834 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 838/1678] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 14 17:55:20 2022] DELETE /identity/v3/projects/9f95d535e3a34fe78406efd7512b87ef => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 17:55:21.307705 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde28fb-174e-440e-a61a-725fc2e6f892 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:21.307994 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde28fb-174e-440e-a61a-725fc2e6f892 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:21.308275 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde28fb-174e-440e-a61a-725fc2e6f892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:21.348961 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-3bde28fb-174e-440e-a61a-725fc2e6f892 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:55:21.354668 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-3bde28fb-174e-440e-a61a-725fc2e6f892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:21.378056 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3fe942-0088-47a5-b6ac-1f06f5ac15e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:21.379010 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3fe942-0088-47a5-b6ac-1f06f5ac15e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:21.379277 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3fe942-0088-47a5-b6ac-1f06f5ac15e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:21.379562 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3fe942-0088-47a5-b6ac-1f06f5ac15e3 admin admin] PATH_INFO: `/v3/projects/7ad6c2e7ed4742278e373e7bd6ddc896/users/be0e51cb46314248bd62c11697401640/roles/95d753870f97426cb1ce32e078621a4c` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:21.415847 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3fe942-0088-47a5-b6ac-1f06f5ac15e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ad6c2e7ed4742278e373e7bd6ddc896, user_id=be0e51cb46314248bd62c11697401640, role_id=95d753870f97426cb1ce32e078621a4c)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:21.419667 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3fe942-0088-47a5-b6ac-1f06f5ac15e3 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:21.455918 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:55:21.466125 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 841/1679] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 17:55:21 2022] PUT /identity/v3/projects/7ad6c2e7ed4742278e373e7bd6ddc896/users/be0e51cb46314248bd62c11697401640/roles/95d753870f97426cb1ce32e078621a4c => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 17:55:21.477247 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92155404-8e2d-47a1-bfb6-2616269626cc None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:21.477556 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92155404-8e2d-47a1-bfb6-2616269626cc None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:21.477887 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92155404-8e2d-47a1-bfb6-2616269626cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:21.521590 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 839/1680] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:55:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:55:21.528592 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b66b9dd-ee44-457b-a31a-156e68c06b5f None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:21.528793 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b66b9dd-ee44-457b-a31a-156e68c06b5f None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:21.530135 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b66b9dd-ee44-457b-a31a-156e68c06b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:21.556948 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-92155404-8e2d-47a1-bfb6-2616269626cc None None] MFA Rules not processed for user `be0e51cb46314248bd62c11697401640`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:55:21.570702 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-92155404-8e2d-47a1-bfb6-2616269626cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:21.581953 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-1b66b9dd-ee44-457b-a31a-156e68c06b5f None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:55:21.583244 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-1b66b9dd-ee44-457b-a31a-156e68c06b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:21.802620 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 842/1681] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:55:21 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:55:21.803848 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92155404-8e2d-47a1-bfb6-2616269626cc None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:21.816909 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-92155404-8e2d-47a1-bfb6-2616269626cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:21.831518 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 840/1682] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:55:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 17:55:21.832615 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b66b9dd-ee44-457b-a31a-156e68c06b5f None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:21.836249 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-1b66b9dd-ee44-457b-a31a-156e68c06b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:21.847362 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92155404-8e2d-47a1-bfb6-2616269626cc None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:21.854129 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:55:21.866221 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7199d0-ab04-47cb-b551-8eb38af52e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:21.867298 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7199d0-ab04-47cb-b551-8eb38af52e78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:21.870657 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7199d0-ab04-47cb-b551-8eb38af52e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:21.871188 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7199d0-ab04-47cb-b551-8eb38af52e78 admin admin] PATH_INFO: `/v3/users/372fb5ec1bee4b4fbcb133a40b64375a` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:21.874946 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7199d0-ab04-47cb-b551-8eb38af52e78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=372fb5ec1bee4b4fbcb133a40b64375a)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:21.877078 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7199d0-ab04-47cb-b551-8eb38af52e78 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:21.991832 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b66b9dd-ee44-457b-a31a-156e68c06b5f None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:22.004374 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f770020b-c5d6-45a7-9220-b65ad8bdbe50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de55cae1600841889668e36402861203', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:22.005123 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f770020b-c5d6-45a7-9220-b65ad8bdbe50 service cinder] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:22.005342 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f770020b-c5d6-45a7-9220-b65ad8bdbe50 service cinder] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:22.005877 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f770020b-c5d6-45a7-9220-b65ad8bdbe50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:22.025492 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f770020b-c5d6-45a7-9220-b65ad8bdbe50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:22.032526 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f770020b-c5d6-45a7-9220-b65ad8bdbe50 service cinder] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:22.035891 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-2f7199d0-ab04-47cb-b551-8eb38af52e78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '372fb5ec1bee4b4fbcb133a40b64375a'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:22.049283 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-2f7199d0-ab04-47cb-b551-8eb38af52e78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '372fb5ec1bee4b4fbcb133a40b64375a'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:22.076772 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 841/1683] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:55:21 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:55:22.080929 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f770020b-c5d6-45a7-9220-b65ad8bdbe50 service cinder] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:22.088312 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-2f7199d0-ab04-47cb-b551-8eb38af52e78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '372fb5ec1bee4b4fbcb133a40b64375a'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:22.091021 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-2f7199d0-ab04-47cb-b551-8eb38af52e78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '372fb5ec1bee4b4fbcb133a40b64375a'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:22.134059 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f770020b-c5d6-45a7-9220-b65ad8bdbe50 service cinder] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:22.161881 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-2f7199d0-ab04-47cb-b551-8eb38af52e78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '372fb5ec1bee4b4fbcb133a40b64375a'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:22.164186 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e5f53-4755-4feb-97d6-23df39c322b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:22.167887 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e5f53-4755-4feb-97d6-23df39c322b7 admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:22.168322 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e5f53-4755-4feb-97d6-23df39c322b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:22.169147 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e5f53-4755-4feb-97d6-23df39c322b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:22.171420 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6e5f53-4755-4feb-97d6-23df39c322b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:55:22.172513 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6e5f53-4755-4feb-97d6-23df39c322b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:22.178460 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6e5f53-4755-4feb-97d6-23df39c322b7 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:22.182994 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 843/1684] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 14 17:55:21 2022] DELETE /identity/v3/users/372fb5ec1bee4b4fbcb133a40b64375a => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:55:22.190934 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a7c87-5d1d-4a69-bc80-7945067aeb78 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:22.190934 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a7c87-5d1d-4a69-bc80-7945067aeb78 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:22.196051 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a7c87-5d1d-4a69-bc80-7945067aeb78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:22.248209 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 842/1685] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 14 17:55:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:55:22.257157 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e5f53-4755-4feb-97d6-23df39c322b7 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:22.268606 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-6c6e5f53-4755-4feb-97d6-23df39c322b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:22.289872 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-a50a7c87-5d1d-4a69-bc80-7945067aeb78 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:55:22.302450 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-a50a7c87-5d1d-4a69-bc80-7945067aeb78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:22.320711 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e5f53-4755-4feb-97d6-23df39c322b7 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:22.485708 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:55:22.515647 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 844/1686] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:55:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:55:22.534505 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31844ca5-da29-4941-bc99-ce75a9faa2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:22.535366 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31844ca5-da29-4941-bc99-ce75a9faa2c4 admin admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:22.535780 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31844ca5-da29-4941-bc99-ce75a9faa2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:22.536164 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31844ca5-da29-4941-bc99-ce75a9faa2c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:22.536982 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31844ca5-da29-4941-bc99-ce75a9faa2c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:22.545342 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31844ca5-da29-4941-bc99-ce75a9faa2c4 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:22.666538 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 843/1687] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 14 17:55:22 2022] POST /identity/v3/projects => generated 367 bytes in 407 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:55:22.669042 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50a7c87-5d1d-4a69-bc80-7945067aeb78 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:22.694782 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50a7c87-5d1d-4a69-bc80-7945067aeb78 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:22.729930 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31844ca5-da29-4941-bc99-ce75a9faa2c4 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:22.731897 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-31844ca5-da29-4941-bc99-ce75a9faa2c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:22.936679 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31844ca5-da29-4941-bc99-ce75a9faa2c4 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:22.949811 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a47c668-5a60-4b2d-ac2a-62cde6d6b2ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:22.950903 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a47c668-5a60-4b2d-ac2a-62cde6d6b2ba service neutron] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:22.951243 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a47c668-5a60-4b2d-ac2a-62cde6d6b2ba service neutron] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:22.951475 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a47c668-5a60-4b2d-ac2a-62cde6d6b2ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:22.969133 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80a999a-a1d0-48b0-a06b-8db56b75632e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:22.970296 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a999a-a1d0-48b0-a06b-8db56b75632e admin admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:22.970780 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a999a-a1d0-48b0-a06b-8db56b75632e admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:22.971234 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a999a-a1d0-48b0-a06b-8db56b75632e admin admin] PATH_INFO: `/v3/users` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:22.972151 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80a999a-a1d0-48b0-a06b-8db56b75632e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:22.974619 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80a999a-a1d0-48b0-a06b-8db56b75632e admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:23.040954 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 845/1688] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 14 17:55:22 2022] POST /identity/v3/users => generated 284 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:55:23.045911 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80a999a-a1d0-48b0-a06b-8db56b75632e admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:23.070467 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80a999a-a1d0-48b0-a06b-8db56b75632e admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:23.078480 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0253ca76-0404-4b5d-b195-38dcf4c098b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:23.079644 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0253ca76-0404-4b5d-b195-38dcf4c098b2 admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:23.080172 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0253ca76-0404-4b5d-b195-38dcf4c098b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:23.080555 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0253ca76-0404-4b5d-b195-38dcf4c098b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:23.081414 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0253ca76-0404-4b5d-b195-38dcf4c098b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:23.087186 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0253ca76-0404-4b5d-b195-38dcf4c098b2 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:23.135947 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 846/1689] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:55:23 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 17:55:23.143275 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:55:23.144311 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0253ca76-0404-4b5d-b195-38dcf4c098b2 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:23.177565 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0253ca76-0404-4b5d-b195-38dcf4c098b2 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:23.204361 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11e6ec6-7a4d-4c25-bb06-4268f9fa01f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:23.205247 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11e6ec6-7a4d-4c25-bb06-4268f9fa01f1 admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:23.205800 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11e6ec6-7a4d-4c25-bb06-4268f9fa01f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:23.206306 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11e6ec6-7a4d-4c25-bb06-4268f9fa01f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:23.207273 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11e6ec6-7a4d-4c25-bb06-4268f9fa01f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:23.216099 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11e6ec6-7a4d-4c25-bb06-4268f9fa01f1 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:23.251655 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 847/1690] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:55:23 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:55:23.263721 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11e6ec6-7a4d-4c25-bb06-4268f9fa01f1 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:23.264032 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a47c668-5a60-4b2d-ac2a-62cde6d6b2ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:23.265767 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a47c668-5a60-4b2d-ac2a-62cde6d6b2ba service neutron] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:23.290961 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11e6ec6-7a4d-4c25-bb06-4268f9fa01f1 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:23.308815 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685145ea-de0b-48f4-9cb3-c75f17d35b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:23.310064 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685145ea-de0b-48f4-9cb3-c75f17d35b41 admin admin] REQUEST_METHOD: `PUT` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:23.310456 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685145ea-de0b-48f4-9cb3-c75f17d35b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:23.310976 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685145ea-de0b-48f4-9cb3-c75f17d35b41 admin admin] PATH_INFO: `/v3/projects/e5cf95abcffe4ede97d5db6fe78a2bc6/users/880e4e305b714142bba7208f7fc91869/roles/95d753870f97426cb1ce32e078621a4c` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:23.311573 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 844/1691] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:55:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 582 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 17:55:23.369350 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685145ea-de0b-48f4-9cb3-c75f17d35b41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5cf95abcffe4ede97d5db6fe78a2bc6, user_id=880e4e305b714142bba7208f7fc91869, role_id=95d753870f97426cb1ce32e078621a4c)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:23.373868 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685145ea-de0b-48f4-9cb3-c75f17d35b41 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:23.404961 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 848/1692] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 17:55:23 2022] PUT /identity/v3/projects/e5cf95abcffe4ede97d5db6fe78a2bc6/users/880e4e305b714142bba7208f7fc91869/roles/95d753870f97426cb1ce32e078621a4c => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:55:23.416437 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb9cde-3f7a-4dd3-b824-3fb9da5b691b None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:23.417195 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb9cde-3f7a-4dd3-b824-3fb9da5b691b None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:23.417661 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb9cde-3f7a-4dd3-b824-3fb9da5b691b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:23.487335 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-cacb9cde-3f7a-4dd3-b824-3fb9da5b691b None None] MFA Rules not processed for user `880e4e305b714142bba7208f7fc91869`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:55:23.488821 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-cacb9cde-3f7a-4dd3-b824-3fb9da5b691b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:23.685359 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb91c51-d17d-4ae1-8383-301a781c394b None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:23.685699 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb91c51-d17d-4ae1-8383-301a781c394b None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:23.685984 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb91c51-d17d-4ae1-8383-301a781c394b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:23.731725 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 845/1693] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:55:23 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:55:23.735944 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacb9cde-3f7a-4dd3-b824-3fb9da5b691b None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:23.790662 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-0eb91c51-d17d-4ae1-8383-301a781c394b None None] MFA Rules not processed for user `d66a790ca51f45dcb16812011445f31b`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:55:23.791923 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-0eb91c51-d17d-4ae1-8383-301a781c394b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:23.892590 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacb9cde-3f7a-4dd3-b824-3fb9da5b691b None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:23.903270 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2a9ea3-da04-46b7-aa3f-486479ece688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:23.906593 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a9ea3-da04-46b7-aa3f-486479ece688 admin admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:23.907461 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a9ea3-da04-46b7-aa3f-486479ece688 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:23.910140 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a9ea3-da04-46b7-aa3f-486479ece688 admin admin] PATH_INFO: `/v3/projects` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:23.911133 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2a9ea3-da04-46b7-aa3f-486479ece688 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:23.913729 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2a9ea3-da04-46b7-aa3f-486479ece688 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:23.995486 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 846/1694] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 14 17:55:23 2022] POST /identity/v3/projects => generated 367 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:55:24.003900 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 849/1695] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:55:23 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 17:55:24.004070 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2a9ea3-da04-46b7-aa3f-486479ece688 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:24.015060 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb91c51-d17d-4ae1-8383-301a781c394b None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:24.016939 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-0eb91c51-d17d-4ae1-8383-301a781c394b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:24.133636 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:55:24.163004 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:55:24.194760 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2a9ea3-da04-46b7-aa3f-486479ece688 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:24.214830 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd0ec83-ddb0-4c42-b942-c25ebfab820d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:24.215857 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd0ec83-ddb0-4c42-b942-c25ebfab820d admin admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:24.216259 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd0ec83-ddb0-4c42-b942-c25ebfab820d admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:24.216679 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd0ec83-ddb0-4c42-b942-c25ebfab820d admin admin] PATH_INFO: `/v3/users` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:24.217492 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd0ec83-ddb0-4c42-b942-c25ebfab820d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:24.219606 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd0ec83-ddb0-4c42-b942-c25ebfab820d admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:24.233782 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb91c51-d17d-4ae1-8383-301a781c394b None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:24.272848 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 847/1696] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 14 17:55:23 2022] POST /identity/v3/users => generated 290 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 17:55:24.274068 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd0ec83-ddb0-4c42-b942-c25ebfab820d admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:24.298352 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd0ec83-ddb0-4c42-b942-c25ebfab820d admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:24.307488 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfbf94c-137b-4900-abcd-99f963773f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:24.308830 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfbf94c-137b-4900-abcd-99f963773f24 admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:24.309321 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfbf94c-137b-4900-abcd-99f963773f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:24.309991 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfbf94c-137b-4900-abcd-99f963773f24 admin admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:24.311369 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfbf94c-137b-4900-abcd-99f963773f24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:24.313639 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfbf94c-137b-4900-abcd-99f963773f24 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:24.338901 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 848/1697] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:55:24 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:55:24.343270 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfbf94c-137b-4900-abcd-99f963773f24 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:24.369861 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfbf94c-137b-4900-abcd-99f963773f24 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:24.383711 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9fd495-723c-4d99-94a6-66c3fee67ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:24.386795 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9fd495-723c-4d99-94a6-66c3fee67ec8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:24.387941 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9fd495-723c-4d99-94a6-66c3fee67ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:24.389681 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9fd495-723c-4d99-94a6-66c3fee67ec8 admin admin] PATH_INFO: `/v3/projects/c9d449799f5a4b9aa619e002bbf799b8/users/a64474fed88d48949f5433e250622976/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:24.431788 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9fd495-723c-4d99-94a6-66c3fee67ec8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9d449799f5a4b9aa619e002bbf799b8, user_id=a64474fed88d48949f5433e250622976, role_id=4651a1cc7b4d4ab7a7a9ca1e77e58e71)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:24.434648 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9fd495-723c-4d99-94a6-66c3fee67ec8 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:24.460055 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60d7f48-0f03-4094-88d9-1c89e8fe584d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41b893bdf4ec474dbfa819c22fc29ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:24.464683 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d7f48-0f03-4094-88d9-1c89e8fe584d service nova] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:24.465319 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d7f48-0f03-4094-88d9-1c89e8fe584d service nova] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:24.474624 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 849/1698] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 17:55:24 2022] PUT /identity/v3/projects/c9d449799f5a4b9aa619e002bbf799b8/users/a64474fed88d48949f5433e250622976/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:55:24.475442 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d7f48-0f03-4094-88d9-1c89e8fe584d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:24.475566 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9fd495-723c-4d99-94a6-66c3fee67ec8 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:24.480037 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-5e9fd495-723c-4d99-94a6-66c3fee67ec8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:24.730377 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9fd495-723c-4d99-94a6-66c3fee67ec8 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:24.747230 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874dc226-123e-433b-bb52-8305bea2398a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:24.748279 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874dc226-123e-433b-bb52-8305bea2398a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:24.748569 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874dc226-123e-433b-bb52-8305bea2398a admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:24.749444 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874dc226-123e-433b-bb52-8305bea2398a admin admin] PATH_INFO: `/v3/projects/643148ded2b84ada91874576426ba477` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:24.749600 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60d7f48-0f03-4094-88d9-1c89e8fe584d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:24.750914 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874dc226-123e-433b-bb52-8305bea2398a admin admin] RBAC: Authorizing `identity:delete_project(project_id=643148ded2b84ada91874576426ba477)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:24.754133 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874dc226-123e-433b-bb52-8305bea2398a admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:24.755367 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60d7f48-0f03-4094-88d9-1c89e8fe584d service nova] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:24.782956 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 850/1699] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:55:24 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 768 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 17:55:24.784211 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60d7f48-0f03-4094-88d9-1c89e8fe584d service nova] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:24.809894 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60d7f48-0f03-4094-88d9-1c89e8fe584d service nova] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:24.834737 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b568654-eda7-498a-809b-1763f0d9887d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:24.836815 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b568654-eda7-498a-809b-1763f0d9887d admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:24.838915 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b568654-eda7-498a-809b-1763f0d9887d admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:24.839593 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b568654-eda7-498a-809b-1763f0d9887d admin admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:24.841437 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b568654-eda7-498a-809b-1763f0d9887d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:24.844880 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b568654-eda7-498a-809b-1763f0d9887d admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:24.862949 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 851/1700] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:55:24 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:55:24.864764 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-874dc226-123e-433b-bb52-8305bea2398a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '643148ded2b84ada91874576426ba477', 'request_id': 'req-874dc226-123e-433b-bb52-8305bea2398a'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:24.865215 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b568654-eda7-498a-809b-1763f0d9887d admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:24.880031 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-874dc226-123e-433b-bb52-8305bea2398a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '643148ded2b84ada91874576426ba477', 'request_id': 'req-874dc226-123e-433b-bb52-8305bea2398a'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:24.885441 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b568654-eda7-498a-809b-1763f0d9887d admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:24.894469 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-874dc226-123e-433b-bb52-8305bea2398a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '643148ded2b84ada91874576426ba477', 'request_id': 'req-874dc226-123e-433b-bb52-8305bea2398a'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:24.928631 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-874dc226-123e-433b-bb52-8305bea2398a admin admin] The token cache is being invalidate because project 643148ded2b84ada91874576426ba477 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86773) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 17:55:24.929128 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-874dc226-123e-433b-bb52-8305bea2398a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:24.931177 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-874dc226-123e-433b-bb52-8305bea2398a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:24.939672 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 850/1701] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 14 17:55:24 2022] DELETE /identity/v3/projects/643148ded2b84ada91874576426ba477 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:55:24.941511 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874dc226-123e-433b-bb52-8305bea2398a admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:24.944845 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-874dc226-123e-433b-bb52-8305bea2398a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:25.086871 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:55:25.098476 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:55:25.121677 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d56863-4a0f-49a9-a6bb-e3dbb1b8f8e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:25.123137 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d56863-4a0f-49a9-a6bb-e3dbb1b8f8e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:25.123758 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d56863-4a0f-49a9-a6bb-e3dbb1b8f8e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:25.124329 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d56863-4a0f-49a9-a6bb-e3dbb1b8f8e4 admin admin] PATH_INFO: `/v3/projects/c9d449799f5a4b9aa619e002bbf799b8/users/a64474fed88d48949f5433e250622976/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:25.128236 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d56863-4a0f-49a9-a6bb-e3dbb1b8f8e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9d449799f5a4b9aa619e002bbf799b8, user_id=a64474fed88d48949f5433e250622976, role_id=4651a1cc7b4d4ab7a7a9ca1e77e58e71)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:25.135999 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d56863-4a0f-49a9-a6bb-e3dbb1b8f8e4 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:25.187479 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 852/1702] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 17:55:24 2022] PUT /identity/v3/projects/c9d449799f5a4b9aa619e002bbf799b8/users/a64474fed88d48949f5433e250622976/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:55:25.199731 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c57a2a-c02c-4502-8abe-e1453fceef1a None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:25.200578 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c57a2a-c02c-4502-8abe-e1453fceef1a None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:25.201085 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c57a2a-c02c-4502-8abe-e1453fceef1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:25.204961 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874dc226-123e-433b-bb52-8305bea2398a admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:25.290101 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-36c57a2a-c02c-4502-8abe-e1453fceef1a None None] MFA Rules not processed for user `a64474fed88d48949f5433e250622976`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:55:25.308221 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-36c57a2a-c02c-4502-8abe-e1453fceef1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:25.374083 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e447df7-aebf-4480-ac25-73ca22eaeb6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:25.375019 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e447df7-aebf-4480-ac25-73ca22eaeb6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:25.375305 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e447df7-aebf-4480-ac25-73ca22eaeb6a admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:25.375587 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e447df7-aebf-4480-ac25-73ca22eaeb6a admin admin] PATH_INFO: `/v3/users/d97e3df37d964f7cbed9e61bebc8042b` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:25.380487 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e447df7-aebf-4480-ac25-73ca22eaeb6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d97e3df37d964f7cbed9e61bebc8042b)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:25.382668 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e447df7-aebf-4480-ac25-73ca22eaeb6a admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:25.517277 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 853/1703] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:55:25 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:55:25.521312 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5759189-567b-4b2e-844c-8272a68d19da None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:25.522074 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5759189-567b-4b2e-844c-8272a68d19da None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:25.522668 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5759189-567b-4b2e-844c-8272a68d19da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:25.571761 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-2e447df7-aebf-4480-ac25-73ca22eaeb6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd97e3df37d964f7cbed9e61bebc8042b'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:25.575777 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-a5759189-567b-4b2e-844c-8272a68d19da None None] MFA Rules not processed for user `eb82471499754e30a4dc121c40b208a3`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:55:25.580571 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-a5759189-567b-4b2e-844c-8272a68d19da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:25.597188 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-2e447df7-aebf-4480-ac25-73ca22eaeb6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd97e3df37d964f7cbed9e61bebc8042b'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:25.635899 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-2e447df7-aebf-4480-ac25-73ca22eaeb6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd97e3df37d964f7cbed9e61bebc8042b'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:25.638193 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-2e447df7-aebf-4480-ac25-73ca22eaeb6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd97e3df37d964f7cbed9e61bebc8042b'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:25.640298 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-2e447df7-aebf-4480-ac25-73ca22eaeb6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd97e3df37d964f7cbed9e61bebc8042b'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:25.674678 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 851/1704] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 14 17:55:24 2022] DELETE /identity/v3/users/d97e3df37d964f7cbed9e61bebc8042b => generated 0 bytes in 727 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:55:25.674678 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e447df7-aebf-4480-ac25-73ca22eaeb6a admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:25.677477 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-2e447df7-aebf-4480-ac25-73ca22eaeb6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:25.798293 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 854/1705] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:55:25 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:55:25.801166 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87a4f73-3f08-4485-9f61-7ece8fb03f25 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:25.803728 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87a4f73-3f08-4485-9f61-7ece8fb03f25 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:25.804101 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87a4f73-3f08-4485-9f61-7ece8fb03f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:25.845382 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-b87a4f73-3f08-4485-9f61-7ece8fb03f25 None None] MFA Rules not processed for user `eb82471499754e30a4dc121c40b208a3`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:55:25.846824 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-b87a4f73-3f08-4485-9f61-7ece8fb03f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:25.853565 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e447df7-aebf-4480-ac25-73ca22eaeb6a admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:25.876043 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566f387c-4f53-4edb-8f74-210e6f9dd1b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de55cae1600841889668e36402861203', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:25.878609 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566f387c-4f53-4edb-8f74-210e6f9dd1b9 service cinder] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:25.880907 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566f387c-4f53-4edb-8f74-210e6f9dd1b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:25.883980 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566f387c-4f53-4edb-8f74-210e6f9dd1b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:25.887347 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-566f387c-4f53-4edb-8f74-210e6f9dd1b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:25.910824 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:55:26.020367 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 855/1706] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:55:25 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:55:26.022791 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87a4f73-3f08-4485-9f61-7ece8fb03f25 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:26.026771 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-b87a4f73-3f08-4485-9f61-7ece8fb03f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:26.062409 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:55:26.065308 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566f387c-4f53-4edb-8f74-210e6f9dd1b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:26.067173 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566f387c-4f53-4edb-8f74-210e6f9dd1b9 service cinder] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:26.111972 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 852/1707] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:55:25 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:55:26.114001 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566f387c-4f53-4edb-8f74-210e6f9dd1b9 service cinder] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:26.121393 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-566f387c-4f53-4edb-8f74-210e6f9dd1b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:26.270290 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87a4f73-3f08-4485-9f61-7ece8fb03f25 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:26.291828 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d461f7b-6a57-4201-863a-a13440e9388c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:26.292738 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d461f7b-6a57-4201-863a-a13440e9388c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:26.293023 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d461f7b-6a57-4201-863a-a13440e9388c admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:26.293301 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d461f7b-6a57-4201-863a-a13440e9388c admin admin] PATH_INFO: `/v3/projects/3b40a3330d8445dc89f4c2054bc2c91e` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:26.298661 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d461f7b-6a57-4201-863a-a13440e9388c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b40a3330d8445dc89f4c2054bc2c91e)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:26.303701 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d461f7b-6a57-4201-863a-a13440e9388c admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:26.397609 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566f387c-4f53-4edb-8f74-210e6f9dd1b9 service cinder] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:26.450306 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-0d461f7b-6a57-4201-863a-a13440e9388c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b40a3330d8445dc89f4c2054bc2c91e', 'request_id': 'req-0d461f7b-6a57-4201-863a-a13440e9388c'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:26.466159 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-0d461f7b-6a57-4201-863a-a13440e9388c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b40a3330d8445dc89f4c2054bc2c91e', 'request_id': 'req-0d461f7b-6a57-4201-863a-a13440e9388c'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:26.489858 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-0d461f7b-6a57-4201-863a-a13440e9388c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b40a3330d8445dc89f4c2054bc2c91e', 'request_id': 'req-0d461f7b-6a57-4201-863a-a13440e9388c'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:26.530972 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-0d461f7b-6a57-4201-863a-a13440e9388c admin admin] The token cache is being invalidate because project 3b40a3330d8445dc89f4c2054bc2c91e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86772) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 17:55:26.531269 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-0d461f7b-6a57-4201-863a-a13440e9388c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:26.532657 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-0d461f7b-6a57-4201-863a-a13440e9388c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:26.535196 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 856/1708] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 14 17:55:26 2022] DELETE /identity/v3/projects/3b40a3330d8445dc89f4c2054bc2c91e => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:55:26.536545 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f85b504-d998-457d-8a7a-f61e3eb4be30 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:26.536838 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f85b504-d998-457d-8a7a-f61e3eb4be30 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:26.537116 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f85b504-d998-457d-8a7a-f61e3eb4be30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:26.587425 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683cd13e-4846-4fe6-a2f1-57bce5bf3025 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41b893bdf4ec474dbfa819c22fc29ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:26.588626 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683cd13e-4846-4fe6-a2f1-57bce5bf3025 service nova] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:26.592102 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683cd13e-4846-4fe6-a2f1-57bce5bf3025 service nova] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:26.592504 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683cd13e-4846-4fe6-a2f1-57bce5bf3025 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:26.599262 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-683cd13e-4846-4fe6-a2f1-57bce5bf3025 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:26.630007 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-1f85b504-d998-457d-8a7a-f61e3eb4be30 None None] MFA Rules not processed for user `a5a7061dd1154fcf891c2c8af16d7841`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:55:26.631905 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-1f85b504-d998-457d-8a7a-f61e3eb4be30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:26.734263 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:55:26.793312 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683cd13e-4846-4fe6-a2f1-57bce5bf3025 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:26.796766 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683cd13e-4846-4fe6-a2f1-57bce5bf3025 service nova] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:26.831842 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 853/1709] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:55:26 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 719 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:55:26.833773 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683cd13e-4846-4fe6-a2f1-57bce5bf3025 service nova] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:26.840714 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-683cd13e-4846-4fe6-a2f1-57bce5bf3025 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:26.892399 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 857/1710] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:55:26 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:55:26.904614 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8c61b0-2677-4b91-8d30-ee496086f636 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:26.905114 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8c61b0-2677-4b91-8d30-ee496086f636 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:26.905617 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8c61b0-2677-4b91-8d30-ee496086f636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:26.977601 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-6c8c61b0-2677-4b91-8d30-ee496086f636 None None] MFA Rules not processed for user `a5a7061dd1154fcf891c2c8af16d7841`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:55:26.983227 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-6c8c61b0-2677-4b91-8d30-ee496086f636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:27.010012 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 858/1711] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:55:26 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:55:27.022721 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8c61b0-2677-4b91-8d30-ee496086f636 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:27.024579 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-6c8c61b0-2677-4b91-8d30-ee496086f636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:27.079940 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8c61b0-2677-4b91-8d30-ee496086f636 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:27.121507 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca38a6c7-8563-4833-8c7e-73be2b5c6b13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41b893bdf4ec474dbfa819c22fc29ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:27.122908 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca38a6c7-8563-4833-8c7e-73be2b5c6b13 service nova] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:27.123393 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca38a6c7-8563-4833-8c7e-73be2b5c6b13 service nova] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:27.123891 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca38a6c7-8563-4833-8c7e-73be2b5c6b13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:27.190285 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca38a6c7-8563-4833-8c7e-73be2b5c6b13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:27.191242 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683cd13e-4846-4fe6-a2f1-57bce5bf3025 service nova] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:27.193268 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca38a6c7-8563-4833-8c7e-73be2b5c6b13 service nova] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:27.205283 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8519fe-f648-44e6-8c18-8d3dd381bcfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:27.208688 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8519fe-f648-44e6-8c18-8d3dd381bcfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:27.213322 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8519fe-f648-44e6-8c18-8d3dd381bcfb admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:27.213899 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8519fe-f648-44e6-8c18-8d3dd381bcfb admin admin] PATH_INFO: `/v3/users/5dc272ea2a364f4e9db87319818bc457` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:27.218623 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8519fe-f648-44e6-8c18-8d3dd381bcfb admin admin] RBAC: Authorizing `identity:delete_user(user_id=5dc272ea2a364f4e9db87319818bc457)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:27.223584 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8519fe-f648-44e6-8c18-8d3dd381bcfb admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:27.259836 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 859/1712] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:55:27 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 17:55:27.397365 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-6c8519fe-f648-44e6-8c18-8d3dd381bcfb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5dc272ea2a364f4e9db87319818bc457'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:27.426060 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-6c8519fe-f648-44e6-8c18-8d3dd381bcfb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5dc272ea2a364f4e9db87319818bc457'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:27.500762 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-6c8519fe-f648-44e6-8c18-8d3dd381bcfb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5dc272ea2a364f4e9db87319818bc457'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:27.505412 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-6c8519fe-f648-44e6-8c18-8d3dd381bcfb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5dc272ea2a364f4e9db87319818bc457'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:27.512349 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-6c8519fe-f648-44e6-8c18-8d3dd381bcfb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5dc272ea2a364f4e9db87319818bc457'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:27.575147 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 854/1713] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 14 17:55:26 2022] DELETE /identity/v3/users/5dc272ea2a364f4e9db87319818bc457 => generated 0 bytes in 743 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:55:27.694217 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca38a6c7-8563-4833-8c7e-73be2b5c6b13 service nova] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:27.696225 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-ca38a6c7-8563-4833-8c7e-73be2b5c6b13 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:27.724484 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca38a6c7-8563-4833-8c7e-73be2b5c6b13 service nova] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:27.752700 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:55:27.877879 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48765d3-0b90-4d55-a080-56252efad2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:27.878787 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48765d3-0b90-4d55-a080-56252efad2e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:27.879065 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48765d3-0b90-4d55-a080-56252efad2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:27.879347 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48765d3-0b90-4d55-a080-56252efad2e6 admin admin] PATH_INFO: `/v3/projects/833210b6d93044f098184fad64abdeaa` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:27.885972 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48765d3-0b90-4d55-a080-56252efad2e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=833210b6d93044f098184fad64abdeaa)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:27.887949 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48765d3-0b90-4d55-a080-56252efad2e6 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:28.045391 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-f48765d3-0b90-4d55-a080-56252efad2e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '833210b6d93044f098184fad64abdeaa', 'request_id': 'req-f48765d3-0b90-4d55-a080-56252efad2e6'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:28.058267 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-f48765d3-0b90-4d55-a080-56252efad2e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '833210b6d93044f098184fad64abdeaa', 'request_id': 'req-f48765d3-0b90-4d55-a080-56252efad2e6'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:28.080922 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-f48765d3-0b90-4d55-a080-56252efad2e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '833210b6d93044f098184fad64abdeaa', 'request_id': 'req-f48765d3-0b90-4d55-a080-56252efad2e6'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:28.119079 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-f48765d3-0b90-4d55-a080-56252efad2e6 admin admin] The token cache is being invalidate because project 833210b6d93044f098184fad64abdeaa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86772) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 17:55:28.119566 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-f48765d3-0b90-4d55-a080-56252efad2e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:28.120436 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-f48765d3-0b90-4d55-a080-56252efad2e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:28.124454 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 860/1714] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 14 17:55:27 2022] DELETE /identity/v3/projects/833210b6d93044f098184fad64abdeaa => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:55:28.129333 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1574a3e-107d-4827-821d-215b01a209b3 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:28.130056 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1574a3e-107d-4827-821d-215b01a209b3 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:28.130541 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1574a3e-107d-4827-821d-215b01a209b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:28.165503 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-f1574a3e-107d-4827-821d-215b01a209b3 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:55:28.167424 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-f1574a3e-107d-4827-821d-215b01a209b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:28.360759 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:55:28.389360 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 855/1715] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:55:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 17:55:28.397569 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd1163c-52ac-4b17-ad94-35d630dee3f1 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:28.397964 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd1163c-52ac-4b17-ad94-35d630dee3f1 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:28.398311 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd1163c-52ac-4b17-ad94-35d630dee3f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:28.437139 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-3fd1163c-52ac-4b17-ad94-35d630dee3f1 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:55:28.440875 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-3fd1163c-52ac-4b17-ad94-35d630dee3f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:28.458602 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 861/1716] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:55:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:55:28.464836 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1574a3e-107d-4827-821d-215b01a209b3 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:28.479791 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1574a3e-107d-4827-821d-215b01a209b3 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:28.487808 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e3a2eb-ab40-411d-b8b7-db1b363e3890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:28.488652 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e3a2eb-ab40-411d-b8b7-db1b363e3890 admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:28.488978 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e3a2eb-ab40-411d-b8b7-db1b363e3890 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:28.489207 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e3a2eb-ab40-411d-b8b7-db1b363e3890 admin admin] PATH_INFO: `/v3/domains` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:28.490228 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e3a2eb-ab40-411d-b8b7-db1b363e3890 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:55:28.490539 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e3a2eb-ab40-411d-b8b7-db1b363e3890 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:28.505557 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e3a2eb-ab40-411d-b8b7-db1b363e3890 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:28.548695 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 856/1717] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 14 17:55:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:55:28.553224 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd1163c-52ac-4b17-ad94-35d630dee3f1 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:28.566662 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd1163c-52ac-4b17-ad94-35d630dee3f1 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:28.578475 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a198eda5-5949-4593-a5fd-5dbe18bc1ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:28.592174 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198eda5-5949-4593-a5fd-5dbe18bc1ec7 admin admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:28.592174 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198eda5-5949-4593-a5fd-5dbe18bc1ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:28.592174 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198eda5-5949-4593-a5fd-5dbe18bc1ec7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:28.592553 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a198eda5-5949-4593-a5fd-5dbe18bc1ec7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:28.599936 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a198eda5-5949-4593-a5fd-5dbe18bc1ec7 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:28.687713 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 862/1718] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 14 17:55:28 2022] POST /identity/v3/projects => generated 401 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 17:55:28.691695 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e3a2eb-ab40-411d-b8b7-db1b363e3890 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:28.708024 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e3a2eb-ab40-411d-b8b7-db1b363e3890 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:28.891764 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76162be2-4bea-4177-abc9-2a55d3e59c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:28.893146 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76162be2-4bea-4177-abc9-2a55d3e59c43 admin admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:28.893511 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76162be2-4bea-4177-abc9-2a55d3e59c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:28.894225 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76162be2-4bea-4177-abc9-2a55d3e59c43 admin admin] PATH_INFO: `/v3/users` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:28.896763 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76162be2-4bea-4177-abc9-2a55d3e59c43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:28.899772 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76162be2-4bea-4177-abc9-2a55d3e59c43 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:28.950890 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 857/1719] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 14 17:55:28 2022] POST /identity/v3/users => generated 301 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:55:28.952519 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a198eda5-5949-4593-a5fd-5dbe18bc1ec7 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:28.968116 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a198eda5-5949-4593-a5fd-5dbe18bc1ec7 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:28.985856 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18743834-0301-4274-9bc3-764479393e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:28.986647 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18743834-0301-4274-9bc3-764479393e3b admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:28.987130 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18743834-0301-4274-9bc3-764479393e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:28.987474 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18743834-0301-4274-9bc3-764479393e3b admin admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:28.989084 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18743834-0301-4274-9bc3-764479393e3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:28.991816 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18743834-0301-4274-9bc3-764479393e3b admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:29.031495 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 863/1720] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:55:28 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:55:29.033827 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76162be2-4bea-4177-abc9-2a55d3e59c43 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:29.059963 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76162be2-4bea-4177-abc9-2a55d3e59c43 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:29.076526 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fbf626-a068-4988-93ad-d1197cdfc20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:29.076526 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fbf626-a068-4988-93ad-d1197cdfc20a admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:29.076858 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fbf626-a068-4988-93ad-d1197cdfc20a admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:29.076959 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fbf626-a068-4988-93ad-d1197cdfc20a admin admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:29.078098 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fbf626-a068-4988-93ad-d1197cdfc20a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:29.079930 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fbf626-a068-4988-93ad-d1197cdfc20a admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:29.110123 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 858/1721] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:55:29 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:55:29.114631 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18743834-0301-4274-9bc3-764479393e3b admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:29.143115 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18743834-0301-4274-9bc3-764479393e3b admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:29.144470 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd422c1-9315-406b-bb73-ba0578c646ad None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:29.144704 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd422c1-9315-406b-bb73-ba0578c646ad None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:29.144981 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd422c1-9315-406b-bb73-ba0578c646ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:29.169322 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b94c1fe-d1f2-4279-9866-28f5e918ff97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:29.172971 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b94c1fe-d1f2-4279-9866-28f5e918ff97 admin admin] REQUEST_METHOD: `PUT` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:29.173428 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b94c1fe-d1f2-4279-9866-28f5e918ff97 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:29.174802 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b94c1fe-d1f2-4279-9866-28f5e918ff97 admin admin] PATH_INFO: `/v3/projects/436d4cf58e7b4836bb6cc4c9548d9240/users/e15d70de553646a0b313d74adc1daced/roles/95d753870f97426cb1ce32e078621a4c` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:29.198649 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-edd422c1-9315-406b-bb73-ba0578c646ad None None] MFA Rules not processed for user `dc2eceb8989543d4bdbbcd706ddbe676`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:55:29.207558 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-edd422c1-9315-406b-bb73-ba0578c646ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:29.252456 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b94c1fe-d1f2-4279-9866-28f5e918ff97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=436d4cf58e7b4836bb6cc4c9548d9240, user_id=e15d70de553646a0b313d74adc1daced, role_id=95d753870f97426cb1ce32e078621a4c)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:29.257641 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b94c1fe-d1f2-4279-9866-28f5e918ff97 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:29.327547 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 864/1722] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 17:55:29 2022] PUT /identity/v3/projects/436d4cf58e7b4836bb6cc4c9548d9240/users/e15d70de553646a0b313d74adc1daced/roles/95d753870f97426cb1ce32e078621a4c => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:55:29.327547 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b94c1fe-d1f2-4279-9866-28f5e918ff97 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:29.327547 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-1b94c1fe-d1f2-4279-9866-28f5e918ff97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:29.409386 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 859/1723] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:55:29 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:55:29.411070 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad57bd-ca06-4bdd-bb1c-04d7a4afb783 None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:29.411491 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad57bd-ca06-4bdd-bb1c-04d7a4afb783 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:29.411893 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad57bd-ca06-4bdd-bb1c-04d7a4afb783 None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:29.413934 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 860/1724] 10.222.0.67 () {54 vars in 912 bytes} [Thu Jul 14 17:55:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:55:29.415552 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79104510-dcc5-43a2-b227-2c5893afd7df None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:29.416517 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79104510-dcc5-43a2-b227-2c5893afd7df None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:29.416968 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79104510-dcc5-43a2-b227-2c5893afd7df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:29.460727 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-79104510-dcc5-43a2-b227-2c5893afd7df None None] MFA Rules not processed for user `e15d70de553646a0b313d74adc1daced`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:55:29.463022 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-79104510-dcc5-43a2-b227-2c5893afd7df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:29.488945 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:55:29.543784 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b94c1fe-d1f2-4279-9866-28f5e918ff97 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:29.559153 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4fe3a8-8422-446e-a67a-7612567a48d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:29.560096 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4fe3a8-8422-446e-a67a-7612567a48d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:29.560598 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4fe3a8-8422-446e-a67a-7612567a48d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:29.561117 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4fe3a8-8422-446e-a67a-7612567a48d8 admin admin] PATH_INFO: `/v3/projects/3bd5c5a94c2145f0837c686c4d9626c0` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:29.562523 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4fe3a8-8422-446e-a67a-7612567a48d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bd5c5a94c2145f0837c686c4d9626c0)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:29.566321 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4fe3a8-8422-446e-a67a-7612567a48d8 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:29.649438 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-ee4fe3a8-8422-446e-a67a-7612567a48d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bd5c5a94c2145f0837c686c4d9626c0', 'request_id': 'req-ee4fe3a8-8422-446e-a67a-7612567a48d8'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:29.656292 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-ee4fe3a8-8422-446e-a67a-7612567a48d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bd5c5a94c2145f0837c686c4d9626c0', 'request_id': 'req-ee4fe3a8-8422-446e-a67a-7612567a48d8'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:29.667949 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-ee4fe3a8-8422-446e-a67a-7612567a48d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bd5c5a94c2145f0837c686c4d9626c0', 'request_id': 'req-ee4fe3a8-8422-446e-a67a-7612567a48d8'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:29.684022 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:55:29.693148 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-ee4fe3a8-8422-446e-a67a-7612567a48d8 admin admin] The token cache is being invalidate because project 3bd5c5a94c2145f0837c686c4d9626c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86772) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 17:55:29.693643 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-ee4fe3a8-8422-446e-a67a-7612567a48d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:29.694437 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-ee4fe3a8-8422-446e-a67a-7612567a48d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:29.696488 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 861/1725] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:55:29 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:55:29.700703 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 865/1726] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 14 17:55:29 2022] DELETE /identity/v3/projects/3bd5c5a94c2145f0837c686c4d9626c0 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:55:29.700703 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f1d98-6392-4fdc-a3db-24488db04482 None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:29.700703 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f1d98-6392-4fdc-a3db-24488db04482 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:29.700703 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f1d98-6392-4fdc-a3db-24488db04482 None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:29.702738 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbcc6a0-949b-4473-a4c3-6235a289b6c0 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:29.703267 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbcc6a0-949b-4473-a4c3-6235a289b6c0 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:29.703833 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbcc6a0-949b-4473-a4c3-6235a289b6c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:29.706955 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 866/1727] 10.222.0.67 () {54 vars in 912 bytes} [Thu Jul 14 17:55:29 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:55:29.708197 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4f1d98-6392-4fdc-a3db-24488db04482 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:29.716233 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-4a4f1d98-6392-4fdc-a3db-24488db04482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:29.790774 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-cbbcc6a0-949b-4473-a4c3-6235a289b6c0 None None] MFA Rules not processed for user `7bda83c5499f43f9838fda2679a522d4`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:55:29.792353 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-cbbcc6a0-949b-4473-a4c3-6235a289b6c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:29.888791 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 862/1728] 10.222.0.67 () {58 vars in 1009 bytes} [Thu Jul 14 17:55:29 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:55:29.889677 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbcc6a0-949b-4473-a4c3-6235a289b6c0 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:29.891075 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-cbbcc6a0-949b-4473-a4c3-6235a289b6c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:29.901278 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4f1d98-6392-4fdc-a3db-24488db04482 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:29.917917 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa8685f-3b90-4f53-9de9-3340ed18cce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:29.918990 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa8685f-3b90-4f53-9de9-3340ed18cce1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:29.919526 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa8685f-3b90-4f53-9de9-3340ed18cce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:29.919940 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa8685f-3b90-4f53-9de9-3340ed18cce1 admin admin] PATH_INFO: `/v3/users/880e4e305b714142bba7208f7fc91869` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:29.921434 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa8685f-3b90-4f53-9de9-3340ed18cce1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=880e4e305b714142bba7208f7fc91869)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:29.923757 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa8685f-3b90-4f53-9de9-3340ed18cce1 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:29.924616 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbcc6a0-949b-4473-a4c3-6235a289b6c0 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:29.948839 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80229e42-36c8-4f5d-b9e3-4dc3aa08329c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:29.950735 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80229e42-36c8-4f5d-b9e3-4dc3aa08329c admin admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:29.957893 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80229e42-36c8-4f5d-b9e3-4dc3aa08329c admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:29.958263 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80229e42-36c8-4f5d-b9e3-4dc3aa08329c admin admin] PATH_INFO: `/v3/projects` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:29.959247 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80229e42-36c8-4f5d-b9e3-4dc3aa08329c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:29.961334 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80229e42-36c8-4f5d-b9e3-4dc3aa08329c admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:30.010984 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-efa8685f-3b90-4f53-9de9-3340ed18cce1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '880e4e305b714142bba7208f7fc91869'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:30.026380 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 863/1729] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 14 17:55:29 2022] POST /identity/v3/projects => generated 401 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:55:30.028006 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c63b9-579a-47ac-bc41-94ce0ee25274 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:30.028368 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c63b9-579a-47ac-bc41-94ce0ee25274 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:30.028843 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c63b9-579a-47ac-bc41-94ce0ee25274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:30.031769 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-efa8685f-3b90-4f53-9de9-3340ed18cce1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '880e4e305b714142bba7208f7fc91869'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:30.048885 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-efa8685f-3b90-4f53-9de9-3340ed18cce1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '880e4e305b714142bba7208f7fc91869'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:30.052007 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-efa8685f-3b90-4f53-9de9-3340ed18cce1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '880e4e305b714142bba7208f7fc91869'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:30.060006 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-bf5c63b9-579a-47ac-bc41-94ce0ee25274 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:55:30.061233 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-bf5c63b9-579a-47ac-bc41-94ce0ee25274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:30.064228 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:55:30.087217 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-efa8685f-3b90-4f53-9de9-3340ed18cce1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '880e4e305b714142bba7208f7fc91869'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:30.104983 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 867/1730] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 14 17:55:29 2022] DELETE /identity/v3/users/880e4e305b714142bba7208f7fc91869 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:55:30.110262 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af03b954-c937-462e-9fde-c3077a1eaf27 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:30.110551 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af03b954-c937-462e-9fde-c3077a1eaf27 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:30.110827 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af03b954-c937-462e-9fde-c3077a1eaf27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:30.152223 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-af03b954-c937-462e-9fde-c3077a1eaf27 None None] MFA Rules not processed for user `7bda83c5499f43f9838fda2679a522d4`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:55:30.161102 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-af03b954-c937-462e-9fde-c3077a1eaf27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:30.174683 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 864/1731] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:55:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:55:30.175809 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5c63b9-579a-47ac-bc41-94ce0ee25274 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:30.177730 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-bf5c63b9-579a-47ac-bc41-94ce0ee25274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:30.264421 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5c63b9-579a-47ac-bc41-94ce0ee25274 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:30.268457 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e977120b-711e-475d-8830-829c3b613691 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:30.269200 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 868/1732] 10.222.0.67 () {58 vars in 1009 bytes} [Thu Jul 14 17:55:30 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:55:30.270106 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af03b954-c937-462e-9fde-c3077a1eaf27 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:30.271845 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-af03b954-c937-462e-9fde-c3077a1eaf27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:30.284731 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e977120b-711e-475d-8830-829c3b613691 service neutron] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:30.285357 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e977120b-711e-475d-8830-829c3b613691 service neutron] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:30.285842 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e977120b-711e-475d-8830-829c3b613691 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:30.288450 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-e977120b-711e-475d-8830-829c3b613691 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:30.302259 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e977120b-711e-475d-8830-829c3b613691 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:30.304148 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e977120b-711e-475d-8830-829c3b613691 service neutron] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:30.316490 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 865/1733] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:55:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:55:30.341284 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d8e46d-bced-4382-b346-aa4227a6f1ee None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:30.341757 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d8e46d-bced-4382-b346-aa4227a6f1ee None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:30.342176 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d8e46d-bced-4382-b346-aa4227a6f1ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:30.375252 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-86d8e46d-bced-4382-b346-aa4227a6f1ee None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:55:30.376591 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-86d8e46d-bced-4382-b346-aa4227a6f1ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:30.401380 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af03b954-c937-462e-9fde-c3077a1eaf27 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:30.406497 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:55:30.406735 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0b1f44-b7ce-4f8e-8762-ed15a3ff71f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:30.407661 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b1f44-b7ce-4f8e-8762-ed15a3ff71f6 admin admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:30.407661 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b1f44-b7ce-4f8e-8762-ed15a3ff71f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:30.407934 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b1f44-b7ce-4f8e-8762-ed15a3ff71f6 admin admin] PATH_INFO: `/v3/users` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:30.409240 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0b1f44-b7ce-4f8e-8762-ed15a3ff71f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:30.411817 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0b1f44-b7ce-4f8e-8762-ed15a3ff71f6 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:30.456415 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 869/1734] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 14 17:55:30 2022] POST /identity/v3/users => generated 307 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:55:30.459757 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05851b59-dc87-43bc-ac1d-93f545921d32 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:30.460051 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05851b59-dc87-43bc-ac1d-93f545921d32 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:30.460333 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05851b59-dc87-43bc-ac1d-93f545921d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:30.484790 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-05851b59-dc87-43bc-ac1d-93f545921d32 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:55:30.486106 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-05851b59-dc87-43bc-ac1d-93f545921d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:30.504479 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 870/1735] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:55:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:55:30.506005 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a4d1f-0f9b-4b23-ac83-a1b1d9ccb921 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:30.506290 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a4d1f-0f9b-4b23-ac83-a1b1d9ccb921 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:30.506567 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a4d1f-0f9b-4b23-ac83-a1b1d9ccb921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:30.544583 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 866/1736] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:55:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:55:30.545700 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d8e46d-bced-4382-b346-aa4227a6f1ee None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:30.558684 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-202a4d1f-0f9b-4b23-ac83-a1b1d9ccb921 None None] MFA Rules not processed for user `d66a790ca51f45dcb16812011445f31b`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:55:30.561007 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-202a4d1f-0f9b-4b23-ac83-a1b1d9ccb921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:30.574091 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d8e46d-bced-4382-b346-aa4227a6f1ee None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:30.580170 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cf57b1-03bd-473b-a785-e627e8d09503 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:30.580988 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cf57b1-03bd-473b-a785-e627e8d09503 service neutron] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:30.581396 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cf57b1-03bd-473b-a785-e627e8d09503 service neutron] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:30.581799 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cf57b1-03bd-473b-a785-e627e8d09503 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:30.592456 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cf57b1-03bd-473b-a785-e627e8d09503 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:30.594827 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cf57b1-03bd-473b-a785-e627e8d09503 service neutron] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:30.608051 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 867/1737] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:55:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:55:30.609893 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cf57b1-03bd-473b-a785-e627e8d09503 service neutron] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:30.645422 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cf57b1-03bd-473b-a785-e627e8d09503 service neutron] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:30.657913 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78c1b7a-26e3-4f36-8203-7c2d7b2ecb1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:30.658558 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78c1b7a-26e3-4f36-8203-7c2d7b2ecb1a admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:30.658846 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78c1b7a-26e3-4f36-8203-7c2d7b2ecb1a admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:30.659127 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78c1b7a-26e3-4f36-8203-7c2d7b2ecb1a admin admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:30.661080 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78c1b7a-26e3-4f36-8203-7c2d7b2ecb1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:30.662757 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78c1b7a-26e3-4f36-8203-7c2d7b2ecb1a admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:30.673945 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 871/1738] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:55:30 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:55:30.680097 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202a4d1f-0f9b-4b23-ac83-a1b1d9ccb921 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:30.693606 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 868/1739] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:55:30 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:55:30.694677 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78c1b7a-26e3-4f36-8203-7c2d7b2ecb1a admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:30.717793 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202a4d1f-0f9b-4b23-ac83-a1b1d9ccb921 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:30.718671 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-c78c1b7a-26e3-4f36-8203-7c2d7b2ecb1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:30.730705 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb758047-3179-4935-b04a-bd961ab9aded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:30.731738 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb758047-3179-4935-b04a-bd961ab9aded admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:30.731738 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb758047-3179-4935-b04a-bd961ab9aded admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:30.731988 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb758047-3179-4935-b04a-bd961ab9aded admin admin] PATH_INFO: `/v3/domains` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:30.732689 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb758047-3179-4935-b04a-bd961ab9aded admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:55:30.732991 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb758047-3179-4935-b04a-bd961ab9aded admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:30.736144 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb758047-3179-4935-b04a-bd961ab9aded admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:30.742638 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78c1b7a-26e3-4f36-8203-7c2d7b2ecb1a admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:30.753403 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913b23d6-02dd-403b-a5c1-2d5891bce2e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:30.754151 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913b23d6-02dd-403b-a5c1-2d5891bce2e3 service neutron] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:30.754440 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913b23d6-02dd-403b-a5c1-2d5891bce2e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:30.754992 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913b23d6-02dd-403b-a5c1-2d5891bce2e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:30.760665 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 872/1740] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 14 17:55:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:55:30.761345 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb758047-3179-4935-b04a-bd961ab9aded admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:30.778386 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913b23d6-02dd-403b-a5c1-2d5891bce2e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:30.780720 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913b23d6-02dd-403b-a5c1-2d5891bce2e3 service neutron] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:30.788363 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb758047-3179-4935-b04a-bd961ab9aded admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:30.800316 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0458fa-153e-47ca-bc75-cd090e2a90a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:30.801236 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0458fa-153e-47ca-bc75-cd090e2a90a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:30.801522 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0458fa-153e-47ca-bc75-cd090e2a90a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:30.801844 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0458fa-153e-47ca-bc75-cd090e2a90a1 admin admin] PATH_INFO: `/v3/projects/ec24fbcd652c41df8f55ec6594431e2f/users/828529af40164e94ae02063a47ef0a1f/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:30.803061 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 869/1741] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:55:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:55:30.804066 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913b23d6-02dd-403b-a5c1-2d5891bce2e3 service neutron] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:30.829708 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:55:30.832714 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913b23d6-02dd-403b-a5c1-2d5891bce2e3 service neutron] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:30.852737 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0458fa-153e-47ca-bc75-cd090e2a90a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec24fbcd652c41df8f55ec6594431e2f, user_id=828529af40164e94ae02063a47ef0a1f, role_id=4651a1cc7b4d4ab7a7a9ca1e77e58e71)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:30.856128 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0458fa-153e-47ca-bc75-cd090e2a90a1 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:30.858186 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2d7765-66e1-4a21-832a-235b26c3ca2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:30.858702 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2d7765-66e1-4a21-832a-235b26c3ca2d admin admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:30.858702 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2d7765-66e1-4a21-832a-235b26c3ca2d admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:30.859049 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2d7765-66e1-4a21-832a-235b26c3ca2d admin admin] PATH_INFO: `/v3/projects` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:30.859667 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2d7765-66e1-4a21-832a-235b26c3ca2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:30.861616 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2d7765-66e1-4a21-832a-235b26c3ca2d admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:30.905382 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 873/1742] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 17:55:30 2022] PUT /identity/v3/projects/ec24fbcd652c41df8f55ec6594431e2f/users/828529af40164e94ae02063a47ef0a1f/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:55:30.909318 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0458fa-153e-47ca-bc75-cd090e2a90a1 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:30.951826 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 870/1743] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 14 17:55:30 2022] POST /identity/v3/projects => generated 375 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:55:30.957644 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2d7765-66e1-4a21-832a-235b26c3ca2d admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:31.096495 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0458fa-153e-47ca-bc75-cd090e2a90a1 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:31.150071 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2d7765-66e1-4a21-832a-235b26c3ca2d admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:31.173261 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1783541-43e9-4229-8aee-83c0951c0a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:31.174203 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1783541-43e9-4229-8aee-83c0951c0a9e admin admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:31.175981 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1783541-43e9-4229-8aee-83c0951c0a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:31.176278 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1783541-43e9-4229-8aee-83c0951c0a9e admin admin] PATH_INFO: `/v3/users` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:31.179488 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1783541-43e9-4229-8aee-83c0951c0a9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:31.183446 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1783541-43e9-4229-8aee-83c0951c0a9e admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:31.221520 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 871/1744] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 14 17:55:30 2022] POST /identity/v3/users => generated 288 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 17:55:31.224846 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1783541-43e9-4229-8aee-83c0951c0a9e admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:31.238165 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1783541-43e9-4229-8aee-83c0951c0a9e admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:31.245049 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f729656-80bc-463d-8180-c623dee03a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:31.246049 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f729656-80bc-463d-8180-c623dee03a58 admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:31.246448 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f729656-80bc-463d-8180-c623dee03a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:31.246735 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f729656-80bc-463d-8180-c623dee03a58 admin admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:31.247483 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f729656-80bc-463d-8180-c623dee03a58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:31.249436 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f729656-80bc-463d-8180-c623dee03a58 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:31.256917 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4568ba6-f79a-4d08-8bf2-30c7bd6fe3bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:31.257745 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4568ba6-f79a-4d08-8bf2-30c7bd6fe3bf admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:31.258853 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4568ba6-f79a-4d08-8bf2-30c7bd6fe3bf admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:31.259390 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4568ba6-f79a-4d08-8bf2-30c7bd6fe3bf admin admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:31.262556 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4568ba6-f79a-4d08-8bf2-30c7bd6fe3bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:31.264368 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4568ba6-f79a-4d08-8bf2-30c7bd6fe3bf admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:31.265226 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 872/1745] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:55:31 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 17:55:31.266222 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f729656-80bc-463d-8180-c623dee03a58 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:31.278136 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f729656-80bc-463d-8180-c623dee03a58 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:31.284033 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe57bce3-5e14-4eeb-b87f-92d2e901e618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:31.284885 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57bce3-5e14-4eeb-b87f-92d2e901e618 admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:31.285438 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57bce3-5e14-4eeb-b87f-92d2e901e618 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:31.285767 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57bce3-5e14-4eeb-b87f-92d2e901e618 admin admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:31.286512 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe57bce3-5e14-4eeb-b87f-92d2e901e618 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:31.288126 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe57bce3-5e14-4eeb-b87f-92d2e901e618 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:31.288575 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 874/1746] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:55:30 2022] GET /identity/v3/roles => generated 1420 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:55:31.293033 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4568ba6-f79a-4d08-8bf2-30c7bd6fe3bf admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:31.304752 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 873/1747] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:55:31 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:55:31.309906 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe57bce3-5e14-4eeb-b87f-92d2e901e618 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:31.321493 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4568ba6-f79a-4d08-8bf2-30c7bd6fe3bf admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:31.322462 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe57bce3-5e14-4eeb-b87f-92d2e901e618 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:31.327601 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39a9812-17f5-498c-86d6-928fbd7d98f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:31.328482 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a9812-17f5-498c-86d6-928fbd7d98f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:31.328763 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a9812-17f5-498c-86d6-928fbd7d98f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:31.329032 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a9812-17f5-498c-86d6-928fbd7d98f8 admin admin] PATH_INFO: `/v3/projects/e83bfaa76db24cf18c04a528d941511d/users/6270cdc59f4847c6b7824f380c2a6bb3/roles/95d753870f97426cb1ce32e078621a4c` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:31.331843 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44514b70-ec63-4323-876b-d0bf2819ace4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:31.332782 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44514b70-ec63-4323-876b-d0bf2819ace4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:31.333053 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44514b70-ec63-4323-876b-d0bf2819ace4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:31.334212 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44514b70-ec63-4323-876b-d0bf2819ace4 admin admin] PATH_INFO: `/v3/projects/ec24fbcd652c41df8f55ec6594431e2f/users/828529af40164e94ae02063a47ef0a1f/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:31.339458 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44514b70-ec63-4323-876b-d0bf2819ace4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec24fbcd652c41df8f55ec6594431e2f, user_id=828529af40164e94ae02063a47ef0a1f, role_id=4651a1cc7b4d4ab7a7a9ca1e77e58e71)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:31.342265 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44514b70-ec63-4323-876b-d0bf2819ace4 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:31.355957 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 875/1748] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 17:55:31 2022] PUT /identity/v3/projects/ec24fbcd652c41df8f55ec6594431e2f/users/828529af40164e94ae02063a47ef0a1f/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:55:31.367318 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291f09d-772a-445d-8da6-d57ba95d6175 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:31.367612 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291f09d-772a-445d-8da6-d57ba95d6175 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:31.367970 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291f09d-772a-445d-8da6-d57ba95d6175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:31.375943 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39a9812-17f5-498c-86d6-928fbd7d98f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e83bfaa76db24cf18c04a528d941511d, user_id=6270cdc59f4847c6b7824f380c2a6bb3, role_id=95d753870f97426cb1ce32e078621a4c)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:31.378913 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39a9812-17f5-498c-86d6-928fbd7d98f8 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:31.447585 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 874/1749] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 17:55:31 2022] PUT /identity/v3/projects/e83bfaa76db24cf18c04a528d941511d/users/6270cdc59f4847c6b7824f380c2a6bb3/roles/95d753870f97426cb1ce32e078621a4c => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:55:31.451720 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a99c53-a940-4c1c-bb16-e0dbc977ebbf None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:31.466188 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a99c53-a940-4c1c-bb16-e0dbc977ebbf None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:31.466562 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a99c53-a940-4c1c-bb16-e0dbc977ebbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:31.484198 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:55:31.495715 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-6291f09d-772a-445d-8da6-d57ba95d6175 None None] MFA Rules not processed for user `828529af40164e94ae02063a47ef0a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:55:31.497289 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-6291f09d-772a-445d-8da6-d57ba95d6175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:31.539760 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-a1a99c53-a940-4c1c-bb16-e0dbc977ebbf None None] MFA Rules not processed for user `6270cdc59f4847c6b7824f380c2a6bb3`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:55:31.541052 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-a1a99c53-a940-4c1c-bb16-e0dbc977ebbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:31.705102 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 876/1750] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:55:31 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:55:31.705102 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6291f09d-772a-445d-8da6-d57ba95d6175 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:31.705102 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-6291f09d-772a-445d-8da6-d57ba95d6175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:31.717915 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:55:31.740491 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 875/1751] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:55:31 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:55:31.745031 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a99c53-a940-4c1c-bb16-e0dbc977ebbf None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:31.749873 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-a1a99c53-a940-4c1c-bb16-e0dbc977ebbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:31.882635 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6291f09d-772a-445d-8da6-d57ba95d6175 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:31.891144 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1a155b-36ba-4390-b774-8cbfb85abee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:31.892305 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a155b-36ba-4390-b774-8cbfb85abee4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:31.892750 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a155b-36ba-4390-b774-8cbfb85abee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:31.893044 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a155b-36ba-4390-b774-8cbfb85abee4 admin admin] PATH_INFO: `/v3/projects/e5cf95abcffe4ede97d5db6fe78a2bc6` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:31.898554 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1a155b-36ba-4390-b774-8cbfb85abee4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5cf95abcffe4ede97d5db6fe78a2bc6)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:31.901792 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1a155b-36ba-4390-b774-8cbfb85abee4 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:31.914406 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a99c53-a940-4c1c-bb16-e0dbc977ebbf None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:31.926722 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2a27a6-06fa-4a92-bcb2-ba63552d15fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de55cae1600841889668e36402861203', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:31.929309 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2a27a6-06fa-4a92-bcb2-ba63552d15fa service cinder] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:31.929650 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2a27a6-06fa-4a92-bcb2-ba63552d15fa service cinder] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:31.929937 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2a27a6-06fa-4a92-bcb2-ba63552d15fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:31.950326 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2a27a6-06fa-4a92-bcb2-ba63552d15fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:31.952136 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2a27a6-06fa-4a92-bcb2-ba63552d15fa service cinder] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:31.990403 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 876/1752] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:55:31 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:55:31.991847 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2a27a6-06fa-4a92-bcb2-ba63552d15fa service cinder] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:32.014202 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2a27a6-06fa-4a92-bcb2-ba63552d15fa service cinder] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:32.021393 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dabc73-ca50-4539-bfb5-2cfe4370470d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:32.022348 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dabc73-ca50-4539-bfb5-2cfe4370470d admin admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:32.022666 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dabc73-ca50-4539-bfb5-2cfe4370470d admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:32.029808 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dabc73-ca50-4539-bfb5-2cfe4370470d admin admin] PATH_INFO: `/v3/projects` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:32.030948 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dabc73-ca50-4539-bfb5-2cfe4370470d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:32.033746 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dabc73-ca50-4539-bfb5-2cfe4370470d admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:32.045324 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-5d1a155b-36ba-4390-b774-8cbfb85abee4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5cf95abcffe4ede97d5db6fe78a2bc6', 'request_id': 'req-5d1a155b-36ba-4390-b774-8cbfb85abee4'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:32.064894 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-5d1a155b-36ba-4390-b774-8cbfb85abee4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5cf95abcffe4ede97d5db6fe78a2bc6', 'request_id': 'req-5d1a155b-36ba-4390-b774-8cbfb85abee4'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:32.079900 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-5d1a155b-36ba-4390-b774-8cbfb85abee4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5cf95abcffe4ede97d5db6fe78a2bc6', 'request_id': 'req-5d1a155b-36ba-4390-b774-8cbfb85abee4'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:32.109561 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-5d1a155b-36ba-4390-b774-8cbfb85abee4 admin admin] The token cache is being invalidate because project e5cf95abcffe4ede97d5db6fe78a2bc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86772) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 17:55:32.110221 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-5d1a155b-36ba-4390-b774-8cbfb85abee4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:32.111171 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-5d1a155b-36ba-4390-b774-8cbfb85abee4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:32.115672 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 877/1753] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 14 17:55:31 2022] DELETE /identity/v3/projects/e5cf95abcffe4ede97d5db6fe78a2bc6 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:55:32.115672 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e29779-8171-4f8e-bc7f-6c4a941d958c None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:32.115933 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e29779-8171-4f8e-bc7f-6c4a941d958c None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:32.116300 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e29779-8171-4f8e-bc7f-6c4a941d958c None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:32.119032 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 878/1754] 10.222.0.67 () {54 vars in 960 bytes} [Thu Jul 14 17:55:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:55:32.119956 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e29779-8171-4f8e-bc7f-6c4a941d958c None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:32.121826 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-f6e29779-8171-4f8e-bc7f-6c4a941d958c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:32.130962 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 877/1755] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 14 17:55:31 2022] POST /identity/v3/projects => generated 373 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:55:32.134903 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dabc73-ca50-4539-bfb5-2cfe4370470d admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:32.134903 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-c8dabc73-ca50-4539-bfb5-2cfe4370470d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:32.233739 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e29779-8171-4f8e-bc7f-6c4a941d958c None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:32.243561 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dabc73-ca50-4539-bfb5-2cfe4370470d admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:32.251708 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e27c422-c135-4683-8a53-6a9e5b094dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:32.252785 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e27c422-c135-4683-8a53-6a9e5b094dd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:32.253210 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e27c422-c135-4683-8a53-6a9e5b094dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:32.253663 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e27c422-c135-4683-8a53-6a9e5b094dd7 admin admin] PATH_INFO: `/v3/users/a64474fed88d48949f5433e250622976` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:32.255397 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e27c422-c135-4683-8a53-6a9e5b094dd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a64474fed88d48949f5433e250622976)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:32.257831 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e27c422-c135-4683-8a53-6a9e5b094dd7 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:32.277847 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:55:32.278249 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:55:32.323755 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e205ad3d-8829-4b6c-9fe9-b830e867913a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5324ab45f4a4449980dad920278f5034', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:32.324752 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e205ad3d-8829-4b6c-9fe9-b830e867913a service placement] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:32.325104 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e205ad3d-8829-4b6c-9fe9-b830e867913a service placement] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:32.325450 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e205ad3d-8829-4b6c-9fe9-b830e867913a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:32.328092 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-e205ad3d-8829-4b6c-9fe9-b830e867913a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:32.344559 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e205ad3d-8829-4b6c-9fe9-b830e867913a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:32.344957 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-5e27c422-c135-4683-8a53-6a9e5b094dd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a64474fed88d48949f5433e250622976'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:32.351279 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e205ad3d-8829-4b6c-9fe9-b830e867913a service placement] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:32.355681 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-5e27c422-c135-4683-8a53-6a9e5b094dd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a64474fed88d48949f5433e250622976'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:32.368015 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 879/1756] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:55:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:55:32.370214 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f369461-db64-41ce-b2a9-bbf64801ce5b None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:32.370643 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f369461-db64-41ce-b2a9-bbf64801ce5b None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:32.371090 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f369461-db64-41ce-b2a9-bbf64801ce5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:32.390024 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-5e27c422-c135-4683-8a53-6a9e5b094dd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a64474fed88d48949f5433e250622976'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:32.390937 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-5e27c422-c135-4683-8a53-6a9e5b094dd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a64474fed88d48949f5433e250622976'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:32.392602 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-5e27c422-c135-4683-8a53-6a9e5b094dd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a64474fed88d48949f5433e250622976'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:32.407069 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-8f369461-db64-41ce-b2a9-bbf64801ce5b None None] MFA Rules not processed for user `5324ab45f4a4449980dad920278f5034`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:55:32.411293 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-8f369461-db64-41ce-b2a9-bbf64801ce5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:32.420030 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 878/1757] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 14 17:55:32 2022] DELETE /identity/v3/users/a64474fed88d48949f5433e250622976 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:55:32.421433 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e27c422-c135-4683-8a53-6a9e5b094dd7 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:32.425555 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-5e27c422-c135-4683-8a53-6a9e5b094dd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:32.455667 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 880/1758] 10.222.0.67 () {58 vars in 1057 bytes} [Thu Jul 14 17:55:32 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:55:32.457150 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f369461-db64-41ce-b2a9-bbf64801ce5b None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:32.458966 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-8f369461-db64-41ce-b2a9-bbf64801ce5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:32.567919 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e27c422-c135-4683-8a53-6a9e5b094dd7 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:32.605326 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d8f929-c77a-4bb5-9906-eab4f9954f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:32.607713 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d8f929-c77a-4bb5-9906-eab4f9954f7f admin admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:32.608574 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d8f929-c77a-4bb5-9906-eab4f9954f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:32.609106 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d8f929-c77a-4bb5-9906-eab4f9954f7f admin admin] PATH_INFO: `/v3/users` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:32.609802 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f369461-db64-41ce-b2a9-bbf64801ce5b None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:32.610472 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d8f929-c77a-4bb5-9906-eab4f9954f7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:32.616919 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d8f929-c77a-4bb5-9906-eab4f9954f7f admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:32.672430 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 879/1759] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 14 17:55:32 2022] POST /identity/v3/users => generated 293 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:55:32.676983 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d8f929-c77a-4bb5-9906-eab4f9954f7f admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:32.798744 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053ecca2-bd33-4882-88ad-2da865d19023 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de55cae1600841889668e36402861203', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:32.799680 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053ecca2-bd33-4882-88ad-2da865d19023 service cinder] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:32.799962 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053ecca2-bd33-4882-88ad-2da865d19023 service cinder] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:32.800245 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053ecca2-bd33-4882-88ad-2da865d19023 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:32.802254 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-053ecca2-bd33-4882-88ad-2da865d19023 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:32.832141 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d8f929-c77a-4bb5-9906-eab4f9954f7f admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:32.854714 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12005c3-1c5f-473b-b86c-807d850b775d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5324ab45f4a4449980dad920278f5034', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:32.856899 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12005c3-1c5f-473b-b86c-807d850b775d service placement] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:32.857195 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12005c3-1c5f-473b-b86c-807d850b775d service placement] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:32.858768 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12005c3-1c5f-473b-b86c-807d850b775d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:32.870806 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-b12005c3-1c5f-473b-b86c-807d850b775d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:32.918356 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12005c3-1c5f-473b-b86c-807d850b775d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:32.920015 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12005c3-1c5f-473b-b86c-807d850b775d service placement] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:32.971249 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 880/1760] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:55:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:55:32.972649 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12005c3-1c5f-473b-b86c-807d850b775d service placement] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:32.986029 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053ecca2-bd33-4882-88ad-2da865d19023 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:32.988687 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053ecca2-bd33-4882-88ad-2da865d19023 service cinder] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:32.992971 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12005c3-1c5f-473b-b86c-807d850b775d service placement] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:33.006473 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ab7392-6537-41e5-92a2-78f878b12a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:33.007505 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab7392-6537-41e5-92a2-78f878b12a70 admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:33.007796 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab7392-6537-41e5-92a2-78f878b12a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:33.008068 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab7392-6537-41e5-92a2-78f878b12a70 admin admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:33.009356 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ab7392-6537-41e5-92a2-78f878b12a70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:33.011653 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ab7392-6537-41e5-92a2-78f878b12a70 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:33.017910 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 881/1761] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:55:32 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 561 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:55:33.070983 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:55:33.086937 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 881/1762] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:55:32 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:55:33.087421 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053ecca2-bd33-4882-88ad-2da865d19023 service cinder] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:33.122684 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053ecca2-bd33-4882-88ad-2da865d19023 service cinder] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:33.144393 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d73e04-b857-4440-ab38-577331edaf48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:33.146285 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d73e04-b857-4440-ab38-577331edaf48 admin admin] REQUEST_METHOD: `PUT` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:33.146600 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d73e04-b857-4440-ab38-577331edaf48 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:33.147517 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d73e04-b857-4440-ab38-577331edaf48 admin admin] PATH_INFO: `/v3/projects/9c628770406c45da9e1504b776dc29c4/users/f7a125e5aa904597b856fa1c0cce70f6/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:33.216616 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d73e04-b857-4440-ab38-577331edaf48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c628770406c45da9e1504b776dc29c4, user_id=f7a125e5aa904597b856fa1c0cce70f6, role_id=4651a1cc7b4d4ab7a7a9ca1e77e58e71)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:33.231902 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d73e04-b857-4440-ab38-577331edaf48 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:33.281267 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 882/1763] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 17:55:33 2022] PUT /identity/v3/projects/9c628770406c45da9e1504b776dc29c4/users/f7a125e5aa904597b856fa1c0cce70f6/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 17:55:33.285433 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ab7392-6537-41e5-92a2-78f878b12a70 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:33.305055 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ab7392-6537-41e5-92a2-78f878b12a70 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:33.349830 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d73e04-b857-4440-ab38-577331edaf48 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:33.351644 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-e7d73e04-b857-4440-ab38-577331edaf48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:33.361250 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:55:33.479075 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9ec739-3743-4ffe-8555-32fab3a2723c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:33.479810 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9ec739-3743-4ffe-8555-32fab3a2723c admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:33.480106 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9ec739-3743-4ffe-8555-32fab3a2723c admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:33.480421 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9ec739-3743-4ffe-8555-32fab3a2723c admin admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:33.481426 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9ec739-3743-4ffe-8555-32fab3a2723c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:33.483242 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9ec739-3743-4ffe-8555-32fab3a2723c admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:33.522982 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 882/1764] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:55:33 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:55:33.531426 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9ec739-3743-4ffe-8555-32fab3a2723c admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:33.538908 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d73e04-b857-4440-ab38-577331edaf48 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:33.552604 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9ec739-3743-4ffe-8555-32fab3a2723c admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:33.562438 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d34a0bf-a83d-48e1-8c11-2ad48644f689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:33.563452 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d34a0bf-a83d-48e1-8c11-2ad48644f689 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:33.563740 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d34a0bf-a83d-48e1-8c11-2ad48644f689 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:33.564019 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d34a0bf-a83d-48e1-8c11-2ad48644f689 admin admin] PATH_INFO: `/v3/projects/c9d449799f5a4b9aa619e002bbf799b8` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:33.565555 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d34a0bf-a83d-48e1-8c11-2ad48644f689 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9d449799f5a4b9aa619e002bbf799b8)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:33.576002 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfcd7bc-06e7-4de6-8a01-0d30d512de78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:33.576936 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfcd7bc-06e7-4de6-8a01-0d30d512de78 admin admin] REQUEST_METHOD: `PUT` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:33.577228 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfcd7bc-06e7-4de6-8a01-0d30d512de78 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:33.577510 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfcd7bc-06e7-4de6-8a01-0d30d512de78 admin admin] PATH_INFO: `/v3/projects/9c628770406c45da9e1504b776dc29c4/users/f7a125e5aa904597b856fa1c0cce70f6/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:33.591235 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfcd7bc-06e7-4de6-8a01-0d30d512de78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c628770406c45da9e1504b776dc29c4, user_id=f7a125e5aa904597b856fa1c0cce70f6, role_id=4651a1cc7b4d4ab7a7a9ca1e77e58e71)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:33.591610 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d34a0bf-a83d-48e1-8c11-2ad48644f689 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:33.599561 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfcd7bc-06e7-4de6-8a01-0d30d512de78 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:33.653217 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 883/1765] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 17:55:33 2022] PUT /identity/v3/projects/9c628770406c45da9e1504b776dc29c4/users/f7a125e5aa904597b856fa1c0cce70f6/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:55:33.667544 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6260bb0b-4283-43d9-97b7-d682a08cf305 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:33.671144 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6260bb0b-4283-43d9-97b7-d682a08cf305 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:33.671437 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6260bb0b-4283-43d9-97b7-d682a08cf305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:33.757006 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-0d34a0bf-a83d-48e1-8c11-2ad48644f689 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9d449799f5a4b9aa619e002bbf799b8', 'request_id': 'req-0d34a0bf-a83d-48e1-8c11-2ad48644f689'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:33.770145 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-6260bb0b-4283-43d9-97b7-d682a08cf305 None None] MFA Rules not processed for user `f7a125e5aa904597b856fa1c0cce70f6`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:55:33.771706 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-6260bb0b-4283-43d9-97b7-d682a08cf305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:33.772536 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-0d34a0bf-a83d-48e1-8c11-2ad48644f689 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9d449799f5a4b9aa619e002bbf799b8', 'request_id': 'req-0d34a0bf-a83d-48e1-8c11-2ad48644f689'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:33.789061 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-0d34a0bf-a83d-48e1-8c11-2ad48644f689 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9d449799f5a4b9aa619e002bbf799b8', 'request_id': 'req-0d34a0bf-a83d-48e1-8c11-2ad48644f689'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:33.813343 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-0d34a0bf-a83d-48e1-8c11-2ad48644f689 admin admin] The token cache is being invalidate because project c9d449799f5a4b9aa619e002bbf799b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86772) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 17:55:33.813826 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-0d34a0bf-a83d-48e1-8c11-2ad48644f689 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:33.819431 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-0d34a0bf-a83d-48e1-8c11-2ad48644f689 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:33.826486 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 883/1766] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 14 17:55:33 2022] DELETE /identity/v3/projects/c9d449799f5a4b9aa619e002bbf799b8 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:55:33.828256 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fef3b1-ac33-4d82-908a-25a91549da5f None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:33.828685 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fef3b1-ac33-4d82-908a-25a91549da5f None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:33.828979 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fef3b1-ac33-4d82-908a-25a91549da5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:33.917821 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-50fef3b1-ac33-4d82-908a-25a91549da5f None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:55:33.922601 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-50fef3b1-ac33-4d82-908a-25a91549da5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:33.935277 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 884/1767] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:55:33 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:55:33.951306 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6260bb0b-4283-43d9-97b7-d682a08cf305 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:33.953492 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-6260bb0b-4283-43d9-97b7-d682a08cf305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:34.066174 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6260bb0b-4283-43d9-97b7-d682a08cf305 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:34.081255 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27d9ec0-1b7c-48bd-ad8a-3038b1bdbb34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de55cae1600841889668e36402861203', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:34.082570 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d9ec0-1b7c-48bd-ad8a-3038b1bdbb34 service cinder] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:34.083008 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d9ec0-1b7c-48bd-ad8a-3038b1bdbb34 service cinder] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:34.083420 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d9ec0-1b7c-48bd-ad8a-3038b1bdbb34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:34.093440 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-e27d9ec0-1b7c-48bd-ad8a-3038b1bdbb34 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:34.157186 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:55:34.238973 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27d9ec0-1b7c-48bd-ad8a-3038b1bdbb34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:34.240436 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27d9ec0-1b7c-48bd-ad8a-3038b1bdbb34 service cinder] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:34.256197 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 884/1768] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:55:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 429 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 17:55:34.266620 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe794ec-2e28-457f-867d-1063f5f78dba None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:34.267405 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe794ec-2e28-457f-867d-1063f5f78dba None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:34.268025 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe794ec-2e28-457f-867d-1063f5f78dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:34.289877 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 885/1769] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:55:33 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:55:34.327411 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-5fe794ec-2e28-457f-867d-1063f5f78dba None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:55:34.331606 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-5fe794ec-2e28-457f-867d-1063f5f78dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:34.370984 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 885/1770] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:55:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:55:34.374864 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27d9ec0-1b7c-48bd-ad8a-3038b1bdbb34 service cinder] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:34.436142 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27d9ec0-1b7c-48bd-ad8a-3038b1bdbb34 service cinder] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:34.482843 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c4ffa-f1dd-4bd3-bf33-70a2c0110143 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:34.483466 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c4ffa-f1dd-4bd3-bf33-70a2c0110143 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:34.484091 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c4ffa-f1dd-4bd3-bf33-70a2c0110143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:34.499690 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a27c1d-f1d2-4a5c-83ce-569e4801b4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:34.500410 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a27c1d-f1d2-4a5c-83ce-569e4801b4e2 admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:34.500697 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a27c1d-f1d2-4a5c-83ce-569e4801b4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:34.500976 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a27c1d-f1d2-4a5c-83ce-569e4801b4e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:34.501791 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a27c1d-f1d2-4a5c-83ce-569e4801b4e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:55:34.502108 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a27c1d-f1d2-4a5c-83ce-569e4801b4e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:34.503733 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a27c1d-f1d2-4a5c-83ce-569e4801b4e2 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:34.530830 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-672c4ffa-f1dd-4bd3-bf33-70a2c0110143 None None] MFA Rules not processed for user `eb82471499754e30a4dc121c40b208a3`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:55:34.539058 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-672c4ffa-f1dd-4bd3-bf33-70a2c0110143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:34.568261 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 886/1771] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 14 17:55:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:55:34.569603 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a27c1d-f1d2-4a5c-83ce-569e4801b4e2 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:34.586797 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a27c1d-f1d2-4a5c-83ce-569e4801b4e2 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:34.594768 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867969b3-6fbf-4861-a92d-6945085b87b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:34.595606 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867969b3-6fbf-4861-a92d-6945085b87b0 admin admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:34.595974 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867969b3-6fbf-4861-a92d-6945085b87b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:34.596377 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867969b3-6fbf-4861-a92d-6945085b87b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:34.597188 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867969b3-6fbf-4861-a92d-6945085b87b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:34.601186 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867969b3-6fbf-4861-a92d-6945085b87b0 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:34.673128 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:55:34.767712 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 887/1772] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 14 17:55:34 2022] POST /identity/v3/projects => generated 387 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:55:34.770355 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867969b3-6fbf-4861-a92d-6945085b87b0 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:34.897173 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 886/1773] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:55:34 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 416 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 17:55:35.168330 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867969b3-6fbf-4861-a92d-6945085b87b0 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:35.224701 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9090303-9516-4c39-a80c-971505c0873a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:35.226009 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9090303-9516-4c39-a80c-971505c0873a admin admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:35.226688 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9090303-9516-4c39-a80c-971505c0873a admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:35.227195 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9090303-9516-4c39-a80c-971505c0873a admin admin] PATH_INFO: `/v3/users` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:35.228336 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9090303-9516-4c39-a80c-971505c0873a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:35.269456 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9090303-9516-4c39-a80c-971505c0873a admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:35.390444 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672c4ffa-f1dd-4bd3-bf33-70a2c0110143 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:35.401896 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 888/1774] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 14 17:55:34 2022] POST /identity/v3/users => generated 294 bytes in 633 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:55:35.416567 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672c4ffa-f1dd-4bd3-bf33-70a2c0110143 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:35.425885 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2383e7-3665-4f09-8977-7e802d606f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:35.426920 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2383e7-3665-4f09-8977-7e802d606f4a admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:35.428237 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2383e7-3665-4f09-8977-7e802d606f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:35.430880 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2383e7-3665-4f09-8977-7e802d606f4a admin admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:35.432180 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2383e7-3665-4f09-8977-7e802d606f4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:35.434366 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2383e7-3665-4f09-8977-7e802d606f4a admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:35.472168 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 887/1775] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:55:35 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 17:55:35.476823 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9090303-9516-4c39-a80c-971505c0873a admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:35.504081 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9090303-9516-4c39-a80c-971505c0873a admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:35.527917 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6f5ddb-4607-470a-8dab-7a9f6078fc08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:35.537226 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f5ddb-4607-470a-8dab-7a9f6078fc08 admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:35.537798 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f5ddb-4607-470a-8dab-7a9f6078fc08 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:35.538223 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f5ddb-4607-470a-8dab-7a9f6078fc08 admin admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:35.539132 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6f5ddb-4607-470a-8dab-7a9f6078fc08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:35.548018 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6f5ddb-4607-470a-8dab-7a9f6078fc08 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:35.617103 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 889/1776] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:55:35 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:55:35.618446 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2383e7-3665-4f09-8977-7e802d606f4a admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:35.641814 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2383e7-3665-4f09-8977-7e802d606f4a admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:35.668673 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980d92e4-97d2-4262-9889-58d018b3a675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:35.671999 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d92e4-97d2-4262-9889-58d018b3a675 admin admin] REQUEST_METHOD: `PUT` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:35.672346 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d92e4-97d2-4262-9889-58d018b3a675 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:35.672637 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d92e4-97d2-4262-9889-58d018b3a675 admin admin] PATH_INFO: `/v3/projects/e7b858e44c7940bd9ff736b69cd64b08/users/d42c9952b9a34126b86b952b3a3eec01/roles/95d753870f97426cb1ce32e078621a4c` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:35.771505 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980d92e4-97d2-4262-9889-58d018b3a675 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7b858e44c7940bd9ff736b69cd64b08, user_id=d42c9952b9a34126b86b952b3a3eec01, role_id=95d753870f97426cb1ce32e078621a4c)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:35.784860 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980d92e4-97d2-4262-9889-58d018b3a675 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:35.831863 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 888/1777] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 17:55:35 2022] PUT /identity/v3/projects/e7b858e44c7940bd9ff736b69cd64b08/users/d42c9952b9a34126b86b952b3a3eec01/roles/95d753870f97426cb1ce32e078621a4c => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:55:35.849566 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ba309d-b164-4212-96a0-c436662d7c48 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:35.849932 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ba309d-b164-4212-96a0-c436662d7c48 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:35.850630 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ba309d-b164-4212-96a0-c436662d7c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:35.941139 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-b0ba309d-b164-4212-96a0-c436662d7c48 None None] MFA Rules not processed for user `d42c9952b9a34126b86b952b3a3eec01`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:55:35.944417 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-b0ba309d-b164-4212-96a0-c436662d7c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:36.159351 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:55:36.184170 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 890/1778] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:55:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:55:36.189036 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980d92e4-97d2-4262-9889-58d018b3a675 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:36.367245 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980d92e4-97d2-4262-9889-58d018b3a675 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:36.382046 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c734d1-7b93-4fbf-b018-2878aa3f368f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:36.401395 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c734d1-7b93-4fbf-b018-2878aa3f368f admin admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:36.403667 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c734d1-7b93-4fbf-b018-2878aa3f368f admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:36.404868 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c734d1-7b93-4fbf-b018-2878aa3f368f admin admin] PATH_INFO: `/v3/projects` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:36.408508 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c734d1-7b93-4fbf-b018-2878aa3f368f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:36.423437 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c734d1-7b93-4fbf-b018-2878aa3f368f admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:36.504299 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 889/1779] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 14 17:55:36 2022] POST /identity/v3/projects => generated 385 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:55:36.505614 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ba309d-b164-4212-96a0-c436662d7c48 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:36.527096 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ba309d-b164-4212-96a0-c436662d7c48 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:36.735053 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9106c100-8c4f-45fb-80ec-c2196d892f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:36.735831 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9106c100-8c4f-45fb-80ec-c2196d892f6a admin admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:36.736940 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9106c100-8c4f-45fb-80ec-c2196d892f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:36.737224 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9106c100-8c4f-45fb-80ec-c2196d892f6a admin admin] PATH_INFO: `/v3/users` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:36.737990 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9106c100-8c4f-45fb-80ec-c2196d892f6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:36.740527 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9106c100-8c4f-45fb-80ec-c2196d892f6a admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:36.803271 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 891/1780] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 14 17:55:36 2022] POST /identity/v3/users => generated 299 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 17:55:36.805229 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c734d1-7b93-4fbf-b018-2878aa3f368f admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:36.843812 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c734d1-7b93-4fbf-b018-2878aa3f368f admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:36.864208 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2ba46a-91d6-474e-a290-40f244b72d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:36.864912 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ba46a-91d6-474e-a290-40f244b72d8f admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:36.865194 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ba46a-91d6-474e-a290-40f244b72d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:36.865657 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ba46a-91d6-474e-a290-40f244b72d8f admin admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:36.866780 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2ba46a-91d6-474e-a290-40f244b72d8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:36.870954 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2ba46a-91d6-474e-a290-40f244b72d8f admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:36.925380 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 890/1781] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:55:36 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:55:36.929929 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9106c100-8c4f-45fb-80ec-c2196d892f6a admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:36.956702 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9106c100-8c4f-45fb-80ec-c2196d892f6a admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:36.984471 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01897532-2741-4ffb-8159-ac66243c3efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:36.997430 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01897532-2741-4ffb-8159-ac66243c3efb admin admin] REQUEST_METHOD: `PUT` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:36.997996 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01897532-2741-4ffb-8159-ac66243c3efb admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:37.000672 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01897532-2741-4ffb-8159-ac66243c3efb admin admin] PATH_INFO: `/v3/projects/841e0f068cd846d19a719b43cc79cb86/users/9db89f308f4d49e3ad9fc29de1bf0006/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:37.078624 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01897532-2741-4ffb-8159-ac66243c3efb admin admin] RBAC: Authorizing `identity:create_grant(project_id=841e0f068cd846d19a719b43cc79cb86, user_id=9db89f308f4d49e3ad9fc29de1bf0006, role_id=4651a1cc7b4d4ab7a7a9ca1e77e58e71)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:37.081449 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01897532-2741-4ffb-8159-ac66243c3efb admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:37.114069 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 892/1782] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 17:55:36 2022] PUT /identity/v3/projects/841e0f068cd846d19a719b43cc79cb86/users/9db89f308f4d49e3ad9fc29de1bf0006/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 17:55:37.115337 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2ba46a-91d6-474e-a290-40f244b72d8f admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:37.135638 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2ba46a-91d6-474e-a290-40f244b72d8f admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:37.328779 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10546077-598c-4542-8f44-0ef1b602df8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:37.340340 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10546077-598c-4542-8f44-0ef1b602df8d admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:37.340752 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10546077-598c-4542-8f44-0ef1b602df8d admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:37.341183 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10546077-598c-4542-8f44-0ef1b602df8d admin admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:37.344512 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10546077-598c-4542-8f44-0ef1b602df8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:37.354377 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10546077-598c-4542-8f44-0ef1b602df8d admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:37.402590 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01897532-2741-4ffb-8159-ac66243c3efb admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:37.403596 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 891/1783] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:55:37 2022] GET /identity/v3/roles => generated 1420 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:55:37.433267 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01897532-2741-4ffb-8159-ac66243c3efb admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:37.456403 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ce1646-fe5b-48a2-a20b-145a355371ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:37.460185 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ce1646-fe5b-48a2-a20b-145a355371ee admin admin] REQUEST_METHOD: `PUT` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:37.478092 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ce1646-fe5b-48a2-a20b-145a355371ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:37.479316 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ce1646-fe5b-48a2-a20b-145a355371ee admin admin] PATH_INFO: `/v3/projects/841e0f068cd846d19a719b43cc79cb86/users/9db89f308f4d49e3ad9fc29de1bf0006/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:37.499085 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ce1646-fe5b-48a2-a20b-145a355371ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=841e0f068cd846d19a719b43cc79cb86, user_id=9db89f308f4d49e3ad9fc29de1bf0006, role_id=4651a1cc7b4d4ab7a7a9ca1e77e58e71)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:37.503554 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ce1646-fe5b-48a2-a20b-145a355371ee admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:37.572532 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d6eb2-fba1-4a58-9bc3-f43979d6bb24 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:37.572819 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d6eb2-fba1-4a58-9bc3-f43979d6bb24 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:37.573461 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d6eb2-fba1-4a58-9bc3-f43979d6bb24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:37.592696 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 893/1784] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 17:55:37 2022] PUT /identity/v3/projects/841e0f068cd846d19a719b43cc79cb86/users/9db89f308f4d49e3ad9fc29de1bf0006/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:55:37.720554 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:55:37.768598 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-745d6eb2-fba1-4a58-9bc3-f43979d6bb24 None None] MFA Rules not processed for user `9db89f308f4d49e3ad9fc29de1bf0006`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:55:37.784674 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-745d6eb2-fba1-4a58-9bc3-f43979d6bb24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:37.807779 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac69e3-ab24-4422-ac57-ac130fb7c8d9 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:37.808827 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac69e3-ab24-4422-ac57-ac130fb7c8d9 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:37.809965 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac69e3-ab24-4422-ac57-ac130fb7c8d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:38.076200 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-3cac69e3-ab24-4422-ac57-ac130fb7c8d9 None None] MFA Rules not processed for user `45542602225b452fa323f5499c1843ec`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:55:38.089209 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-3cac69e3-ab24-4422-ac57-ac130fb7c8d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:38.116522 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 892/1785] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:55:37 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 545 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:55:38.131142 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745d6eb2-fba1-4a58-9bc3-f43979d6bb24 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:38.132799 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-745d6eb2-fba1-4a58-9bc3-f43979d6bb24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:38.401879 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745d6eb2-fba1-4a58-9bc3-f43979d6bb24 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:38.414081 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a671d3-dacf-4e40-8070-55aa1b618e6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de55cae1600841889668e36402861203', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:38.414816 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 894/1786] 10.222.0.67 () {58 vars in 1009 bytes} [Thu Jul 14 17:55:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 608 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 17:55:38.422395 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a671d3-dacf-4e40-8070-55aa1b618e6c service cinder] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:38.423373 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a671d3-dacf-4e40-8070-55aa1b618e6c service cinder] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:38.423984 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a671d3-dacf-4e40-8070-55aa1b618e6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:38.474940 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a671d3-dacf-4e40-8070-55aa1b618e6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:38.487684 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a671d3-dacf-4e40-8070-55aa1b618e6c service cinder] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:38.527276 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 893/1787] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:55:38 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:55:38.561686 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac69e3-ab24-4422-ac57-ac130fb7c8d9 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:38.622775 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:55:38.789273 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a671d3-dacf-4e40-8070-55aa1b618e6c service cinder] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:38.792396 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-19a671d3-dacf-4e40-8070-55aa1b618e6c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:38.862237 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac69e3-ab24-4422-ac57-ac130fb7c8d9 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:38.876024 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091611ac-311f-4070-ae90-095ace651848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:38.883577 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091611ac-311f-4070-ae90-095ace651848 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:38.883955 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091611ac-311f-4070-ae90-095ace651848 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:38.884312 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091611ac-311f-4070-ae90-095ace651848 admin admin] PATH_INFO: `/v3/users/d42c9952b9a34126b86b952b3a3eec01` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:38.886710 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091611ac-311f-4070-ae90-095ace651848 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d42c9952b9a34126b86b952b3a3eec01)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:38.891922 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091611ac-311f-4070-ae90-095ace651848 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:39.094275 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-091611ac-311f-4070-ae90-095ace651848 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd42c9952b9a34126b86b952b3a3eec01'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:39.134157 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-091611ac-311f-4070-ae90-095ace651848 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd42c9952b9a34126b86b952b3a3eec01'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:39.199019 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-091611ac-311f-4070-ae90-095ace651848 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd42c9952b9a34126b86b952b3a3eec01'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:39.200005 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-091611ac-311f-4070-ae90-095ace651848 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd42c9952b9a34126b86b952b3a3eec01'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:39.202324 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-091611ac-311f-4070-ae90-095ace651848 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd42c9952b9a34126b86b952b3a3eec01'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:39.223142 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a671d3-dacf-4e40-8070-55aa1b618e6c service cinder] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:39.233366 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f63db9b-b17a-4012-802f-6601d20e8855 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c65607a396474192a43c374d306ef5ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:39.235384 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f63db9b-b17a-4012-802f-6601d20e8855 service swift] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:39.235891 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f63db9b-b17a-4012-802f-6601d20e8855 service swift] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:39.236385 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f63db9b-b17a-4012-802f-6601d20e8855 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:39.241174 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-7f63db9b-b17a-4012-802f-6601d20e8855 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:39.241857 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 895/1788] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 14 17:55:38 2022] DELETE /identity/v3/users/d42c9952b9a34126b86b952b3a3eec01 => generated 0 bytes in 681 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:55:39.243313 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091611ac-311f-4070-ae90-095ace651848 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:39.251905 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-091611ac-311f-4070-ae90-095ace651848 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:39.320426 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f63db9b-b17a-4012-802f-6601d20e8855 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:39.331384 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f63db9b-b17a-4012-802f-6601d20e8855 service swift] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:39.408062 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091611ac-311f-4070-ae90-095ace651848 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:39.425329 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58acb92f-0dce-426e-8e3e-ff3d48f6584d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de55cae1600841889668e36402861203', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:39.426234 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58acb92f-0dce-426e-8e3e-ff3d48f6584d service cinder] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:39.426808 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58acb92f-0dce-426e-8e3e-ff3d48f6584d service cinder] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:39.427168 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58acb92f-0dce-426e-8e3e-ff3d48f6584d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:39.430843 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-58acb92f-0dce-426e-8e3e-ff3d48f6584d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:39.477700 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 894/1789] 10.222.0.67 () {60 vars in 1384 bytes} [Thu Jul 14 17:55:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 690 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 17:55:39.488952 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db79b3e-2174-4250-b315-4442ff95f395 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:39.489812 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db79b3e-2174-4250-b315-4442ff95f395 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:39.490296 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db79b3e-2174-4250-b315-4442ff95f395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:39.537713 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:55:39.554740 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-6db79b3e-2174-4250-b315-4442ff95f395 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:55:39.559814 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-6db79b3e-2174-4250-b315-4442ff95f395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:39.676234 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:55:39.737163 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58acb92f-0dce-426e-8e3e-ff3d48f6584d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:39.742622 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58acb92f-0dce-426e-8e3e-ff3d48f6584d service cinder] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:39.823530 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 895/1790] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:55:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:55:39.823942 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 896/1791] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:55:39 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 581 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:55:39.833307 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede82878-9173-4539-b3f0-1c85e2d93205 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:39.835739 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede82878-9173-4539-b3f0-1c85e2d93205 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:39.837876 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede82878-9173-4539-b3f0-1c85e2d93205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:39.914155 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-ede82878-9173-4539-b3f0-1c85e2d93205 None None] MFA Rules not processed for user `7bda83c5499f43f9838fda2679a522d4`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:55:39.915608 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-ede82878-9173-4539-b3f0-1c85e2d93205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:40.174464 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 896/1792] 10.222.0.40 () {58 vars in 1015 bytes} [Thu Jul 14 17:55:39 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:55:40.291750 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58acb92f-0dce-426e-8e3e-ff3d48f6584d service cinder] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:40.293908 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-58acb92f-0dce-426e-8e3e-ff3d48f6584d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:40.309866 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede82878-9173-4539-b3f0-1c85e2d93205 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:40.311448 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-ede82878-9173-4539-b3f0-1c85e2d93205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:40.345793 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede82878-9173-4539-b3f0-1c85e2d93205 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:40.347984 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58acb92f-0dce-426e-8e3e-ff3d48f6584d service cinder] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:40.363850 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c7a8a2-2ce7-4aa0-898c-ce2ae1119c98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:40.368049 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c7a8a2-2ce7-4aa0-898c-ce2ae1119c98 service neutron] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:40.368363 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c7a8a2-2ce7-4aa0-898c-ce2ae1119c98 service neutron] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:40.368648 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c7a8a2-2ce7-4aa0-898c-ce2ae1119c98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:40.374161 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e45599c-4eb6-453c-b38c-07cf39b368c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:40.379802 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45599c-4eb6-453c-b38c-07cf39b368c0 service neutron] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:40.380361 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45599c-4eb6-453c-b38c-07cf39b368c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:40.380801 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45599c-4eb6-453c-b38c-07cf39b368c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:40.416053 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e45599c-4eb6-453c-b38c-07cf39b368c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:40.417788 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e45599c-4eb6-453c-b38c-07cf39b368c0 service neutron] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:40.424039 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c7a8a2-2ce7-4aa0-898c-ce2ae1119c98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:40.426379 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c7a8a2-2ce7-4aa0-898c-ce2ae1119c98 service neutron] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:40.458903 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 897/1793] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:55:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:55:40.462160 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e45599c-4eb6-453c-b38c-07cf39b368c0 service neutron] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:40.467562 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-6e45599c-4eb6-453c-b38c-07cf39b368c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:40.499048 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 897/1794] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:55:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 17:55:40.518791 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e45599c-4eb6-453c-b38c-07cf39b368c0 service neutron] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:40.534705 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e04db2-6971-4f08-8935-97a3fa28d7f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:40.536103 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e04db2-6971-4f08-8935-97a3fa28d7f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:40.537050 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e04db2-6971-4f08-8935-97a3fa28d7f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:40.537599 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e04db2-6971-4f08-8935-97a3fa28d7f0 admin admin] PATH_INFO: `/v3/users/e15d70de553646a0b313d74adc1daced` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:40.540691 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e04db2-6971-4f08-8935-97a3fa28d7f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e15d70de553646a0b313d74adc1daced)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:40.543379 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e04db2-6971-4f08-8935-97a3fa28d7f0 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:40.692996 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-29e04db2-6971-4f08-8935-97a3fa28d7f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e15d70de553646a0b313d74adc1daced'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:40.711551 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-29e04db2-6971-4f08-8935-97a3fa28d7f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e15d70de553646a0b313d74adc1daced'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:40.788121 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-29e04db2-6971-4f08-8935-97a3fa28d7f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e15d70de553646a0b313d74adc1daced'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:40.793236 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-29e04db2-6971-4f08-8935-97a3fa28d7f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e15d70de553646a0b313d74adc1daced'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:40.797378 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-29e04db2-6971-4f08-8935-97a3fa28d7f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e15d70de553646a0b313d74adc1daced'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:40.865908 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 898/1795] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 14 17:55:40 2022] DELETE /identity/v3/users/e15d70de553646a0b313d74adc1daced => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:55:40.872070 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ffdd8-207c-4691-814d-fe9aed9ef868 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:40.872355 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ffdd8-207c-4691-814d-fe9aed9ef868 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:40.872637 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ffdd8-207c-4691-814d-fe9aed9ef868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:40.946312 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-006ffdd8-207c-4691-814d-fe9aed9ef868 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:55:40.950101 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-006ffdd8-207c-4691-814d-fe9aed9ef868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:41.265867 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 898/1796] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:55:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 395 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:55:41.455932 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e04db2-6971-4f08-8935-97a3fa28d7f0 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:41.456094 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-29e04db2-6971-4f08-8935-97a3fa28d7f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:41.679017 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e04db2-6971-4f08-8935-97a3fa28d7f0 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:41.687116 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edc8e69-1c93-4635-acb4-bf6f0186b596 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:41.687819 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc8e69-1c93-4635-acb4-bf6f0186b596 service neutron] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:41.688111 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc8e69-1c93-4635-acb4-bf6f0186b596 service neutron] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:41.688520 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc8e69-1c93-4635-acb4-bf6f0186b596 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:41.714441 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edc8e69-1c93-4635-acb4-bf6f0186b596 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:41.716381 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edc8e69-1c93-4635-acb4-bf6f0186b596 service neutron] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:41.764867 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 899/1797] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:55:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:55:43.706521 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006ffdd8-207c-4691-814d-fe9aed9ef868 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:43.708742 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-006ffdd8-207c-4691-814d-fe9aed9ef868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:43.734424 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006ffdd8-207c-4691-814d-fe9aed9ef868 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:43.750987 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc6e131-69ca-4784-8630-417939f9a74c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:43.752255 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc6e131-69ca-4784-8630-417939f9a74c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:43.752740 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc6e131-69ca-4784-8630-417939f9a74c admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:43.753213 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc6e131-69ca-4784-8630-417939f9a74c admin admin] PATH_INFO: `/v3/projects/e7b858e44c7940bd9ff736b69cd64b08` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:43.754820 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc6e131-69ca-4784-8630-417939f9a74c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7b858e44c7940bd9ff736b69cd64b08)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:43.757231 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc6e131-69ca-4784-8630-417939f9a74c admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:43.882630 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:55:43.905264 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-fcc6e131-69ca-4784-8630-417939f9a74c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7b858e44c7940bd9ff736b69cd64b08', 'request_id': 'req-fcc6e131-69ca-4784-8630-417939f9a74c'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:43.925629 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-fcc6e131-69ca-4784-8630-417939f9a74c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7b858e44c7940bd9ff736b69cd64b08', 'request_id': 'req-fcc6e131-69ca-4784-8630-417939f9a74c'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:43.945518 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-fcc6e131-69ca-4784-8630-417939f9a74c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7b858e44c7940bd9ff736b69cd64b08', 'request_id': 'req-fcc6e131-69ca-4784-8630-417939f9a74c'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:43.987036 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-fcc6e131-69ca-4784-8630-417939f9a74c admin admin] The token cache is being invalidate because project e7b858e44c7940bd9ff736b69cd64b08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86772) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 17:55:43.988863 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-fcc6e131-69ca-4784-8630-417939f9a74c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:43.991915 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-fcc6e131-69ca-4784-8630-417939f9a74c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:43.997024 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 899/1798] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 14 17:55:43 2022] DELETE /identity/v3/projects/e7b858e44c7940bd9ff736b69cd64b08 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:55:44.001866 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edc8e69-1c93-4635-acb4-bf6f0186b596 service neutron] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:44.024604 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edc8e69-1c93-4635-acb4-bf6f0186b596 service neutron] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:44.153783 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:55:44.183462 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d715864c-8955-42e6-8bf7-c96fbf603081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:44.188822 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d715864c-8955-42e6-8bf7-c96fbf603081 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:44.199372 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d715864c-8955-42e6-8bf7-c96fbf603081 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:44.199372 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d715864c-8955-42e6-8bf7-c96fbf603081 admin admin] PATH_INFO: `/v3/users/9db89f308f4d49e3ad9fc29de1bf0006` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:44.199372 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d715864c-8955-42e6-8bf7-c96fbf603081 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9db89f308f4d49e3ad9fc29de1bf0006)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:44.201399 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d715864c-8955-42e6-8bf7-c96fbf603081 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:44.361180 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-d715864c-8955-42e6-8bf7-c96fbf603081 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9db89f308f4d49e3ad9fc29de1bf0006'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:44.386372 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-d715864c-8955-42e6-8bf7-c96fbf603081 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9db89f308f4d49e3ad9fc29de1bf0006'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:44.415833 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-d715864c-8955-42e6-8bf7-c96fbf603081 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9db89f308f4d49e3ad9fc29de1bf0006'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:44.419287 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-d715864c-8955-42e6-8bf7-c96fbf603081 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9db89f308f4d49e3ad9fc29de1bf0006'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:44.421167 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-d715864c-8955-42e6-8bf7-c96fbf603081 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9db89f308f4d49e3ad9fc29de1bf0006'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:44.448792 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 900/1799] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 14 17:55:44 2022] DELETE /identity/v3/users/9db89f308f4d49e3ad9fc29de1bf0006 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:55:44.561830 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc6e131-69ca-4784-8630-417939f9a74c admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:44.563377 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-fcc6e131-69ca-4784-8630-417939f9a74c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:44.582912 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc6e131-69ca-4784-8630-417939f9a74c admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:44.952722 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83df8cf-9dd5-4612-ab75-0dd710521ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:44.960352 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83df8cf-9dd5-4612-ab75-0dd710521ae9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:44.962217 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83df8cf-9dd5-4612-ab75-0dd710521ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:44.964667 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83df8cf-9dd5-4612-ab75-0dd710521ae9 admin admin] PATH_INFO: `/v3/users/be0e51cb46314248bd62c11697401640` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:44.978585 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83df8cf-9dd5-4612-ab75-0dd710521ae9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be0e51cb46314248bd62c11697401640)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:44.988295 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83df8cf-9dd5-4612-ab75-0dd710521ae9 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:45.107371 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-a83df8cf-9dd5-4612-ab75-0dd710521ae9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be0e51cb46314248bd62c11697401640'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:45.120144 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-a83df8cf-9dd5-4612-ab75-0dd710521ae9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be0e51cb46314248bd62c11697401640'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:45.139278 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-a83df8cf-9dd5-4612-ab75-0dd710521ae9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be0e51cb46314248bd62c11697401640'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:45.140047 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-a83df8cf-9dd5-4612-ab75-0dd710521ae9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be0e51cb46314248bd62c11697401640'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:45.177521 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-a83df8cf-9dd5-4612-ab75-0dd710521ae9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be0e51cb46314248bd62c11697401640'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:45.222553 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 900/1800] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 14 17:55:44 2022] DELETE /identity/v3/users/be0e51cb46314248bd62c11697401640 => generated 0 bytes in 661 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:55:45.227003 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6c369c-3949-4cfa-9459-61906f798901 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:45.227496 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6c369c-3949-4cfa-9459-61906f798901 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:45.227719 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6c369c-3949-4cfa-9459-61906f798901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:45.260192 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-8a6c369c-3949-4cfa-9459-61906f798901 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:55:45.266583 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-8a6c369c-3949-4cfa-9459-61906f798901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:45.438150 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 901/1801] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:55:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 17:55:45.499574 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83df8cf-9dd5-4612-ab75-0dd710521ae9 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:45.501133 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-a83df8cf-9dd5-4612-ab75-0dd710521ae9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:45.667108 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:55:45.686731 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83df8cf-9dd5-4612-ab75-0dd710521ae9 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:45.714291 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d492cc-317c-4230-93cb-938bdb5b27bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:45.717504 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d492cc-317c-4230-93cb-938bdb5b27bf service neutron] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:45.718904 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d492cc-317c-4230-93cb-938bdb5b27bf service neutron] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:45.720399 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d492cc-317c-4230-93cb-938bdb5b27bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:45.750125 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d492cc-317c-4230-93cb-938bdb5b27bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:45.752195 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d492cc-317c-4230-93cb-938bdb5b27bf service neutron] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:45.797355 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 901/1802] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:55:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:55:46.251825 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6c369c-3949-4cfa-9459-61906f798901 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:46.255028 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-8a6c369c-3949-4cfa-9459-61906f798901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:46.302702 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6c369c-3949-4cfa-9459-61906f798901 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:46.316437 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c419bb7-7620-43fa-b23f-634e4bc1e367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:46.318780 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c419bb7-7620-43fa-b23f-634e4bc1e367 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:46.319598 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c419bb7-7620-43fa-b23f-634e4bc1e367 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:46.320379 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c419bb7-7620-43fa-b23f-634e4bc1e367 admin admin] PATH_INFO: `/v3/projects/841e0f068cd846d19a719b43cc79cb86` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:46.324566 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c419bb7-7620-43fa-b23f-634e4bc1e367 admin admin] RBAC: Authorizing `identity:delete_project(project_id=841e0f068cd846d19a719b43cc79cb86)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:46.330170 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c419bb7-7620-43fa-b23f-634e4bc1e367 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:46.474188 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-7c419bb7-7620-43fa-b23f-634e4bc1e367 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '841e0f068cd846d19a719b43cc79cb86', 'request_id': 'req-7c419bb7-7620-43fa-b23f-634e4bc1e367'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:46.494053 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-7c419bb7-7620-43fa-b23f-634e4bc1e367 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '841e0f068cd846d19a719b43cc79cb86', 'request_id': 'req-7c419bb7-7620-43fa-b23f-634e4bc1e367'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:46.523559 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-7c419bb7-7620-43fa-b23f-634e4bc1e367 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '841e0f068cd846d19a719b43cc79cb86', 'request_id': 'req-7c419bb7-7620-43fa-b23f-634e4bc1e367'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:46.532243 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:55:46.558076 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-7c419bb7-7620-43fa-b23f-634e4bc1e367 admin admin] The token cache is being invalidate because project 841e0f068cd846d19a719b43cc79cb86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86773) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 17:55:46.558598 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-7c419bb7-7620-43fa-b23f-634e4bc1e367 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:46.559657 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-7c419bb7-7620-43fa-b23f-634e4bc1e367 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:46.565970 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 902/1803] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 14 17:55:46 2022] DELETE /identity/v3/projects/841e0f068cd846d19a719b43cc79cb86 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:55:46.567474 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857eb130-d80b-4a76-b647-1b681632bad2 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:46.568011 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857eb130-d80b-4a76-b647-1b681632bad2 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:46.568011 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857eb130-d80b-4a76-b647-1b681632bad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:46.612486 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-857eb130-d80b-4a76-b647-1b681632bad2 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:55:46.615469 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-857eb130-d80b-4a76-b647-1b681632bad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:46.846563 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 902/1804] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:55:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:55:46.849014 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc8d24c-64a4-4a9f-bfd7-a8425c126478 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:46.849633 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc8d24c-64a4-4a9f-bfd7-a8425c126478 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:46.852928 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc8d24c-64a4-4a9f-bfd7-a8425c126478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:46.883909 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-4cc8d24c-64a4-4a9f-bfd7-a8425c126478 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:55:46.886884 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-4cc8d24c-64a4-4a9f-bfd7-a8425c126478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:46.911426 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 903/1805] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:55:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:55:46.911976 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857eb130-d80b-4a76-b647-1b681632bad2 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:46.925516 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857eb130-d80b-4a76-b647-1b681632bad2 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:46.940325 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc600dcf-1cca-4f3d-9317-2a5dd45fe1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:46.942370 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc600dcf-1cca-4f3d-9317-2a5dd45fe1c7 admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:46.944581 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc600dcf-1cca-4f3d-9317-2a5dd45fe1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:46.945702 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc600dcf-1cca-4f3d-9317-2a5dd45fe1c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:46.946697 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc600dcf-1cca-4f3d-9317-2a5dd45fe1c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:55:46.948617 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc600dcf-1cca-4f3d-9317-2a5dd45fe1c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:46.951394 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc600dcf-1cca-4f3d-9317-2a5dd45fe1c7 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:46.990014 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 903/1806] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 14 17:55:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:55:46.993993 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc8d24c-64a4-4a9f-bfd7-a8425c126478 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:47.034801 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc8d24c-64a4-4a9f-bfd7-a8425c126478 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:47.054937 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f0d065-cc62-4d41-9205-f8f942f5cee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:47.066050 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f0d065-cc62-4d41-9205-f8f942f5cee3 admin admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:47.066703 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f0d065-cc62-4d41-9205-f8f942f5cee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:47.067129 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f0d065-cc62-4d41-9205-f8f942f5cee3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:47.068341 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f0d065-cc62-4d41-9205-f8f942f5cee3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:47.075424 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f0d065-cc62-4d41-9205-f8f942f5cee3 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:47.214970 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 904/1807] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 14 17:55:46 2022] POST /identity/v3/projects => generated 381 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:55:47.219295 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc600dcf-1cca-4f3d-9317-2a5dd45fe1c7 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:47.262188 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc600dcf-1cca-4f3d-9317-2a5dd45fe1c7 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:47.384221 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c50a7c5-aed8-4dda-b186-f70b85bef86c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:47.386256 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c50a7c5-aed8-4dda-b186-f70b85bef86c admin admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:47.387456 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c50a7c5-aed8-4dda-b186-f70b85bef86c admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:47.388068 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c50a7c5-aed8-4dda-b186-f70b85bef86c admin admin] PATH_INFO: `/v3/users` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:47.390006 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c50a7c5-aed8-4dda-b186-f70b85bef86c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:47.399473 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c50a7c5-aed8-4dda-b186-f70b85bef86c admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:47.444263 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 904/1808] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 14 17:55:47 2022] POST /identity/v3/users => generated 291 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:55:47.446740 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f0d065-cc62-4d41-9205-f8f942f5cee3 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:47.513520 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f0d065-cc62-4d41-9205-f8f942f5cee3 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:47.540888 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3428be7-9198-4105-b05b-5a7304a1ad3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:47.543235 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3428be7-9198-4105-b05b-5a7304a1ad3a admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:47.544027 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3428be7-9198-4105-b05b-5a7304a1ad3a admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:47.545180 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3428be7-9198-4105-b05b-5a7304a1ad3a admin admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:47.552071 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3428be7-9198-4105-b05b-5a7304a1ad3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:47.561395 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3428be7-9198-4105-b05b-5a7304a1ad3a admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:47.581499 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 905/1809] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:55:47 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:55:47.585519 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c50a7c5-aed8-4dda-b186-f70b85bef86c admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:47.615656 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c50a7c5-aed8-4dda-b186-f70b85bef86c admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:47.626928 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0905785-f737-4742-b699-6d3f4a264354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:47.628803 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0905785-f737-4742-b699-6d3f4a264354 admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:47.629899 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0905785-f737-4742-b699-6d3f4a264354 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:47.630687 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0905785-f737-4742-b699-6d3f4a264354 admin admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:47.668424 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0905785-f737-4742-b699-6d3f4a264354 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:47.686526 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0905785-f737-4742-b699-6d3f4a264354 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:47.739527 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 905/1810] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:55:47 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:55:47.744712 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3428be7-9198-4105-b05b-5a7304a1ad3a admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:47.761608 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3428be7-9198-4105-b05b-5a7304a1ad3a admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:47.770443 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4f71bc-295d-4674-b859-d6c39cff32ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:47.772289 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f71bc-295d-4674-b859-d6c39cff32ca admin admin] REQUEST_METHOD: `PUT` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:47.773243 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f71bc-295d-4674-b859-d6c39cff32ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:47.773808 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f71bc-295d-4674-b859-d6c39cff32ca admin admin] PATH_INFO: `/v3/projects/bb001cfb301d431d83314fcdeb2870fd/users/9de4bd1127e845ebabb813d2b6221e5f/roles/95d753870f97426cb1ce32e078621a4c` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:47.820993 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4f71bc-295d-4674-b859-d6c39cff32ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb001cfb301d431d83314fcdeb2870fd, user_id=9de4bd1127e845ebabb813d2b6221e5f, role_id=95d753870f97426cb1ce32e078621a4c)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:47.831607 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4f71bc-295d-4674-b859-d6c39cff32ca admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:47.887088 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 906/1811] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 17:55:47 2022] PUT /identity/v3/projects/bb001cfb301d431d83314fcdeb2870fd/users/9de4bd1127e845ebabb813d2b6221e5f/roles/95d753870f97426cb1ce32e078621a4c => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 17:55:47.896438 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097b7db0-645e-41d7-9e63-6656d2d5a78c None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:47.897281 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097b7db0-645e-41d7-9e63-6656d2d5a78c None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:47.898112 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097b7db0-645e-41d7-9e63-6656d2d5a78c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:48.011630 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-097b7db0-645e-41d7-9e63-6656d2d5a78c None None] MFA Rules not processed for user `9de4bd1127e845ebabb813d2b6221e5f`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:55:48.012947 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-097b7db0-645e-41d7-9e63-6656d2d5a78c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:48.127640 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:55:48.224459 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 906/1812] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:55:47 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:55:48.226621 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4f71bc-295d-4674-b859-d6c39cff32ca admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:48.625461 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4f71bc-295d-4674-b859-d6c39cff32ca admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:48.637278 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097b7db0-645e-41d7-9e63-6656d2d5a78c None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:48.640070 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-097b7db0-645e-41d7-9e63-6656d2d5a78c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:48.668234 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3125cd4-7c6b-4772-8a3b-533a675fdae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:48.671055 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3125cd4-7c6b-4772-8a3b-533a675fdae0 admin admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:48.671400 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3125cd4-7c6b-4772-8a3b-533a675fdae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:48.671688 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3125cd4-7c6b-4772-8a3b-533a675fdae0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:48.672449 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3125cd4-7c6b-4772-8a3b-533a675fdae0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:48.674536 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3125cd4-7c6b-4772-8a3b-533a675fdae0 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:48.677340 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097b7db0-645e-41d7-9e63-6656d2d5a78c None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:48.693903 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde2ec2e-9dfa-4cfa-bef3-9c782d927208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:48.694859 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde2ec2e-9dfa-4cfa-bef3-9c782d927208 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:48.695150 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde2ec2e-9dfa-4cfa-bef3-9c782d927208 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:48.695439 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde2ec2e-9dfa-4cfa-bef3-9c782d927208 admin admin] PATH_INFO: `/v3/projects/436d4cf58e7b4836bb6cc4c9548d9240` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:48.705919 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde2ec2e-9dfa-4cfa-bef3-9c782d927208 admin admin] RBAC: Authorizing `identity:delete_project(project_id=436d4cf58e7b4836bb6cc4c9548d9240)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:48.708207 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde2ec2e-9dfa-4cfa-bef3-9c782d927208 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:48.798025 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 907/1813] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 14 17:55:48 2022] POST /identity/v3/projects => generated 379 bytes in 573 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:55:48.805064 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3125cd4-7c6b-4772-8a3b-533a675fdae0 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:48.807731 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-dde2ec2e-9dfa-4cfa-bef3-9c782d927208 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '436d4cf58e7b4836bb6cc4c9548d9240', 'request_id': 'req-dde2ec2e-9dfa-4cfa-bef3-9c782d927208'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:48.874884 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-dde2ec2e-9dfa-4cfa-bef3-9c782d927208 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '436d4cf58e7b4836bb6cc4c9548d9240', 'request_id': 'req-dde2ec2e-9dfa-4cfa-bef3-9c782d927208'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:48.906124 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-dde2ec2e-9dfa-4cfa-bef3-9c782d927208 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '436d4cf58e7b4836bb6cc4c9548d9240', 'request_id': 'req-dde2ec2e-9dfa-4cfa-bef3-9c782d927208'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:48.971159 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-dde2ec2e-9dfa-4cfa-bef3-9c782d927208 admin admin] The token cache is being invalidate because project 436d4cf58e7b4836bb6cc4c9548d9240 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86772) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 17:55:48.971644 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-dde2ec2e-9dfa-4cfa-bef3-9c782d927208 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:48.973241 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-dde2ec2e-9dfa-4cfa-bef3-9c782d927208 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:48.984609 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 907/1814] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 14 17:55:48 2022] DELETE /identity/v3/projects/436d4cf58e7b4836bb6cc4c9548d9240 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:55:48.989333 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3125cd4-7c6b-4772-8a3b-533a675fdae0 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:48.993951 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde2ec2e-9dfa-4cfa-bef3-9c782d927208 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:48.998724 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-dde2ec2e-9dfa-4cfa-bef3-9c782d927208 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:49.026695 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc230a0c-b58b-4d31-b073-dea3f628b88d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:49.027429 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc230a0c-b58b-4d31-b073-dea3f628b88d admin admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:49.027723 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc230a0c-b58b-4d31-b073-dea3f628b88d admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:49.028006 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc230a0c-b58b-4d31-b073-dea3f628b88d admin admin] PATH_INFO: `/v3/users` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:49.028779 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc230a0c-b58b-4d31-b073-dea3f628b88d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:49.031634 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc230a0c-b58b-4d31-b073-dea3f628b88d admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:49.086996 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 908/1815] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 14 17:55:48 2022] POST /identity/v3/users => generated 296 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:55:49.091384 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc230a0c-b58b-4d31-b073-dea3f628b88d admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:49.093624 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-bc230a0c-b58b-4d31-b073-dea3f628b88d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:49.112123 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:DELETE=1,keystone:SELECT=93,keystone:INSERT=6 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:55:49.122361 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc230a0c-b58b-4d31-b073-dea3f628b88d admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:49.135904 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aede430-d406-452d-a08a-5db957f862cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:49.136642 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aede430-d406-452d-a08a-5db957f862cf admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:49.137124 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aede430-d406-452d-a08a-5db957f862cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:49.137415 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aede430-d406-452d-a08a-5db957f862cf admin admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:49.138228 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aede430-d406-452d-a08a-5db957f862cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:49.143165 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aede430-d406-452d-a08a-5db957f862cf admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:49.183465 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 909/1816] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:55:49 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 17:55:49.189172 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aede430-d406-452d-a08a-5db957f862cf admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:49.236020 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aede430-d406-452d-a08a-5db957f862cf admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:49.262985 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9436ee7-82eb-40ba-b081-132209ce7a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:49.264119 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9436ee7-82eb-40ba-b081-132209ce7a71 admin admin] REQUEST_METHOD: `PUT` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:49.264523 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9436ee7-82eb-40ba-b081-132209ce7a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:49.264768 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9436ee7-82eb-40ba-b081-132209ce7a71 admin admin] PATH_INFO: `/v3/projects/be34284682b4420882948938ffce549d/users/49dbbdad94db4ac8a84ae0d2857db0d4/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:49.298689 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde2ec2e-9dfa-4cfa-bef3-9c782d927208 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:49.311372 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9436ee7-82eb-40ba-b081-132209ce7a71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be34284682b4420882948938ffce549d, user_id=49dbbdad94db4ac8a84ae0d2857db0d4, role_id=4651a1cc7b4d4ab7a7a9ca1e77e58e71)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:49.315781 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9436ee7-82eb-40ba-b081-132209ce7a71 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:49.322600 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702b03d2-423b-4cdd-89f0-2337b725b833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:49.323940 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b03d2-423b-4cdd-89f0-2337b725b833 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:49.324361 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b03d2-423b-4cdd-89f0-2337b725b833 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:49.324711 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b03d2-423b-4cdd-89f0-2337b725b833 admin admin] PATH_INFO: `/v3/users/828529af40164e94ae02063a47ef0a1f` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:49.327316 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702b03d2-423b-4cdd-89f0-2337b725b833 admin admin] RBAC: Authorizing `identity:delete_user(user_id=828529af40164e94ae02063a47ef0a1f)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:49.330613 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702b03d2-423b-4cdd-89f0-2337b725b833 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:49.352820 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 910/1817] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 17:55:49 2022] PUT /identity/v3/projects/be34284682b4420882948938ffce549d/users/49dbbdad94db4ac8a84ae0d2857db0d4/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:55:49.360948 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9436ee7-82eb-40ba-b081-132209ce7a71 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:49.503789 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-702b03d2-423b-4cdd-89f0-2337b725b833 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '828529af40164e94ae02063a47ef0a1f'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:49.534600 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-702b03d2-423b-4cdd-89f0-2337b725b833 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '828529af40164e94ae02063a47ef0a1f'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:49.553774 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-702b03d2-423b-4cdd-89f0-2337b725b833 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '828529af40164e94ae02063a47ef0a1f'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:49.554722 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-702b03d2-423b-4cdd-89f0-2337b725b833 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '828529af40164e94ae02063a47ef0a1f'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:49.572105 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:55:49.593450 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-702b03d2-423b-4cdd-89f0-2337b725b833 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '828529af40164e94ae02063a47ef0a1f'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:49.608746 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 908/1818] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 14 17:55:48 2022] DELETE /identity/v3/users/828529af40164e94ae02063a47ef0a1f => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:55:49.692703 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9436ee7-82eb-40ba-b081-132209ce7a71 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:49.787536 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57325d9f-f502-444b-b89e-8211b546f48e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:49.788263 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57325d9f-f502-444b-b89e-8211b546f48e admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:49.788591 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57325d9f-f502-444b-b89e-8211b546f48e admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:49.791170 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57325d9f-f502-444b-b89e-8211b546f48e admin admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:49.792226 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57325d9f-f502-444b-b89e-8211b546f48e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:49.795835 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57325d9f-f502-444b-b89e-8211b546f48e admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:49.813576 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 911/1819] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:55:49 2022] GET /identity/v3/roles => generated 1420 bytes in 453 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:55:49.818294 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702b03d2-423b-4cdd-89f0-2337b725b833 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:49.829776 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-702b03d2-423b-4cdd-89f0-2337b725b833 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:49.938017 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702b03d2-423b-4cdd-89f0-2337b725b833 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:49.982330 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baec920-4976-4ede-b86d-54f98e67cc58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:49.990259 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baec920-4976-4ede-b86d-54f98e67cc58 admin admin] REQUEST_METHOD: `PUT` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:49.991260 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baec920-4976-4ede-b86d-54f98e67cc58 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:49.991260 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baec920-4976-4ede-b86d-54f98e67cc58 admin admin] PATH_INFO: `/v3/projects/be34284682b4420882948938ffce549d/users/49dbbdad94db4ac8a84ae0d2857db0d4/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:50.011615 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baec920-4976-4ede-b86d-54f98e67cc58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be34284682b4420882948938ffce549d, user_id=49dbbdad94db4ac8a84ae0d2857db0d4, role_id=4651a1cc7b4d4ab7a7a9ca1e77e58e71)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:50.068355 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baec920-4976-4ede-b86d-54f98e67cc58 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:50.135209 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 909/1820] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 17:55:49 2022] PUT /identity/v3/projects/be34284682b4420882948938ffce549d/users/49dbbdad94db4ac8a84ae0d2857db0d4/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:55:50.149472 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e7f5f-cec5-45c9-bbda-e9a5b2cf988d None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:50.150343 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e7f5f-cec5-45c9-bbda-e9a5b2cf988d None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:50.151573 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e7f5f-cec5-45c9-bbda-e9a5b2cf988d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:50.256208 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-188e7f5f-cec5-45c9-bbda-e9a5b2cf988d None None] MFA Rules not processed for user `49dbbdad94db4ac8a84ae0d2857db0d4`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:55:50.257506 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-188e7f5f-cec5-45c9-bbda-e9a5b2cf988d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:50.363394 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:55:50.381120 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 912/1821] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:55:50 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:55:50.398273 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baec920-4976-4ede-b86d-54f98e67cc58 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:50.400559 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-4baec920-4976-4ede-b86d-54f98e67cc58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:50.555020 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baec920-4976-4ede-b86d-54f98e67cc58 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:50.559841 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc85d5e-4c58-4078-a06f-402226b374ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de55cae1600841889668e36402861203', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:50.560527 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc85d5e-4c58-4078-a06f-402226b374ed service cinder] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:50.560815 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc85d5e-4c58-4078-a06f-402226b374ed service cinder] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:50.561147 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc85d5e-4c58-4078-a06f-402226b374ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:50.588603 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc85d5e-4c58-4078-a06f-402226b374ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:50.590232 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc85d5e-4c58-4078-a06f-402226b374ed service cinder] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:50.613725 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 910/1822] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:55:50 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:55:51.803519 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fb363b-22ec-4634-b2e6-8ced9c769855 None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:51.804023 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fb363b-22ec-4634-b2e6-8ced9c769855 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:51.804251 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fb363b-22ec-4634-b2e6-8ced9c769855 None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:51.808311 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 913/1823] 10.222.0.67 () {54 vars in 921 bytes} [Thu Jul 14 17:55:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:55:51.826456 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc85d5e-4c58-4078-a06f-402226b374ed service cinder] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:51.883053 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc85d5e-4c58-4078-a06f-402226b374ed service cinder] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:51.908391 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ee6adb-32df-4ffe-a4de-182555c0d37f tempest-VolumeQuotaClassesTest-999264891 tempest-VolumeQuotaClassesTest-999264891-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49dbbdad94db4ac8a84ae0d2857db0d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be34284682b4420882948938ffce549d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:51.913215 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee6adb-32df-4ffe-a4de-182555c0d37f tempest-VolumeQuotaClassesTest-999264891 tempest-VolumeQuotaClassesTest-999264891-project-admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:51.915455 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee6adb-32df-4ffe-a4de-182555c0d37f tempest-VolumeQuotaClassesTest-999264891 tempest-VolumeQuotaClassesTest-999264891-project-admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:51.917258 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee6adb-32df-4ffe-a4de-182555c0d37f tempest-VolumeQuotaClassesTest-999264891 tempest-VolumeQuotaClassesTest-999264891-project-admin] PATH_INFO: `/v3/domains` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:51.920258 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ee6adb-32df-4ffe-a4de-182555c0d37f tempest-VolumeQuotaClassesTest-999264891 tempest-VolumeQuotaClassesTest-999264891-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:55:51.920882 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ee6adb-32df-4ffe-a4de-182555c0d37f tempest-VolumeQuotaClassesTest-999264891 tempest-VolumeQuotaClassesTest-999264891-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:51.924031 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ee6adb-32df-4ffe-a4de-182555c0d37f tempest-VolumeQuotaClassesTest-999264891 tempest-VolumeQuotaClassesTest-999264891-project-admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:52.003627 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 911/1824] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 14 17:55:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:55:52.020889 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fb363b-22ec-4634-b2e6-8ced9c769855 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:52.087790 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d92fa5-f872-4f76-aabe-bbf4deb49d7d None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:52.089694 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d92fa5-f872-4f76-aabe-bbf4deb49d7d None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:52.090681 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d92fa5-f872-4f76-aabe-bbf4deb49d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:52.108188 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fb363b-22ec-4634-b2e6-8ced9c769855 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:52.130267 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ea353a-9e68-4369-ab7a-da55f83bec37 tempest-VolumeQuotaClassesTest-999264891 tempest-VolumeQuotaClassesTest-999264891-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49dbbdad94db4ac8a84ae0d2857db0d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be34284682b4420882948938ffce549d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:52.132505 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea353a-9e68-4369-ab7a-da55f83bec37 tempest-VolumeQuotaClassesTest-999264891 tempest-VolumeQuotaClassesTest-999264891-project-admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:52.134286 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea353a-9e68-4369-ab7a-da55f83bec37 tempest-VolumeQuotaClassesTest-999264891 tempest-VolumeQuotaClassesTest-999264891-project-admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:52.136415 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea353a-9e68-4369-ab7a-da55f83bec37 tempest-VolumeQuotaClassesTest-999264891 tempest-VolumeQuotaClassesTest-999264891-project-admin] PATH_INFO: `/v3/projects` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:52.139739 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ea353a-9e68-4369-ab7a-da55f83bec37 tempest-VolumeQuotaClassesTest-999264891 tempest-VolumeQuotaClassesTest-999264891-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:52.144356 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ea353a-9e68-4369-ab7a-da55f83bec37 tempest-VolumeQuotaClassesTest-999264891 tempest-VolumeQuotaClassesTest-999264891-project-admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:52.259905 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-b6d92fa5-f872-4f76-aabe-bbf4deb49d7d None None] MFA Rules not processed for user `41b893bdf4ec474dbfa819c22fc29ce9`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:55:52.264350 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 914/1825] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 14 17:55:52 2022] POST /identity/v3/projects => generated 355 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:55:52.269747 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ea353a-9e68-4369-ab7a-da55f83bec37 tempest-VolumeQuotaClassesTest-999264891 tempest-VolumeQuotaClassesTest-999264891-project-admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:52.272303 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-b6d92fa5-f872-4f76-aabe-bbf4deb49d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:52.465321 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ea353a-9e68-4369-ab7a-da55f83bec37 tempest-VolumeQuotaClassesTest-999264891 tempest-VolumeQuotaClassesTest-999264891-project-admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:52.492179 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5041d058-d4ff-4f37-9b64-d3339ca18777 tempest-VolumeQuotaClassesTest-999264891 tempest-VolumeQuotaClassesTest-999264891-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49dbbdad94db4ac8a84ae0d2857db0d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be34284682b4420882948938ffce549d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:52.493336 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5041d058-d4ff-4f37-9b64-d3339ca18777 tempest-VolumeQuotaClassesTest-999264891 tempest-VolumeQuotaClassesTest-999264891-project-admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:52.493901 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5041d058-d4ff-4f37-9b64-d3339ca18777 tempest-VolumeQuotaClassesTest-999264891 tempest-VolumeQuotaClassesTest-999264891-project-admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:52.494423 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5041d058-d4ff-4f37-9b64-d3339ca18777 tempest-VolumeQuotaClassesTest-999264891 tempest-VolumeQuotaClassesTest-999264891-project-admin] PATH_INFO: `/v3/domains` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:52.495659 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5041d058-d4ff-4f37-9b64-d3339ca18777 tempest-VolumeQuotaClassesTest-999264891 tempest-VolumeQuotaClassesTest-999264891-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:55:52.496234 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5041d058-d4ff-4f37-9b64-d3339ca18777 tempest-VolumeQuotaClassesTest-999264891 tempest-VolumeQuotaClassesTest-999264891-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:52.498183 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5041d058-d4ff-4f37-9b64-d3339ca18777 tempest-VolumeQuotaClassesTest-999264891 tempest-VolumeQuotaClassesTest-999264891-project-admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:52.533358 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 915/1826] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 14 17:55:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:55:52.535396 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e1fec-0c48-4e67-93d5-bee701ad31f1 None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:52.552075 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e1fec-0c48-4e67-93d5-bee701ad31f1 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:52.552638 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e1fec-0c48-4e67-93d5-bee701ad31f1 None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:52.555376 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 916/1827] 10.222.0.67 () {54 vars in 921 bytes} [Thu Jul 14 17:55:52 2022] GET /identity => generated 270 bytes in 21 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:55:52.593792 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62e1fec-0c48-4e67-93d5-bee701ad31f1 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:52.612134 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62e1fec-0c48-4e67-93d5-bee701ad31f1 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:52.620115 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1a5326-97ce-4c71-8d56-f2da4ac388a8 tempest-VolumeQuotaClassesTest-999264891 tempest-VolumeQuotaClassesTest-999264891-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49dbbdad94db4ac8a84ae0d2857db0d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be34284682b4420882948938ffce549d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:52.621463 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a5326-97ce-4c71-8d56-f2da4ac388a8 tempest-VolumeQuotaClassesTest-999264891 tempest-VolumeQuotaClassesTest-999264891-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:52.622048 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a5326-97ce-4c71-8d56-f2da4ac388a8 tempest-VolumeQuotaClassesTest-999264891 tempest-VolumeQuotaClassesTest-999264891-project-admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:52.622551 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a5326-97ce-4c71-8d56-f2da4ac388a8 tempest-VolumeQuotaClassesTest-999264891 tempest-VolumeQuotaClassesTest-999264891-project-admin] PATH_INFO: `/v3/projects/f21e3e8bf02f4c298da23d17396fcbd4` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:52.624499 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1a5326-97ce-4c71-8d56-f2da4ac388a8 tempest-VolumeQuotaClassesTest-999264891 tempest-VolumeQuotaClassesTest-999264891-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f21e3e8bf02f4c298da23d17396fcbd4)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:52.627506 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1a5326-97ce-4c71-8d56-f2da4ac388a8 tempest-VolumeQuotaClassesTest-999264891 tempest-VolumeQuotaClassesTest-999264891-project-admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:52.704539 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 912/1828] 10.222.0.67 () {58 vars in 1018 bytes} [Thu Jul 14 17:55:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 619 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:55:52.715965 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70a8e26-58db-4ff5-bf7e-8be9f52a52d1 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:52.716631 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70a8e26-58db-4ff5-bf7e-8be9f52a52d1 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:52.717261 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70a8e26-58db-4ff5-bf7e-8be9f52a52d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:52.806788 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-2a1a5326-97ce-4c71-8d56-f2da4ac388a8 tempest-VolumeQuotaClassesTest-999264891 tempest-VolumeQuotaClassesTest-999264891-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f21e3e8bf02f4c298da23d17396fcbd4', 'request_id': 'req-2a1a5326-97ce-4c71-8d56-f2da4ac388a8'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:52.825504 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-d70a8e26-58db-4ff5-bf7e-8be9f52a52d1 None None] MFA Rules not processed for user `41b893bdf4ec474dbfa819c22fc29ce9`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:55:52.834912 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-d70a8e26-58db-4ff5-bf7e-8be9f52a52d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:52.847195 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-2a1a5326-97ce-4c71-8d56-f2da4ac388a8 tempest-VolumeQuotaClassesTest-999264891 tempest-VolumeQuotaClassesTest-999264891-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f21e3e8bf02f4c298da23d17396fcbd4', 'request_id': 'req-2a1a5326-97ce-4c71-8d56-f2da4ac388a8'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:52.875052 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-2a1a5326-97ce-4c71-8d56-f2da4ac388a8 tempest-VolumeQuotaClassesTest-999264891 tempest-VolumeQuotaClassesTest-999264891-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f21e3e8bf02f4c298da23d17396fcbd4', 'request_id': 'req-2a1a5326-97ce-4c71-8d56-f2da4ac388a8'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:52.933211 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-2a1a5326-97ce-4c71-8d56-f2da4ac388a8 tempest-VolumeQuotaClassesTest-999264891 tempest-VolumeQuotaClassesTest-999264891-project-admin] The token cache is being invalidate because project f21e3e8bf02f4c298da23d17396fcbd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86773) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 17:55:52.946094 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-2a1a5326-97ce-4c71-8d56-f2da4ac388a8 tempest-VolumeQuotaClassesTest-999264891 tempest-VolumeQuotaClassesTest-999264891-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:52.946094 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-2a1a5326-97ce-4c71-8d56-f2da4ac388a8 tempest-VolumeQuotaClassesTest-999264891 tempest-VolumeQuotaClassesTest-999264891-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:52.946094 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 917/1829] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 14 17:55:52 2022] DELETE /identity/v3/projects/f21e3e8bf02f4c298da23d17396fcbd4 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 17:55:53.078582 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:55:53.125732 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 913/1830] 10.222.0.67 () {58 vars in 1018 bytes} [Thu Jul 14 17:55:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 413 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:55:53.194070 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1a5326-97ce-4c71-8d56-f2da4ac388a8 tempest-VolumeQuotaClassesTest-999264891 tempest-VolumeQuotaClassesTest-999264891-project-admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:53.195961 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-2a1a5326-97ce-4c71-8d56-f2da4ac388a8 tempest-VolumeQuotaClassesTest-999264891 tempest-VolumeQuotaClassesTest-999264891-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:53.351357 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:55:53.352837 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70a8e26-58db-4ff5-bf7e-8be9f52a52d1 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:53.355953 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-d70a8e26-58db-4ff5-bf7e-8be9f52a52d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:53.380470 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1a5326-97ce-4c71-8d56-f2da4ac388a8 tempest-VolumeQuotaClassesTest-999264891 tempest-VolumeQuotaClassesTest-999264891-project-admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:53.393761 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70a8e26-58db-4ff5-bf7e-8be9f52a52d1 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:53.407622 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff884e9-d2e8-48a9-b7af-8d9aa83dad4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:53.408691 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff884e9-d2e8-48a9-b7af-8d9aa83dad4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:53.408976 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff884e9-d2e8-48a9-b7af-8d9aa83dad4f admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:53.409267 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff884e9-d2e8-48a9-b7af-8d9aa83dad4f admin admin] PATH_INFO: `/v3/projects/ec24fbcd652c41df8f55ec6594431e2f` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:53.414378 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff884e9-d2e8-48a9-b7af-8d9aa83dad4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec24fbcd652c41df8f55ec6594431e2f)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:53.417630 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff884e9-d2e8-48a9-b7af-8d9aa83dad4f admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:53.421080 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ed32a0-7e1b-494c-ab96-c2e1415c9128 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41b893bdf4ec474dbfa819c22fc29ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:53.421784 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed32a0-7e1b-494c-ab96-c2e1415c9128 service nova] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:53.422071 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed32a0-7e1b-494c-ab96-c2e1415c9128 service nova] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:53.422338 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed32a0-7e1b-494c-ab96-c2e1415c9128 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:53.433501 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-69ed32a0-7e1b-494c-ab96-c2e1415c9128 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:53.478367 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ed32a0-7e1b-494c-ab96-c2e1415c9128 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:53.480987 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ed32a0-7e1b-494c-ab96-c2e1415c9128 service nova] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:53.499545 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 914/1831] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:55:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:55:53.512796 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ed32a0-7e1b-494c-ab96-c2e1415c9128 service nova] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:53.520336 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-69ed32a0-7e1b-494c-ab96-c2e1415c9128 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:53.552254 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ed32a0-7e1b-494c-ab96-c2e1415c9128 service nova] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:53.574004 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-9ff884e9-d2e8-48a9-b7af-8d9aa83dad4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec24fbcd652c41df8f55ec6594431e2f', 'request_id': 'req-9ff884e9-d2e8-48a9-b7af-8d9aa83dad4f'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:53.587711 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-9ff884e9-d2e8-48a9-b7af-8d9aa83dad4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec24fbcd652c41df8f55ec6594431e2f', 'request_id': 'req-9ff884e9-d2e8-48a9-b7af-8d9aa83dad4f'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:53.605423 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-9ff884e9-d2e8-48a9-b7af-8d9aa83dad4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec24fbcd652c41df8f55ec6594431e2f', 'request_id': 'req-9ff884e9-d2e8-48a9-b7af-8d9aa83dad4f'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:53.634726 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-9ff884e9-d2e8-48a9-b7af-8d9aa83dad4f admin admin] The token cache is being invalidate because project ec24fbcd652c41df8f55ec6594431e2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86773) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 17:55:53.634984 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-9ff884e9-d2e8-48a9-b7af-8d9aa83dad4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:53.642402 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-9ff884e9-d2e8-48a9-b7af-8d9aa83dad4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:53.649210 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 918/1832] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 14 17:55:53 2022] DELETE /identity/v3/projects/ec24fbcd652c41df8f55ec6594431e2f => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:55:53.650241 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff884e9-d2e8-48a9-b7af-8d9aa83dad4f admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:53.660203 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-9ff884e9-d2e8-48a9-b7af-8d9aa83dad4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:53.784396 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7cbbd6-4e0c-4935-b4bf-a2d1d0255c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:53.785779 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7cbbd6-4e0c-4935-b4bf-a2d1d0255c85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:53.786266 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7cbbd6-4e0c-4935-b4bf-a2d1d0255c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:53.786740 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7cbbd6-4e0c-4935-b4bf-a2d1d0255c85 admin admin] PATH_INFO: `/v3/users/9de4bd1127e845ebabb813d2b6221e5f` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:53.791660 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7cbbd6-4e0c-4935-b4bf-a2d1d0255c85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9de4bd1127e845ebabb813d2b6221e5f)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:53.811769 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7cbbd6-4e0c-4935-b4bf-a2d1d0255c85 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:53.830548 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff884e9-d2e8-48a9-b7af-8d9aa83dad4f admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:53.841435 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4e356a-88ca-4d82-962f-d967c75aba9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:53.848219 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4e356a-88ca-4d82-962f-d967c75aba9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:53.853409 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4e356a-88ca-4d82-962f-d967c75aba9a admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:53.853901 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4e356a-88ca-4d82-962f-d967c75aba9a admin admin] PATH_INFO: `/v3/projects/7ad6c2e7ed4742278e373e7bd6ddc896` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:53.855837 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4e356a-88ca-4d82-962f-d967c75aba9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ad6c2e7ed4742278e373e7bd6ddc896)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:53.863413 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4e356a-88ca-4d82-962f-d967c75aba9a admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:53.982927 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-bd4e356a-88ca-4d82-962f-d967c75aba9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ad6c2e7ed4742278e373e7bd6ddc896', 'request_id': 'req-bd4e356a-88ca-4d82-962f-d967c75aba9a'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:53.996347 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-bd4e356a-88ca-4d82-962f-d967c75aba9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ad6c2e7ed4742278e373e7bd6ddc896', 'request_id': 'req-bd4e356a-88ca-4d82-962f-d967c75aba9a'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:53.997633 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-5b7cbbd6-4e0c-4935-b4bf-a2d1d0255c85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9de4bd1127e845ebabb813d2b6221e5f'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:54.005761 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-bd4e356a-88ca-4d82-962f-d967c75aba9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ad6c2e7ed4742278e373e7bd6ddc896', 'request_id': 'req-bd4e356a-88ca-4d82-962f-d967c75aba9a'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:54.036016 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-bd4e356a-88ca-4d82-962f-d967c75aba9a admin admin] The token cache is being invalidate because project 7ad6c2e7ed4742278e373e7bd6ddc896 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86773) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 17:55:54.036326 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-5b7cbbd6-4e0c-4935-b4bf-a2d1d0255c85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9de4bd1127e845ebabb813d2b6221e5f'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:54.036471 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-bd4e356a-88ca-4d82-962f-d967c75aba9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:54.037412 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-bd4e356a-88ca-4d82-962f-d967c75aba9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:54.045500 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 919/1833] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 14 17:55:53 2022] DELETE /identity/v3/projects/7ad6c2e7ed4742278e373e7bd6ddc896 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:55:54.045500 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d4b4b-96cd-4aec-b2f0-5d217831fc87 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:54.045500 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d4b4b-96cd-4aec-b2f0-5d217831fc87 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:54.045500 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d4b4b-96cd-4aec-b2f0-5d217831fc87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:54.055193 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-5b7cbbd6-4e0c-4935-b4bf-a2d1d0255c85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9de4bd1127e845ebabb813d2b6221e5f'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:54.060460 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-5b7cbbd6-4e0c-4935-b4bf-a2d1d0255c85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9de4bd1127e845ebabb813d2b6221e5f'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:54.099666 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-e31d4b4b-96cd-4aec-b2f0-5d217831fc87 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:55:54.102847 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-e31d4b4b-96cd-4aec-b2f0-5d217831fc87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:54.109125 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-5b7cbbd6-4e0c-4935-b4bf-a2d1d0255c85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9de4bd1127e845ebabb813d2b6221e5f'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:54.120481 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 915/1834] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 14 17:55:53 2022] DELETE /identity/v3/users/9de4bd1127e845ebabb813d2b6221e5f => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:55:54.121446 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7cbbd6-4e0c-4935-b4bf-a2d1d0255c85 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:54.126112 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-5b7cbbd6-4e0c-4935-b4bf-a2d1d0255c85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:54.144063 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:55:54.278410 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 920/1835] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:55:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:55:54.281683 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b53c05b-c2d7-4f13-b3f8-f73da699044b None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:54.282297 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b53c05b-c2d7-4f13-b3f8-f73da699044b None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:54.282995 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b53c05b-c2d7-4f13-b3f8-f73da699044b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:54.284223 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:55:54.332008 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-4b53c05b-c2d7-4f13-b3f8-f73da699044b None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:55:54.334768 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-4b53c05b-c2d7-4f13-b3f8-f73da699044b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:54.343784 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7cbbd6-4e0c-4935-b4bf-a2d1d0255c85 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:54.355930 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a28727-6ae7-4575-ae92-fe429978053b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41b893bdf4ec474dbfa819c22fc29ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:54.356985 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a28727-6ae7-4575-ae92-fe429978053b service nova] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:54.357463 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a28727-6ae7-4575-ae92-fe429978053b service nova] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:54.357985 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a28727-6ae7-4575-ae92-fe429978053b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:54.361394 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-63a28727-6ae7-4575-ae92-fe429978053b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:54.389430 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a28727-6ae7-4575-ae92-fe429978053b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:54.392660 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a28727-6ae7-4575-ae92-fe429978053b service nova] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:54.420285 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 916/1836] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:55:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:55:54.423254 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d427e19f-aca9-4d91-960d-42bb27840557 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:54.423795 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d427e19f-aca9-4d91-960d-42bb27840557 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:54.424281 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d427e19f-aca9-4d91-960d-42bb27840557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:54.504226 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 921/1837] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:55:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:55:54.507422 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c8159a-7cde-46d5-815f-23c8e047c878 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:54.508015 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c8159a-7cde-46d5-815f-23c8e047c878 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:54.508745 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c8159a-7cde-46d5-815f-23c8e047c878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:54.522473 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-d427e19f-aca9-4d91-960d-42bb27840557 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:55:54.525389 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-d427e19f-aca9-4d91-960d-42bb27840557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:54.544649 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 917/1838] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:55:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:55:54.547376 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6122ee35-c395-4d75-a9c0-d61c59d411ea None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:54.547844 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6122ee35-c395-4d75-a9c0-d61c59d411ea None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:54.548335 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6122ee35-c395-4d75-a9c0-d61c59d411ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:54.569919 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-70c8159a-7cde-46d5-815f-23c8e047c878 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:55:54.572147 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-70c8159a-7cde-46d5-815f-23c8e047c878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:54.581476 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-6122ee35-c395-4d75-a9c0-d61c59d411ea None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:55:54.583458 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-6122ee35-c395-4d75-a9c0-d61c59d411ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:54.593287 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 922/1839] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:55:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:55:54.594911 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c8159a-7cde-46d5-815f-23c8e047c878 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:54.606921 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-70c8159a-7cde-46d5-815f-23c8e047c878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:54.615863 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 918/1840] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:55:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:55:54.624315 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6122ee35-c395-4d75-a9c0-d61c59d411ea None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:54.643936 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6122ee35-c395-4d75-a9c0-d61c59d411ea None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:54.653173 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb658314-afb3-4d96-ba27-2365fd12e954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:54.654438 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb658314-afb3-4d96-ba27-2365fd12e954 admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:54.654942 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb658314-afb3-4d96-ba27-2365fd12e954 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:54.655360 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb658314-afb3-4d96-ba27-2365fd12e954 admin admin] PATH_INFO: `/v3/domains` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:54.656965 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb658314-afb3-4d96-ba27-2365fd12e954 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:55:54.657564 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb658314-afb3-4d96-ba27-2365fd12e954 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:54.661420 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb658314-afb3-4d96-ba27-2365fd12e954 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:54.704049 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 919/1841] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 14 17:55:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:55:54.705302 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb658314-afb3-4d96-ba27-2365fd12e954 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:54.729229 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb658314-afb3-4d96-ba27-2365fd12e954 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:54.741069 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52a14fd-fa01-4662-bebc-22a16a44b4f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:54.742336 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a14fd-fa01-4662-bebc-22a16a44b4f9 admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:54.742863 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a14fd-fa01-4662-bebc-22a16a44b4f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:54.745950 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a14fd-fa01-4662-bebc-22a16a44b4f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:54.745950 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52a14fd-fa01-4662-bebc-22a16a44b4f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:55:54.746328 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52a14fd-fa01-4662-bebc-22a16a44b4f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:54.749333 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52a14fd-fa01-4662-bebc-22a16a44b4f9 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:54.758001 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c8159a-7cde-46d5-815f-23c8e047c878 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:54.773082 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26882125-21ef-48c2-9e27-ac840f05b4e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:54.774251 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26882125-21ef-48c2-9e27-ac840f05b4e4 service neutron] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:54.775018 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26882125-21ef-48c2-9e27-ac840f05b4e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:54.775427 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26882125-21ef-48c2-9e27-ac840f05b4e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:54.779594 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 920/1842] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 14 17:55:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:55:54.781198 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52a14fd-fa01-4662-bebc-22a16a44b4f9 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:54.794771 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52a14fd-fa01-4662-bebc-22a16a44b4f9 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:54.800294 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e28ea5e-053c-4de3-932b-95068507c998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:54.801597 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e28ea5e-053c-4de3-932b-95068507c998 admin admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:54.801989 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e28ea5e-053c-4de3-932b-95068507c998 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:54.802273 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e28ea5e-053c-4de3-932b-95068507c998 admin admin] PATH_INFO: `/v3/projects` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:54.803186 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e28ea5e-053c-4de3-932b-95068507c998 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:54.805171 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e28ea5e-053c-4de3-932b-95068507c998 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:54.814868 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26882125-21ef-48c2-9e27-ac840f05b4e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:54.819047 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26882125-21ef-48c2-9e27-ac840f05b4e4 service neutron] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:54.860437 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 921/1843] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 14 17:55:54 2022] POST /identity/v3/projects => generated 379 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:55:54.861899 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e28ea5e-053c-4de3-932b-95068507c998 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:54.870970 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 923/1844] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:55:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:55:54.878415 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26882125-21ef-48c2-9e27-ac840f05b4e4 service neutron] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:54.936047 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26882125-21ef-48c2-9e27-ac840f05b4e4 service neutron] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:54.960924 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e28ea5e-053c-4de3-932b-95068507c998 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:54.967844 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98820d6d-f4dc-4bca-87de-686b65e017d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:54.969000 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98820d6d-f4dc-4bca-87de-686b65e017d8 admin admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:54.969000 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98820d6d-f4dc-4bca-87de-686b65e017d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:54.969000 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98820d6d-f4dc-4bca-87de-686b65e017d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:54.969786 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98820d6d-f4dc-4bca-87de-686b65e017d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:54.973013 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98820d6d-f4dc-4bca-87de-686b65e017d8 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:55.048932 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 922/1845] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 14 17:55:54 2022] POST /identity/v3/projects => generated 373 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:55:55.053510 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98820d6d-f4dc-4bca-87de-686b65e017d8 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:55.145483 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:55:55.189307 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad52e32-948c-4c5f-84af-b182f8ef034b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:55.193987 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad52e32-948c-4c5f-84af-b182f8ef034b admin admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:55.196286 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad52e32-948c-4c5f-84af-b182f8ef034b admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:55.200116 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad52e32-948c-4c5f-84af-b182f8ef034b admin admin] PATH_INFO: `/v3/users` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:55.201681 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad52e32-948c-4c5f-84af-b182f8ef034b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:55.212256 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad52e32-948c-4c5f-84af-b182f8ef034b admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:55.270834 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 924/1846] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 14 17:55:54 2022] POST /identity/v3/users => generated 290 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:55:55.274526 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad52e32-948c-4c5f-84af-b182f8ef034b admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:55.275013 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98820d6d-f4dc-4bca-87de-686b65e017d8 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:55.295978 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155bcb3d-f80f-4d6d-ab52-0b663186126f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:55.297570 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155bcb3d-f80f-4d6d-ab52-0b663186126f admin admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:55.298262 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155bcb3d-f80f-4d6d-ab52-0b663186126f admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:55.298917 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155bcb3d-f80f-4d6d-ab52-0b663186126f admin admin] PATH_INFO: `/v3/users` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:55.299571 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad52e32-948c-4c5f-84af-b182f8ef034b admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:55.301443 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155bcb3d-f80f-4d6d-ab52-0b663186126f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:55.318144 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155bcb3d-f80f-4d6d-ab52-0b663186126f admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:55.321950 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65681d1-f012-439c-9b3a-b9bd9f7814dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:55.323626 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65681d1-f012-439c-9b3a-b9bd9f7814dc admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:55.324095 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65681d1-f012-439c-9b3a-b9bd9f7814dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:55.324576 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65681d1-f012-439c-9b3a-b9bd9f7814dc admin admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:55.327032 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65681d1-f012-439c-9b3a-b9bd9f7814dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:55.330130 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65681d1-f012-439c-9b3a-b9bd9f7814dc admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:55.339055 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:55:55.360420 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 925/1847] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:55:55 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:55:55.361935 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65681d1-f012-439c-9b3a-b9bd9f7814dc admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:55.370508 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 923/1848] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 14 17:55:55 2022] POST /identity/v3/users => generated 287 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 17:55:55.375406 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155bcb3d-f80f-4d6d-ab52-0b663186126f admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:55.387183 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65681d1-f012-439c-9b3a-b9bd9f7814dc admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:55.396254 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe57c64-9338-4dc9-8ab2-86dc19588cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:55.397558 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe57c64-9338-4dc9-8ab2-86dc19588cd9 admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:55.398161 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe57c64-9338-4dc9-8ab2-86dc19588cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:55.398712 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe57c64-9338-4dc9-8ab2-86dc19588cd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:55.400373 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe57c64-9338-4dc9-8ab2-86dc19588cd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:55.404325 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe57c64-9338-4dc9-8ab2-86dc19588cd9 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:55.407629 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155bcb3d-f80f-4d6d-ab52-0b663186126f admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:55.423725 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67ac42d-939b-4cbe-afb4-96fce0ba377e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:55.425058 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ac42d-939b-4cbe-afb4-96fce0ba377e admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:55.425521 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ac42d-939b-4cbe-afb4-96fce0ba377e admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:55.426330 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ac42d-939b-4cbe-afb4-96fce0ba377e admin admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:55.428253 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67ac42d-939b-4cbe-afb4-96fce0ba377e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:55.431805 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67ac42d-939b-4cbe-afb4-96fce0ba377e admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:55.463216 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 924/1850] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:55:55 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:55:55.463216 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67ac42d-939b-4cbe-afb4-96fce0ba377e admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:55.466056 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 926/1850] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:55:55 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:55:55.474347 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe57c64-9338-4dc9-8ab2-86dc19588cd9 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:55.494853 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67ac42d-939b-4cbe-afb4-96fce0ba377e admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:55.499138 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe57c64-9338-4dc9-8ab2-86dc19588cd9 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:55.512190 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380ec745-62f6-45f1-9849-79b497a2c1a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:55.513098 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ec745-62f6-45f1-9849-79b497a2c1a7 admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:55.513488 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ec745-62f6-45f1-9849-79b497a2c1a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:55.513885 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ec745-62f6-45f1-9849-79b497a2c1a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:55.514778 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380ec745-62f6-45f1-9849-79b497a2c1a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:55.515973 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdd2404-fea5-4682-b67e-786dad7dc570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:55.517052 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380ec745-62f6-45f1-9849-79b497a2c1a7 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:55.517903 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdd2404-fea5-4682-b67e-786dad7dc570 admin admin] REQUEST_METHOD: `PUT` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:55.518403 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdd2404-fea5-4682-b67e-786dad7dc570 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:55.522732 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdd2404-fea5-4682-b67e-786dad7dc570 admin admin] PATH_INFO: `/v3/projects/e1b832cfb04c4ef1be0dca90003d2a88/users/b5a0af3c83244573aac3de58c64ec31e/roles/95d753870f97426cb1ce32e078621a4c` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:55.531040 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 927/1851] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:55:55 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:55:55.535750 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380ec745-62f6-45f1-9849-79b497a2c1a7 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:55.549349 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380ec745-62f6-45f1-9849-79b497a2c1a7 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:55.561187 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ffcbca-6605-43b7-81e5-5c05ba09dd0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:55.562800 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ffcbca-6605-43b7-81e5-5c05ba09dd0e admin admin] REQUEST_METHOD: `PUT` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:55.563237 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ffcbca-6605-43b7-81e5-5c05ba09dd0e admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:55.563682 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ffcbca-6605-43b7-81e5-5c05ba09dd0e admin admin] PATH_INFO: `/v3/projects/0f3b885a2cbf45368c7f64d611ad9f00/users/453add2ad3ab403392ab849bbdbd93f0/roles/95d753870f97426cb1ce32e078621a4c` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:55.583771 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdd2404-fea5-4682-b67e-786dad7dc570 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1b832cfb04c4ef1be0dca90003d2a88, user_id=b5a0af3c83244573aac3de58c64ec31e, role_id=95d753870f97426cb1ce32e078621a4c)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:55.586947 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdd2404-fea5-4682-b67e-786dad7dc570 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:55.605926 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ffcbca-6605-43b7-81e5-5c05ba09dd0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f3b885a2cbf45368c7f64d611ad9f00, user_id=453add2ad3ab403392ab849bbdbd93f0, role_id=95d753870f97426cb1ce32e078621a4c)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:55.606791 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ffcbca-6605-43b7-81e5-5c05ba09dd0e admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:55.629647 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 925/1852] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 17:55:55 2022] PUT /identity/v3/projects/e1b832cfb04c4ef1be0dca90003d2a88/users/b5a0af3c83244573aac3de58c64ec31e/roles/95d753870f97426cb1ce32e078621a4c => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:55:55.644372 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 928/1853] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 17:55:55 2022] PUT /identity/v3/projects/0f3b885a2cbf45368c7f64d611ad9f00/users/453add2ad3ab403392ab849bbdbd93f0/roles/95d753870f97426cb1ce32e078621a4c => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 17:55:55.644619 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ca864-9487-4be3-a8f5-09a663a72711 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:55.644619 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ca864-9487-4be3-a8f5-09a663a72711 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:55.644619 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ca864-9487-4be3-a8f5-09a663a72711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:55.649713 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9889f0-7282-4cc1-ac47-87bcb3064457 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:55.650236 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9889f0-7282-4cc1-ac47-87bcb3064457 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:55.650745 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9889f0-7282-4cc1-ac47-87bcb3064457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:55.715662 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-492ca864-9487-4be3-a8f5-09a663a72711 None None] MFA Rules not processed for user `b5a0af3c83244573aac3de58c64ec31e`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:55:55.721929 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-492ca864-9487-4be3-a8f5-09a663a72711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:55.728297 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-9e9889f0-7282-4cc1-ac47-87bcb3064457 None None] MFA Rules not processed for user `453add2ad3ab403392ab849bbdbd93f0`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:55:55.731071 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-9e9889f0-7282-4cc1-ac47-87bcb3064457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:55.942228 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 926/1854] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:55:55 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:55:55.944255 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492ca864-9487-4be3-a8f5-09a663a72711 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:56.020165 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 929/1855] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:55:55 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:55:56.022941 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9889f0-7282-4cc1-ac47-87bcb3064457 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:56.130444 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492ca864-9487-4be3-a8f5-09a663a72711 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:56.150237 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bb4970-ed03-41ab-bcf4-4ce938a2c6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:56.150902 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb4970-ed03-41ab-bcf4-4ce938a2c6ed admin admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:56.151212 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb4970-ed03-41ab-bcf4-4ce938a2c6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:56.152097 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb4970-ed03-41ab-bcf4-4ce938a2c6ed admin admin] PATH_INFO: `/v3/projects` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:56.152946 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bb4970-ed03-41ab-bcf4-4ce938a2c6ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:56.155126 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bb4970-ed03-41ab-bcf4-4ce938a2c6ed admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:56.175095 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9889f0-7282-4cc1-ac47-87bcb3064457 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:56.185915 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b72690-1ea3-4af7-97db-763ce49d254b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:56.188861 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b72690-1ea3-4af7-97db-763ce49d254b admin admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:56.189488 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b72690-1ea3-4af7-97db-763ce49d254b admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:56.190434 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b72690-1ea3-4af7-97db-763ce49d254b admin admin] PATH_INFO: `/v3/projects` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:56.192297 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b72690-1ea3-4af7-97db-763ce49d254b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:56.197194 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b72690-1ea3-4af7-97db-763ce49d254b admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:56.255463 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 927/1856] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 14 17:55:55 2022] POST /identity/v3/projects => generated 377 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:55:56.255862 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:55:56.257330 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bb4970-ed03-41ab-bcf4-4ce938a2c6ed admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:56.283541 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 930/1857] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 14 17:55:56 2022] POST /identity/v3/projects => generated 371 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 17:55:56.285454 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b72690-1ea3-4af7-97db-763ce49d254b admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:56.354795 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:55:56.404818 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bb4970-ed03-41ab-bcf4-4ce938a2c6ed admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:56.492269 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b72690-1ea3-4af7-97db-763ce49d254b admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:56.504347 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53529c13-f127-4e17-8902-7a4a09d8211b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:56.506214 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53529c13-f127-4e17-8902-7a4a09d8211b admin admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:56.506676 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53529c13-f127-4e17-8902-7a4a09d8211b admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:56.507127 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53529c13-f127-4e17-8902-7a4a09d8211b admin admin] PATH_INFO: `/v3/users` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:56.507805 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2093bb5b-05e4-4f92-9b73-e66d90231ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:56.508406 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53529c13-f127-4e17-8902-7a4a09d8211b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:56.509272 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093bb5b-05e4-4f92-9b73-e66d90231ade admin admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:56.511465 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093bb5b-05e4-4f92-9b73-e66d90231ade admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:56.511967 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53529c13-f127-4e17-8902-7a4a09d8211b admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:56.512084 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093bb5b-05e4-4f92-9b73-e66d90231ade admin admin] PATH_INFO: `/v3/users` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:56.513402 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2093bb5b-05e4-4f92-9b73-e66d90231ade admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:56.521023 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2093bb5b-05e4-4f92-9b73-e66d90231ade admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:56.549927 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 928/1858] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 14 17:55:56 2022] POST /identity/v3/users => generated 289 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 17:55:56.551849 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53529c13-f127-4e17-8902-7a4a09d8211b admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:56.569372 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53529c13-f127-4e17-8902-7a4a09d8211b admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:56.578372 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694db5c8-fd20-4280-bcd3-bc67f80753e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:56.579495 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694db5c8-fd20-4280-bcd3-bc67f80753e6 admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:56.580124 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694db5c8-fd20-4280-bcd3-bc67f80753e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:56.580628 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694db5c8-fd20-4280-bcd3-bc67f80753e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:56.581674 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694db5c8-fd20-4280-bcd3-bc67f80753e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:56.584114 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694db5c8-fd20-4280-bcd3-bc67f80753e6 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:56.606102 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 931/1859] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 14 17:55:56 2022] POST /identity/v3/users => generated 292 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:55:56.607997 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2093bb5b-05e4-4f92-9b73-e66d90231ade admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:56.614433 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 929/1860] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:55:56 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:55:56.615534 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694db5c8-fd20-4280-bcd3-bc67f80753e6 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:56.624479 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2093bb5b-05e4-4f92-9b73-e66d90231ade admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:56.632791 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9d10c4-11c5-4607-9a4f-650af9ac470f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:56.633908 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9d10c4-11c5-4607-9a4f-650af9ac470f admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:56.634426 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9d10c4-11c5-4607-9a4f-650af9ac470f admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:56.634842 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9d10c4-11c5-4607-9a4f-650af9ac470f admin admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:56.635476 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694db5c8-fd20-4280-bcd3-bc67f80753e6 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:56.636877 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9d10c4-11c5-4607-9a4f-650af9ac470f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:56.640712 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9d10c4-11c5-4607-9a4f-650af9ac470f admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:56.644664 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc57bfd-fc83-416a-9ca5-f1d6cde3fb37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:56.645830 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc57bfd-fc83-416a-9ca5-f1d6cde3fb37 admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:56.646360 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc57bfd-fc83-416a-9ca5-f1d6cde3fb37 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:56.646948 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc57bfd-fc83-416a-9ca5-f1d6cde3fb37 admin admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:56.648067 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc57bfd-fc83-416a-9ca5-f1d6cde3fb37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:56.651927 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc57bfd-fc83-416a-9ca5-f1d6cde3fb37 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:56.665625 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 932/1861] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:55:56 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:55:56.669889 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9d10c4-11c5-4607-9a4f-650af9ac470f admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:56.676274 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 930/1862] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:55:56 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:55:56.681040 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc57bfd-fc83-416a-9ca5-f1d6cde3fb37 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:56.694857 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9d10c4-11c5-4607-9a4f-650af9ac470f admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:56.695257 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc57bfd-fc83-416a-9ca5-f1d6cde3fb37 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:56.705423 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057a8a76-ba64-4c4a-9601-81f2e462519c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:56.706512 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b128523-cd37-4805-9f1f-961aed16b458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:56.706715 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a8a76-ba64-4c4a-9601-81f2e462519c admin admin] REQUEST_METHOD: `PUT` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:56.706968 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a8a76-ba64-4c4a-9601-81f2e462519c admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:56.707324 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a8a76-ba64-4c4a-9601-81f2e462519c admin admin] PATH_INFO: `/v3/projects/eea8d9510b3c4a42886cce84e988731c/users/f2bd56e927d34130b83ea44d621fd04c/roles/95d753870f97426cb1ce32e078621a4c` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:56.708953 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b128523-cd37-4805-9f1f-961aed16b458 admin admin] REQUEST_METHOD: `PUT` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:56.709764 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b128523-cd37-4805-9f1f-961aed16b458 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:56.710691 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b128523-cd37-4805-9f1f-961aed16b458 admin admin] PATH_INFO: `/v3/projects/e19be4a5239946b6b1f750aa86c307a7/users/b3fe7b2344884ecdb972c2daed170dc2/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:56.734424 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057a8a76-ba64-4c4a-9601-81f2e462519c admin admin] RBAC: Authorizing `identity:create_grant(project_id=eea8d9510b3c4a42886cce84e988731c, user_id=f2bd56e927d34130b83ea44d621fd04c, role_id=95d753870f97426cb1ce32e078621a4c)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:56.737864 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057a8a76-ba64-4c4a-9601-81f2e462519c admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:56.747738 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b128523-cd37-4805-9f1f-961aed16b458 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e19be4a5239946b6b1f750aa86c307a7, user_id=b3fe7b2344884ecdb972c2daed170dc2, role_id=4651a1cc7b4d4ab7a7a9ca1e77e58e71)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:56.754471 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b128523-cd37-4805-9f1f-961aed16b458 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:56.765851 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 931/1863] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 17:55:56 2022] PUT /identity/v3/projects/eea8d9510b3c4a42886cce84e988731c/users/f2bd56e927d34130b83ea44d621fd04c/roles/95d753870f97426cb1ce32e078621a4c => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:55:56.778301 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bef207-4096-4d34-894d-bcfe290ae8f1 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:56.778689 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bef207-4096-4d34-894d-bcfe290ae8f1 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:56.779149 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bef207-4096-4d34-894d-bcfe290ae8f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:56.809068 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 933/1864] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 17:55:56 2022] PUT /identity/v3/projects/e19be4a5239946b6b1f750aa86c307a7/users/b3fe7b2344884ecdb972c2daed170dc2/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:55:56.815121 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b128523-cd37-4805-9f1f-961aed16b458 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:56.851719 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-73bef207-4096-4d34-894d-bcfe290ae8f1 None None] MFA Rules not processed for user `f2bd56e927d34130b83ea44d621fd04c`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:55:56.855413 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-73bef207-4096-4d34-894d-bcfe290ae8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:56.997395 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b128523-cd37-4805-9f1f-961aed16b458 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:57.003354 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bc2e63-d2ea-4920-98d5-291ce9a68099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:57.005148 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc2e63-d2ea-4920-98d5-291ce9a68099 admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:57.005148 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc2e63-d2ea-4920-98d5-291ce9a68099 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:57.005490 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc2e63-d2ea-4920-98d5-291ce9a68099 admin admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:57.006189 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bc2e63-d2ea-4920-98d5-291ce9a68099 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:57.007869 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bc2e63-d2ea-4920-98d5-291ce9a68099 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:57.026273 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 934/1865] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:55:56 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:55:57.027770 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bc2e63-d2ea-4920-98d5-291ce9a68099 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:57.034717 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 932/1866] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:55:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:55:57.043666 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bc2e63-d2ea-4920-98d5-291ce9a68099 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:57.046738 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bef207-4096-4d34-894d-bcfe290ae8f1 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:57.062602 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697d63b1-3595-41b0-a593-68d0e3705cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:57.063529 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d63b1-3595-41b0-a593-68d0e3705cdc admin admin] REQUEST_METHOD: `PUT` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:57.063815 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d63b1-3595-41b0-a593-68d0e3705cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:57.064097 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d63b1-3595-41b0-a593-68d0e3705cdc admin admin] PATH_INFO: `/v3/projects/e19be4a5239946b6b1f750aa86c307a7/users/b3fe7b2344884ecdb972c2daed170dc2/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:57.071413 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bef207-4096-4d34-894d-bcfe290ae8f1 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:57.071662 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697d63b1-3595-41b0-a593-68d0e3705cdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=e19be4a5239946b6b1f750aa86c307a7, user_id=b3fe7b2344884ecdb972c2daed170dc2, role_id=4651a1cc7b4d4ab7a7a9ca1e77e58e71)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:57.078299 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697d63b1-3595-41b0-a593-68d0e3705cdc admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:57.078923 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14db4065-850c-49ae-8844-48e7b6911d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:57.081735 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db4065-850c-49ae-8844-48e7b6911d09 admin admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:57.081735 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db4065-850c-49ae-8844-48e7b6911d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:57.081735 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db4065-850c-49ae-8844-48e7b6911d09 admin admin] PATH_INFO: `/v3/projects` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:57.081735 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14db4065-850c-49ae-8844-48e7b6911d09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:57.083272 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14db4065-850c-49ae-8844-48e7b6911d09 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:57.093873 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:55:57.112319 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 935/1867] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 17:55:57 2022] PUT /identity/v3/projects/e19be4a5239946b6b1f750aa86c307a7/users/b3fe7b2344884ecdb972c2daed170dc2/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:55:57.121978 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc725dbe-d590-4e2f-b647-93fe08e943ea None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:57.123898 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc725dbe-d590-4e2f-b647-93fe08e943ea None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:57.124517 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc725dbe-d590-4e2f-b647-93fe08e943ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:57.144236 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 933/1868] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 14 17:55:57 2022] POST /identity/v3/projects => generated 379 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:55:57.146569 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14db4065-850c-49ae-8844-48e7b6911d09 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:57.191667 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-bc725dbe-d590-4e2f-b647-93fe08e943ea None None] MFA Rules not processed for user `b3fe7b2344884ecdb972c2daed170dc2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:55:57.194107 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-bc725dbe-d590-4e2f-b647-93fe08e943ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:57.327652 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:55:57.427695 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14db4065-850c-49ae-8844-48e7b6911d09 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:57.439060 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 936/1869] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:55:57 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:55:57.439060 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc725dbe-d590-4e2f-b647-93fe08e943ea None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:57.443990 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-bc725dbe-d590-4e2f-b647-93fe08e943ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:57.459241 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3949a7e-0774-4671-879c-cd221750201b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:57.465563 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3949a7e-0774-4671-879c-cd221750201b admin admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:57.465891 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3949a7e-0774-4671-879c-cd221750201b admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:57.466150 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3949a7e-0774-4671-879c-cd221750201b admin admin] PATH_INFO: `/v3/users` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:57.466915 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3949a7e-0774-4671-879c-cd221750201b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:57.469027 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3949a7e-0774-4671-879c-cd221750201b admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:57.470611 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc725dbe-d590-4e2f-b647-93fe08e943ea None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:57.477120 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe80f507-cf61-42ec-abca-147a49e32f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:57.478155 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe80f507-cf61-42ec-abca-147a49e32f98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:57.478510 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe80f507-cf61-42ec-abca-147a49e32f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:57.478882 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe80f507-cf61-42ec-abca-147a49e32f98 admin admin] PATH_INFO: `/v3/projects/bb001cfb301d431d83314fcdeb2870fd` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:57.480468 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe80f507-cf61-42ec-abca-147a49e32f98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb001cfb301d431d83314fcdeb2870fd)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:57.483018 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe80f507-cf61-42ec-abca-147a49e32f98 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:57.509838 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 934/1870] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 14 17:55:57 2022] POST /identity/v3/users => generated 296 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:55:57.511376 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3949a7e-0774-4671-879c-cd221750201b admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:57.516963 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-d3949a7e-0774-4671-879c-cd221750201b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:57.592504 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-fe80f507-cf61-42ec-abca-147a49e32f98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb001cfb301d431d83314fcdeb2870fd', 'request_id': 'req-fe80f507-cf61-42ec-abca-147a49e32f98'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:57.603630 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-fe80f507-cf61-42ec-abca-147a49e32f98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb001cfb301d431d83314fcdeb2870fd', 'request_id': 'req-fe80f507-cf61-42ec-abca-147a49e32f98'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:57.627126 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-fe80f507-cf61-42ec-abca-147a49e32f98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb001cfb301d431d83314fcdeb2870fd', 'request_id': 'req-fe80f507-cf61-42ec-abca-147a49e32f98'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:57.665838 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3949a7e-0774-4671-879c-cd221750201b admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:57.667236 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-fe80f507-cf61-42ec-abca-147a49e32f98 admin admin] The token cache is being invalidate because project bb001cfb301d431d83314fcdeb2870fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86773) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 17:55:57.667538 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-fe80f507-cf61-42ec-abca-147a49e32f98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:57.668306 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-fe80f507-cf61-42ec-abca-147a49e32f98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:57.673813 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 937/1871] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 14 17:55:57 2022] DELETE /identity/v3/projects/bb001cfb301d431d83314fcdeb2870fd => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:55:57.674902 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe80f507-cf61-42ec-abca-147a49e32f98 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:57.676700 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-fe80f507-cf61-42ec-abca-147a49e32f98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:57.770781 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe80f507-cf61-42ec-abca-147a49e32f98 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:57.779535 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239cddde-ee89-45af-916b-10fdc821c294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:57.780879 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239cddde-ee89-45af-916b-10fdc821c294 admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:57.781030 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b959841-e364-4d2d-bd2d-35c2e67b8a2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de55cae1600841889668e36402861203', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:57.781554 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239cddde-ee89-45af-916b-10fdc821c294 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:57.781678 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b959841-e364-4d2d-bd2d-35c2e67b8a2f service cinder] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:57.781954 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b959841-e364-4d2d-bd2d-35c2e67b8a2f service cinder] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:57.782233 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b959841-e364-4d2d-bd2d-35c2e67b8a2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:57.782345 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239cddde-ee89-45af-916b-10fdc821c294 admin admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:57.784378 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-5b959841-e364-4d2d-bd2d-35c2e67b8a2f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:57.784953 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239cddde-ee89-45af-916b-10fdc821c294 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:57.788261 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239cddde-ee89-45af-916b-10fdc821c294 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:57.809719 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 938/1872] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:55:57 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:55:57.811066 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239cddde-ee89-45af-916b-10fdc821c294 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:57.817795 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-239cddde-ee89-45af-916b-10fdc821c294 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:57.857969 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239cddde-ee89-45af-916b-10fdc821c294 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:57.858350 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:55:57.871452 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fc801d-a3f9-480e-9879-d7998a2fb0ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:57.872961 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc801d-a3f9-480e-9879-d7998a2fb0ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:57.873243 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc801d-a3f9-480e-9879-d7998a2fb0ae admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:57.873569 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc801d-a3f9-480e-9879-d7998a2fb0ae admin admin] PATH_INFO: `/v3/users/49dbbdad94db4ac8a84ae0d2857db0d4` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:57.875233 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fc801d-a3f9-480e-9879-d7998a2fb0ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=49dbbdad94db4ac8a84ae0d2857db0d4)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:57.877293 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fc801d-a3f9-480e-9879-d7998a2fb0ae admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:57.888421 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b959841-e364-4d2d-bd2d-35c2e67b8a2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:57.894807 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b959841-e364-4d2d-bd2d-35c2e67b8a2f service cinder] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:57.909413 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 935/1873] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:55:57 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:55:57.910398 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b959841-e364-4d2d-bd2d-35c2e67b8a2f service cinder] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:57.922842 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b959841-e364-4d2d-bd2d-35c2e67b8a2f service cinder] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:57.929119 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1ae63b-b076-4c10-bbb3-291c070ffa4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:57.930266 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ae63b-b076-4c10-bbb3-291c070ffa4c admin admin] REQUEST_METHOD: `PUT` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:57.930607 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ae63b-b076-4c10-bbb3-291c070ffa4c admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:57.930907 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ae63b-b076-4c10-bbb3-291c070ffa4c admin admin] PATH_INFO: `/v3/projects/eb39c82d4218440bb02fa84ed37f7efd/users/0efb5974b666422e8addbb14ee2a32be/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:57.953028 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:55:57.959647 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1ae63b-b076-4c10-bbb3-291c070ffa4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb39c82d4218440bb02fa84ed37f7efd, user_id=0efb5974b666422e8addbb14ee2a32be, role_id=4651a1cc7b4d4ab7a7a9ca1e77e58e71)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:57.965878 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1ae63b-b076-4c10-bbb3-291c070ffa4c admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:57.968162 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-d8fc801d-a3f9-480e-9879-d7998a2fb0ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49dbbdad94db4ac8a84ae0d2857db0d4'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:57.988654 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 936/1874] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 17:55:57 2022] PUT /identity/v3/projects/eb39c82d4218440bb02fa84ed37f7efd/users/0efb5974b666422e8addbb14ee2a32be/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:55:57.990923 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-d8fc801d-a3f9-480e-9879-d7998a2fb0ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49dbbdad94db4ac8a84ae0d2857db0d4'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:57.994607 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1ae63b-b076-4c10-bbb3-291c070ffa4c admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:58.008270 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-d8fc801d-a3f9-480e-9879-d7998a2fb0ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49dbbdad94db4ac8a84ae0d2857db0d4'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:58.009359 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-d8fc801d-a3f9-480e-9879-d7998a2fb0ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49dbbdad94db4ac8a84ae0d2857db0d4'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:58.010096 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-d8fc801d-a3f9-480e-9879-d7998a2fb0ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49dbbdad94db4ac8a84ae0d2857db0d4'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:58.034463 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 939/1875] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 14 17:55:57 2022] DELETE /identity/v3/users/49dbbdad94db4ac8a84ae0d2857db0d4 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:55:58.081670 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fc801d-a3f9-480e-9879-d7998a2fb0ae admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:58.083940 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-d8fc801d-a3f9-480e-9879-d7998a2fb0ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:58.115804 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1ae63b-b076-4c10-bbb3-291c070ffa4c admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:58.229206 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fc801d-a3f9-480e-9879-d7998a2fb0ae admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:58.238248 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250d2f87-a872-467e-a31d-02b5f7960f8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de55cae1600841889668e36402861203', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:58.239463 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d2f87-a872-467e-a31d-02b5f7960f8c service cinder] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:58.239934 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d2f87-a872-467e-a31d-02b5f7960f8c service cinder] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:58.240670 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d2f87-a872-467e-a31d-02b5f7960f8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:58.242758 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43f71e4-3c9e-4a39-9e94-66d4785a50ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:58.243765 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43f71e4-3c9e-4a39-9e94-66d4785a50ae admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:58.244132 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-250d2f87-a872-467e-a31d-02b5f7960f8c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:58.244761 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43f71e4-3c9e-4a39-9e94-66d4785a50ae admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:58.245134 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43f71e4-3c9e-4a39-9e94-66d4785a50ae admin admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:58.246706 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43f71e4-3c9e-4a39-9e94-66d4785a50ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:58.251221 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43f71e4-3c9e-4a39-9e94-66d4785a50ae admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:58.275090 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 937/1876] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:55:57 2022] GET /identity/v3/roles => generated 1420 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 17:55:58.281854 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43f71e4-3c9e-4a39-9e94-66d4785a50ae admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:58.287964 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-a43f71e4-3c9e-4a39-9e94-66d4785a50ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:58.310349 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43f71e4-3c9e-4a39-9e94-66d4785a50ae admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:58.317739 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554ce733-b8a9-4405-9ad9-23998f2a2c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:58.319110 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554ce733-b8a9-4405-9ad9-23998f2a2c47 admin admin] REQUEST_METHOD: `PUT` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:58.319792 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554ce733-b8a9-4405-9ad9-23998f2a2c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:58.320276 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554ce733-b8a9-4405-9ad9-23998f2a2c47 admin admin] PATH_INFO: `/v3/projects/eb39c82d4218440bb02fa84ed37f7efd/users/0efb5974b666422e8addbb14ee2a32be/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:58.323510 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554ce733-b8a9-4405-9ad9-23998f2a2c47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb39c82d4218440bb02fa84ed37f7efd, user_id=0efb5974b666422e8addbb14ee2a32be, role_id=4651a1cc7b4d4ab7a7a9ca1e77e58e71)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:58.327486 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554ce733-b8a9-4405-9ad9-23998f2a2c47 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:58.356752 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 938/1877] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 17:55:58 2022] PUT /identity/v3/projects/eb39c82d4218440bb02fa84ed37f7efd/users/0efb5974b666422e8addbb14ee2a32be/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:55:58.359907 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d895c-f366-4938-aeed-df6e8612d8c6 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:58.360539 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d895c-f366-4938-aeed-df6e8612d8c6 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:58.361023 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d895c-f366-4938-aeed-df6e8612d8c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:58.405190 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250d2f87-a872-467e-a31d-02b5f7960f8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:58.407203 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250d2f87-a872-467e-a31d-02b5f7960f8c service cinder] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:58.422971 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 940/1878] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:55:58 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:55:58.430088 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-b43d895c-f366-4938-aeed-df6e8612d8c6 None None] MFA Rules not processed for user `0efb5974b666422e8addbb14ee2a32be`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:55:58.432189 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-b43d895c-f366-4938-aeed-df6e8612d8c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:58.474320 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250d2f87-a872-467e-a31d-02b5f7960f8c service cinder] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:58.476132 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-250d2f87-a872-467e-a31d-02b5f7960f8c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:58.496161 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250d2f87-a872-467e-a31d-02b5f7960f8c service cinder] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:58.523516 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:55:58.576777 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 939/1879] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:55:58 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:55:58.612402 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43d895c-f366-4938-aeed-df6e8612d8c6 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:58.613956 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-b43d895c-f366-4938-aeed-df6e8612d8c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:58.615955 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed38e79-5151-4bf3-906e-98d551b891a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:58.617429 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed38e79-5151-4bf3-906e-98d551b891a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:58.617955 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed38e79-5151-4bf3-906e-98d551b891a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:58.618419 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed38e79-5151-4bf3-906e-98d551b891a9 admin admin] PATH_INFO: `/v3/projects/be34284682b4420882948938ffce549d` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:58.621771 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed38e79-5151-4bf3-906e-98d551b891a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be34284682b4420882948938ffce549d)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:58.625458 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed38e79-5151-4bf3-906e-98d551b891a9 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:58.639901 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43d895c-f366-4938-aeed-df6e8612d8c6 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:58.646957 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:55:58.650315 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714afbea-7ec7-4044-9e62-26758387dc3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:58.652946 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714afbea-7ec7-4044-9e62-26758387dc3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:58.653841 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714afbea-7ec7-4044-9e62-26758387dc3b admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:58.655255 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714afbea-7ec7-4044-9e62-26758387dc3b admin admin] PATH_INFO: `/v3/users/6270cdc59f4847c6b7824f380c2a6bb3` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:58.658101 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714afbea-7ec7-4044-9e62-26758387dc3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6270cdc59f4847c6b7824f380c2a6bb3)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:58.663417 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714afbea-7ec7-4044-9e62-26758387dc3b admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:58.738011 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-9ed38e79-5151-4bf3-906e-98d551b891a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be34284682b4420882948938ffce549d', 'request_id': 'req-9ed38e79-5151-4bf3-906e-98d551b891a9'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:58.746729 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-9ed38e79-5151-4bf3-906e-98d551b891a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be34284682b4420882948938ffce549d', 'request_id': 'req-9ed38e79-5151-4bf3-906e-98d551b891a9'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:58.755495 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-714afbea-7ec7-4044-9e62-26758387dc3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6270cdc59f4847c6b7824f380c2a6bb3'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:58.755793 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-9ed38e79-5151-4bf3-906e-98d551b891a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be34284682b4420882948938ffce549d', 'request_id': 'req-9ed38e79-5151-4bf3-906e-98d551b891a9'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:58.766906 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-714afbea-7ec7-4044-9e62-26758387dc3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6270cdc59f4847c6b7824f380c2a6bb3'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:58.778004 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-9ed38e79-5151-4bf3-906e-98d551b891a9 admin admin] The token cache is being invalidate because project be34284682b4420882948938ffce549d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86773) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 17:55:58.778409 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-9ed38e79-5151-4bf3-906e-98d551b891a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:58.779117 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-9ed38e79-5151-4bf3-906e-98d551b891a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:58.781011 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 941/1880] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 14 17:55:58 2022] DELETE /identity/v3/projects/be34284682b4420882948938ffce549d => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 17:55:58.787119 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed38e79-5151-4bf3-906e-98d551b891a9 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:58.787372 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-714afbea-7ec7-4044-9e62-26758387dc3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6270cdc59f4847c6b7824f380c2a6bb3'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:58.788575 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-714afbea-7ec7-4044-9e62-26758387dc3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6270cdc59f4847c6b7824f380c2a6bb3'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:58.788756 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-9ed38e79-5151-4bf3-906e-98d551b891a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:58.816321 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-714afbea-7ec7-4044-9e62-26758387dc3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6270cdc59f4847c6b7824f380c2a6bb3'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:55:58.826066 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 940/1881] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 14 17:55:58 2022] DELETE /identity/v3/users/6270cdc59f4847c6b7824f380c2a6bb3 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:55:58.827992 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c1f91-88cf-4727-9481-c066960e4e2c None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:58.828579 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c1f91-88cf-4727-9481-c066960e4e2c None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:58.829148 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c1f91-88cf-4727-9481-c066960e4e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:58.856092 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-dd2c1f91-88cf-4727-9481-c066960e4e2c None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:55:58.858254 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-dd2c1f91-88cf-4727-9481-c066960e4e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:58.891257 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed38e79-5151-4bf3-906e-98d551b891a9 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:58.941956 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 941/1882] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:55:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:55:58.943339 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa81612-9517-4bdb-b3be-2e3ad74c2d77 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:58.943632 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa81612-9517-4bdb-b3be-2e3ad74c2d77 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:58.943933 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa81612-9517-4bdb-b3be-2e3ad74c2d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:58.968450 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-daa81612-9517-4bdb-b3be-2e3ad74c2d77 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:55:58.969756 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-daa81612-9517-4bdb-b3be-2e3ad74c2d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:58.984329 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 942/1883] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:55:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:55:58.984329 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69beaf88-c733-482d-a813-33c4e88c5018 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:58.984329 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69beaf88-c733-482d-a813-33c4e88c5018 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:58.984329 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69beaf88-c733-482d-a813-33c4e88c5018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:59.004233 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01ac785-ef31-4994-a4b5-edecdc60a0d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de55cae1600841889668e36402861203', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:59.005207 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ac785-ef31-4994-a4b5-edecdc60a0d4 service cinder] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:59.005926 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ac785-ef31-4994-a4b5-edecdc60a0d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:59.006596 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ac785-ef31-4994-a4b5-edecdc60a0d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:59.008935 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-a01ac785-ef31-4994-a4b5-edecdc60a0d4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:59.012338 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-69beaf88-c733-482d-a813-33c4e88c5018 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:55:59.013823 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-69beaf88-c733-482d-a813-33c4e88c5018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:59.022980 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 943/1884] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:55:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:55:59.023702 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69beaf88-c733-482d-a813-33c4e88c5018 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:59.025129 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-69beaf88-c733-482d-a813-33c4e88c5018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:59.096436 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:55:59.132768 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69beaf88-c733-482d-a813-33c4e88c5018 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:59.135156 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01ac785-ef31-4994-a4b5-edecdc60a0d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:59.137468 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01ac785-ef31-4994-a4b5-edecdc60a0d4 service cinder] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:59.140831 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91db9503-b2d1-419b-a57a-0e86011b0007 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:59.142336 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db9503-b2d1-419b-a57a-0e86011b0007 service neutron] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:59.142511 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db9503-b2d1-419b-a57a-0e86011b0007 service neutron] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:59.142962 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db9503-b2d1-419b-a57a-0e86011b0007 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:59.150567 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 942/1885] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:55:58 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:55:59.152454 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01ac785-ef31-4994-a4b5-edecdc60a0d4 service cinder] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:59.159144 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:55:59.160963 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91db9503-b2d1-419b-a57a-0e86011b0007 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:59.163778 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91db9503-b2d1-419b-a57a-0e86011b0007 service neutron] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:59.167804 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01ac785-ef31-4994-a4b5-edecdc60a0d4 service cinder] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:59.177076 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07f6105-3eb6-4483-b840-14a004c5e771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:59.178403 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07f6105-3eb6-4483-b840-14a004c5e771 admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:59.179523 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07f6105-3eb6-4483-b840-14a004c5e771 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:59.179987 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07f6105-3eb6-4483-b840-14a004c5e771 admin admin] PATH_INFO: `/v3/domains` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:59.181041 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07f6105-3eb6-4483-b840-14a004c5e771 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:55:59.181770 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07f6105-3eb6-4483-b840-14a004c5e771 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:59.185598 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07f6105-3eb6-4483-b840-14a004c5e771 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:59.186687 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 944/1886] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:55:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:55:59.219343 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 943/1887] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 14 17:55:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:55:59.237103 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91db9503-b2d1-419b-a57a-0e86011b0007 service neutron] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:59.244261 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07f6105-3eb6-4483-b840-14a004c5e771 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:59.246478 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-e07f6105-3eb6-4483-b840-14a004c5e771 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:59.262024 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91db9503-b2d1-419b-a57a-0e86011b0007 service neutron] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:59.266377 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3ee679-c752-4765-b2d8-2437b83ed848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:59.266633 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3ee679-c752-4765-b2d8-2437b83ed848 admin admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:59.267221 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3ee679-c752-4765-b2d8-2437b83ed848 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:59.267326 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3ee679-c752-4765-b2d8-2437b83ed848 admin admin] PATH_INFO: `/v3/projects` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:59.268067 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3ee679-c752-4765-b2d8-2437b83ed848 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:59.270729 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3ee679-c752-4765-b2d8-2437b83ed848 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:59.274555 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07f6105-3eb6-4483-b840-14a004c5e771 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:59.283424 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e87787d-d3dd-4d3e-aa25-e7efe31151be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de55cae1600841889668e36402861203', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:59.285301 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e87787d-d3dd-4d3e-aa25-e7efe31151be service cinder] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:59.285987 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e87787d-d3dd-4d3e-aa25-e7efe31151be service cinder] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:59.286610 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e87787d-d3dd-4d3e-aa25-e7efe31151be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:59.290254 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-9e87787d-d3dd-4d3e-aa25-e7efe31151be service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:55:59.311704 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 945/1888] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 14 17:55:59 2022] POST /identity/v3/projects => generated 409 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:55:59.316254 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3ee679-c752-4765-b2d8-2437b83ed848 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:59.408829 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e87787d-d3dd-4d3e-aa25-e7efe31151be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:59.411583 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e87787d-d3dd-4d3e-aa25-e7efe31151be service cinder] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:59.411857 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3ee679-c752-4765-b2d8-2437b83ed848 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:59.421103 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81bb12d-6d4c-4d99-85a1-6e658763ef08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:59.422556 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81bb12d-6d4c-4d99-85a1-6e658763ef08 admin admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:59.422875 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81bb12d-6d4c-4d99-85a1-6e658763ef08 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:59.423628 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81bb12d-6d4c-4d99-85a1-6e658763ef08 admin admin] PATH_INFO: `/v3/users` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:59.424623 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81bb12d-6d4c-4d99-85a1-6e658763ef08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:59.428744 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81bb12d-6d4c-4d99-85a1-6e658763ef08 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:59.429721 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 944/1889] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:55:59 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 17:55:59.505147 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 946/1890] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 14 17:55:59 2022] POST /identity/v3/users => generated 305 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 17:55:59.511693 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e87787d-d3dd-4d3e-aa25-e7efe31151be service cinder] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:59.546998 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e87787d-d3dd-4d3e-aa25-e7efe31151be service cinder] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:59.563729 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc07412f-90bd-4086-b65a-a51d5939bdec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:59.564544 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc07412f-90bd-4086-b65a-a51d5939bdec admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:59.564743 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc07412f-90bd-4086-b65a-a51d5939bdec admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:59.565281 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc07412f-90bd-4086-b65a-a51d5939bdec admin admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:59.567947 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc07412f-90bd-4086-b65a-a51d5939bdec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:59.571141 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc07412f-90bd-4086-b65a-a51d5939bdec admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:59.596370 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 945/1891] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:55:59 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:55:59.601557 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81bb12d-6d4c-4d99-85a1-6e658763ef08 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:59.615816 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81bb12d-6d4c-4d99-85a1-6e658763ef08 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:59.622076 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed730f6b-d887-44f6-b3a2-441ed85c787c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:59.622809 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed730f6b-d887-44f6-b3a2-441ed85c787c admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:59.623697 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed730f6b-d887-44f6-b3a2-441ed85c787c admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:59.623697 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed730f6b-d887-44f6-b3a2-441ed85c787c admin admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:59.624758 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed730f6b-d887-44f6-b3a2-441ed85c787c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:59.626640 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed730f6b-d887-44f6-b3a2-441ed85c787c admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:59.645080 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 947/1892] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:55:59 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:55:59.650419 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc07412f-90bd-4086-b65a-a51d5939bdec admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:55:59.672525 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc07412f-90bd-4086-b65a-a51d5939bdec admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:55:59.682367 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7eccc6-80c0-4ebd-aecd-91f56f017151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:55:59.684249 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7eccc6-80c0-4ebd-aecd-91f56f017151 admin admin] REQUEST_METHOD: `PUT` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:59.684769 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7eccc6-80c0-4ebd-aecd-91f56f017151 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:59.686026 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7eccc6-80c0-4ebd-aecd-91f56f017151 admin admin] PATH_INFO: `/v3/projects/cc1a3146d93a4fb4aa2094ce0f2eba6b/users/145984f1273d47e2a9b4aa4e5cec37c9/roles/95d753870f97426cb1ce32e078621a4c` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:59.722284 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7eccc6-80c0-4ebd-aecd-91f56f017151 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc1a3146d93a4fb4aa2094ce0f2eba6b, user_id=145984f1273d47e2a9b4aa4e5cec37c9, role_id=95d753870f97426cb1ce32e078621a4c)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:55:59.737698 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7eccc6-80c0-4ebd-aecd-91f56f017151 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:55:59.775650 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 946/1893] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 17:55:59 2022] PUT /identity/v3/projects/cc1a3146d93a4fb4aa2094ce0f2eba6b/users/145984f1273d47e2a9b4aa4e5cec37c9/roles/95d753870f97426cb1ce32e078621a4c => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:55:59.799708 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cacc17-c27c-4372-9f72-1aead4d26c3a None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:55:59.800013 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cacc17-c27c-4372-9f72-1aead4d26c3a None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:55:59.800332 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cacc17-c27c-4372-9f72-1aead4d26c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:55:59.875376 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-91cacc17-c27c-4372-9f72-1aead4d26c3a None None] MFA Rules not processed for user `145984f1273d47e2a9b4aa4e5cec37c9`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:55:59.876909 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-91cacc17-c27c-4372-9f72-1aead4d26c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:00.144770 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 948/1894] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:55:59 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 17:56:00.145029 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7eccc6-80c0-4ebd-aecd-91f56f017151 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:00.316868 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cacc17-c27c-4372-9f72-1aead4d26c3a None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:00.319195 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-91cacc17-c27c-4372-9f72-1aead4d26c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:00.363535 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7eccc6-80c0-4ebd-aecd-91f56f017151 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:00.390400 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160989c2-b32e-4765-a912-4b1abfd79473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:00.391112 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160989c2-b32e-4765-a912-4b1abfd79473 admin admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:00.391403 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160989c2-b32e-4765-a912-4b1abfd79473 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:00.391685 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160989c2-b32e-4765-a912-4b1abfd79473 admin admin] PATH_INFO: `/v3/projects` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:00.392636 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160989c2-b32e-4765-a912-4b1abfd79473 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:00.399220 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:56:00.404372 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160989c2-b32e-4765-a912-4b1abfd79473 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:00.516526 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 947/1895] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 14 17:56:00 2022] POST /identity/v3/projects => generated 407 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 17:56:00.522505 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160989c2-b32e-4765-a912-4b1abfd79473 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:00.534312 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cacc17-c27c-4372-9f72-1aead4d26c3a None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:00.683273 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:56:00.729833 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80ed86e-2971-4a9e-b815-daea437c24e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:00.731819 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ed86e-2971-4a9e-b815-daea437c24e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:00.732389 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ed86e-2971-4a9e-b815-daea437c24e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:00.732827 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ed86e-2971-4a9e-b815-daea437c24e8 admin admin] PATH_INFO: `/v3/projects/e83bfaa76db24cf18c04a528d941511d` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:00.735363 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80ed86e-2971-4a9e-b815-daea437c24e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e83bfaa76db24cf18c04a528d941511d)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:00.740257 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80ed86e-2971-4a9e-b815-daea437c24e8 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:00.746360 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160989c2-b32e-4765-a912-4b1abfd79473 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:00.767467 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd6797b-b15b-4704-b5a0-0cc5538a8ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:00.768459 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd6797b-b15b-4704-b5a0-0cc5538a8ebf admin admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:00.768796 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd6797b-b15b-4704-b5a0-0cc5538a8ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:00.769215 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd6797b-b15b-4704-b5a0-0cc5538a8ebf admin admin] PATH_INFO: `/v3/users` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:00.770312 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd6797b-b15b-4704-b5a0-0cc5538a8ebf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:00.779638 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd6797b-b15b-4704-b5a0-0cc5538a8ebf admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:00.825197 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 948/1896] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 14 17:56:00 2022] POST /identity/v3/users => generated 310 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 17:56:00.831484 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd6797b-b15b-4704-b5a0-0cc5538a8ebf admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:00.860373 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd6797b-b15b-4704-b5a0-0cc5538a8ebf admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:00.883362 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-f80ed86e-2971-4a9e-b815-daea437c24e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e83bfaa76db24cf18c04a528d941511d', 'request_id': 'req-f80ed86e-2971-4a9e-b815-daea437c24e8'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:00.891728 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-f80ed86e-2971-4a9e-b815-daea437c24e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e83bfaa76db24cf18c04a528d941511d', 'request_id': 'req-f80ed86e-2971-4a9e-b815-daea437c24e8'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:00.904351 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-f80ed86e-2971-4a9e-b815-daea437c24e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e83bfaa76db24cf18c04a528d941511d', 'request_id': 'req-f80ed86e-2971-4a9e-b815-daea437c24e8'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:00.920678 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-f80ed86e-2971-4a9e-b815-daea437c24e8 admin admin] The token cache is being invalidate because project e83bfaa76db24cf18c04a528d941511d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86772) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 17:56:00.921073 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-f80ed86e-2971-4a9e-b815-daea437c24e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:00.922400 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-f80ed86e-2971-4a9e-b815-daea437c24e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:00.924932 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 949/1897] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 14 17:56:00 2022] DELETE /identity/v3/projects/e83bfaa76db24cf18c04a528d941511d => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 17:56:00.930250 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80ed86e-2971-4a9e-b815-daea437c24e8 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:00.932814 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-f80ed86e-2971-4a9e-b815-daea437c24e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:00.944326 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a573541f-35e4-4c75-8fef-5064bf91ae47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:00.944996 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a573541f-35e4-4c75-8fef-5064bf91ae47 admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:00.945280 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a573541f-35e4-4c75-8fef-5064bf91ae47 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:00.945598 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a573541f-35e4-4c75-8fef-5064bf91ae47 admin admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:00.946367 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a573541f-35e4-4c75-8fef-5064bf91ae47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:00.948033 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a573541f-35e4-4c75-8fef-5064bf91ae47 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:00.959558 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 949/1898] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:56:00.964952 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a573541f-35e4-4c75-8fef-5064bf91ae47 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:00.966789 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-a573541f-35e4-4c75-8fef-5064bf91ae47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:00.981447 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a573541f-35e4-4c75-8fef-5064bf91ae47 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:00.986844 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6595b424-5f63-45d2-9678-108883d8a2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:00.987826 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6595b424-5f63-45d2-9678-108883d8a2de admin admin] REQUEST_METHOD: `PUT` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:00.988117 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6595b424-5f63-45d2-9678-108883d8a2de admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:00.988435 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6595b424-5f63-45d2-9678-108883d8a2de admin admin] PATH_INFO: `/v3/projects/ae19ffc96daf418599c3331beb346856/users/3285825b91754db88c94cb6c10132473/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:01.007708 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6595b424-5f63-45d2-9678-108883d8a2de admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae19ffc96daf418599c3331beb346856, user_id=3285825b91754db88c94cb6c10132473, role_id=4651a1cc7b4d4ab7a7a9ca1e77e58e71)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:01.011934 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6595b424-5f63-45d2-9678-108883d8a2de admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:01.029327 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 950/1899] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 17:56:00 2022] PUT /identity/v3/projects/ae19ffc96daf418599c3331beb346856/users/3285825b91754db88c94cb6c10132473/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 17:56:01.034303 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6595b424-5f63-45d2-9678-108883d8a2de admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:01.070981 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80ed86e-2971-4a9e-b815-daea437c24e8 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:01.081396 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:56:01.140336 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6595b424-5f63-45d2-9678-108883d8a2de admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:01.145682 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deea77d-8911-48de-be42-72f1b661dfd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:01.146635 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deea77d-8911-48de-be42-72f1b661dfd5 admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:01.146980 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deea77d-8911-48de-be42-72f1b661dfd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:01.148277 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deea77d-8911-48de-be42-72f1b661dfd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:01.148277 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deea77d-8911-48de-be42-72f1b661dfd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:01.150021 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deea77d-8911-48de-be42-72f1b661dfd5 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:01.163078 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 951/1900] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:56:01 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 17:56:01.169385 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deea77d-8911-48de-be42-72f1b661dfd5 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:01.184606 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deea77d-8911-48de-be42-72f1b661dfd5 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:01.192741 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805f2377-6606-4c52-99e5-c1cff581a823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:01.193899 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f2377-6606-4c52-99e5-c1cff581a823 admin admin] REQUEST_METHOD: `PUT` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:01.194202 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f2377-6606-4c52-99e5-c1cff581a823 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:01.194502 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f2377-6606-4c52-99e5-c1cff581a823 admin admin] PATH_INFO: `/v3/projects/ae19ffc96daf418599c3331beb346856/users/3285825b91754db88c94cb6c10132473/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:01.197398 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805f2377-6606-4c52-99e5-c1cff581a823 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae19ffc96daf418599c3331beb346856, user_id=3285825b91754db88c94cb6c10132473, role_id=4651a1cc7b4d4ab7a7a9ca1e77e58e71)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:01.200569 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805f2377-6606-4c52-99e5-c1cff581a823 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:01.213445 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 952/1901] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 17:56:01 2022] PUT /identity/v3/projects/ae19ffc96daf418599c3331beb346856/users/3285825b91754db88c94cb6c10132473/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 17:56:01.241340 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb64b0e-a909-45a6-9679-6606c6e5679a None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:01.242091 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb64b0e-a909-45a6-9679-6606c6e5679a None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:01.242619 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb64b0e-a909-45a6-9679-6606c6e5679a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:01.245400 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7820b15-d917-487b-9d5b-a21d7cbca3cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:01.247472 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7820b15-d917-487b-9d5b-a21d7cbca3cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:01.247990 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7820b15-d917-487b-9d5b-a21d7cbca3cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:01.248395 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7820b15-d917-487b-9d5b-a21d7cbca3cf admin admin] PATH_INFO: `/v3/users/f7a125e5aa904597b856fa1c0cce70f6` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:01.250782 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7820b15-d917-487b-9d5b-a21d7cbca3cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7a125e5aa904597b856fa1c0cce70f6)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:01.254572 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7820b15-d917-487b-9d5b-a21d7cbca3cf admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:01.303874 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-8cb64b0e-a909-45a6-9679-6606c6e5679a None None] MFA Rules not processed for user `3285825b91754db88c94cb6c10132473`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:56:01.305324 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-8cb64b0e-a909-45a6-9679-6606c6e5679a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:01.320311 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:56:01.348660 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-d7820b15-d917-487b-9d5b-a21d7cbca3cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7a125e5aa904597b856fa1c0cce70f6'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:01.373752 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-d7820b15-d917-487b-9d5b-a21d7cbca3cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7a125e5aa904597b856fa1c0cce70f6'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:01.410899 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-d7820b15-d917-487b-9d5b-a21d7cbca3cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7a125e5aa904597b856fa1c0cce70f6'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:01.414885 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-d7820b15-d917-487b-9d5b-a21d7cbca3cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7a125e5aa904597b856fa1c0cce70f6'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:01.436979 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-d7820b15-d917-487b-9d5b-a21d7cbca3cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7a125e5aa904597b856fa1c0cce70f6'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:01.451177 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 950/1902] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 14 17:56:00 2022] DELETE /identity/v3/users/f7a125e5aa904597b856fa1c0cce70f6 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 17:56:01.484314 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 953/1903] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:56:01 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:56:01.500115 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7820b15-d917-487b-9d5b-a21d7cbca3cf admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:01.503181 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-d7820b15-d917-487b-9d5b-a21d7cbca3cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:01.615528 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7820b15-d917-487b-9d5b-a21d7cbca3cf admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:01.621276 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de6f4b-a169-4304-bdc2-73d1b95b4911 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de55cae1600841889668e36402861203', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:01.622114 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de6f4b-a169-4304-bdc2-73d1b95b4911 service cinder] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:01.622452 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de6f4b-a169-4304-bdc2-73d1b95b4911 service cinder] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:01.622718 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de6f4b-a169-4304-bdc2-73d1b95b4911 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:01.705669 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:56:01.747659 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09de6f4b-a169-4304-bdc2-73d1b95b4911 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:01.750017 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09de6f4b-a169-4304-bdc2-73d1b95b4911 service cinder] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:01.769625 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 951/1904] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:56:01 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:56:02.059546 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb64b0e-a909-45a6-9679-6606c6e5679a None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:02.061110 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-8cb64b0e-a909-45a6-9679-6606c6e5679a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:02.265150 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb64b0e-a909-45a6-9679-6606c6e5679a None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:02.356530 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de6f4b-a169-4304-bdc2-73d1b95b4911 service cinder] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:02.378360 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de6f4b-a169-4304-bdc2-73d1b95b4911 service cinder] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:02.392025 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12da161-110c-49c5-8749-eac5bb087497 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de55cae1600841889668e36402861203', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:02.395836 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12da161-110c-49c5-8749-eac5bb087497 service cinder] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:02.396208 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12da161-110c-49c5-8749-eac5bb087497 service cinder] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:02.397202 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12da161-110c-49c5-8749-eac5bb087497 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:02.402621 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-e12da161-110c-49c5-8749-eac5bb087497 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:02.426552 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832ddff1-fe08-4cff-952f-375afebdf1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:02.429050 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832ddff1-fe08-4cff-952f-375afebdf1ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:02.429498 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832ddff1-fe08-4cff-952f-375afebdf1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:02.429907 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832ddff1-fe08-4cff-952f-375afebdf1ca admin admin] PATH_INFO: `/v3/projects/9c628770406c45da9e1504b776dc29c4` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:02.432101 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832ddff1-fe08-4cff-952f-375afebdf1ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c628770406c45da9e1504b776dc29c4)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:02.434602 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832ddff1-fe08-4cff-952f-375afebdf1ca admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:02.585674 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12da161-110c-49c5-8749-eac5bb087497 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:02.586053 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-832ddff1-fe08-4cff-952f-375afebdf1ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c628770406c45da9e1504b776dc29c4', 'request_id': 'req-832ddff1-fe08-4cff-952f-375afebdf1ca'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:02.588158 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12da161-110c-49c5-8749-eac5bb087497 service cinder] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:02.595484 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-832ddff1-fe08-4cff-952f-375afebdf1ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c628770406c45da9e1504b776dc29c4', 'request_id': 'req-832ddff1-fe08-4cff-952f-375afebdf1ca'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:02.598495 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:56:02.606025 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-832ddff1-fe08-4cff-952f-375afebdf1ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c628770406c45da9e1504b776dc29c4', 'request_id': 'req-832ddff1-fe08-4cff-952f-375afebdf1ca'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:02.608378 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 952/1905] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:56:02 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:56:02.626690 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-832ddff1-fe08-4cff-952f-375afebdf1ca admin admin] The token cache is being invalidate because project 9c628770406c45da9e1504b776dc29c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86773) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 17:56:02.627136 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-832ddff1-fe08-4cff-952f-375afebdf1ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:02.627931 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-832ddff1-fe08-4cff-952f-375afebdf1ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:02.630360 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 954/1906] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 14 17:56:02 2022] DELETE /identity/v3/projects/9c628770406c45da9e1504b776dc29c4 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:56:02.637107 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf3b3e2-de97-4bac-80cc-ca7032aaa4f1 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:02.637680 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf3b3e2-de97-4bac-80cc-ca7032aaa4f1 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:02.638024 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf3b3e2-de97-4bac-80cc-ca7032aaa4f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:02.668990 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-7bf3b3e2-de97-4bac-80cc-ca7032aaa4f1 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:56:02.670646 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-7bf3b3e2-de97-4bac-80cc-ca7032aaa4f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:02.789599 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 953/1907] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:56:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:56:02.798895 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95830a03-fe9f-49c6-b311-0c21d802d6ea None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:02.799789 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95830a03-fe9f-49c6-b311-0c21d802d6ea None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:02.800930 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95830a03-fe9f-49c6-b311-0c21d802d6ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:02.833746 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf3b3e2-de97-4bac-80cc-ca7032aaa4f1 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:02.837448 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-7bf3b3e2-de97-4bac-80cc-ca7032aaa4f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:02.845616 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-95830a03-fe9f-49c6-b311-0c21d802d6ea None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:56:02.846217 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-95830a03-fe9f-49c6-b311-0c21d802d6ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:02.862006 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 955/1908] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:56:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:56:02.863311 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95830a03-fe9f-49c6-b311-0c21d802d6ea None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:02.873265 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf3b3e2-de97-4bac-80cc-ca7032aaa4f1 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:02.877323 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95830a03-fe9f-49c6-b311-0c21d802d6ea None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:02.884474 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15752716-3193-46f3-b97c-f1463a69591a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:02.887435 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae64e76f-38f6-4167-a6e9-7f9b054f0df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:02.888086 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15752716-3193-46f3-b97c-f1463a69591a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:02.888224 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae64e76f-38f6-4167-a6e9-7f9b054f0df4 admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:02.888404 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae64e76f-38f6-4167-a6e9-7f9b054f0df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:02.888691 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae64e76f-38f6-4167-a6e9-7f9b054f0df4 admin admin] PATH_INFO: `/v3/domains` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:02.889188 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15752716-3193-46f3-b97c-f1463a69591a admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:02.889514 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae64e76f-38f6-4167-a6e9-7f9b054f0df4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:56:02.889861 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae64e76f-38f6-4167-a6e9-7f9b054f0df4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:02.890471 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15752716-3193-46f3-b97c-f1463a69591a admin admin] PATH_INFO: `/v3/users/b5a0af3c83244573aac3de58c64ec31e` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:02.891836 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae64e76f-38f6-4167-a6e9-7f9b054f0df4 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:02.895407 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15752716-3193-46f3-b97c-f1463a69591a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5a0af3c83244573aac3de58c64ec31e)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:02.904237 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15752716-3193-46f3-b97c-f1463a69591a admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:02.909612 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 956/1909] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 14 17:56:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:56:02.914482 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae64e76f-38f6-4167-a6e9-7f9b054f0df4 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:02.930963 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae64e76f-38f6-4167-a6e9-7f9b054f0df4 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:02.939634 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1031dfc2-84e9-4dd1-a00d-a4dcbd0165ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:02.940430 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1031dfc2-84e9-4dd1-a00d-a4dcbd0165ca admin admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:02.941343 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1031dfc2-84e9-4dd1-a00d-a4dcbd0165ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:02.941565 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1031dfc2-84e9-4dd1-a00d-a4dcbd0165ca admin admin] PATH_INFO: `/v3/projects` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:02.942463 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1031dfc2-84e9-4dd1-a00d-a4dcbd0165ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:02.945052 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1031dfc2-84e9-4dd1-a00d-a4dcbd0165ca admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:02.988936 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 957/1910] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 14 17:56:02 2022] POST /identity/v3/projects => generated 379 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:56:02.991136 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1031dfc2-84e9-4dd1-a00d-a4dcbd0165ca admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:03.042855 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-15752716-3193-46f3-b97c-f1463a69591a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5a0af3c83244573aac3de58c64ec31e'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:03.061233 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-15752716-3193-46f3-b97c-f1463a69591a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5a0af3c83244573aac3de58c64ec31e'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:03.084340 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-15752716-3193-46f3-b97c-f1463a69591a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5a0af3c83244573aac3de58c64ec31e'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:03.085586 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-15752716-3193-46f3-b97c-f1463a69591a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5a0af3c83244573aac3de58c64ec31e'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:03.119217 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:56:03.150619 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-15752716-3193-46f3-b97c-f1463a69591a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5a0af3c83244573aac3de58c64ec31e'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:03.151657 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1031dfc2-84e9-4dd1-a00d-a4dcbd0165ca admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:03.161797 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9101cbf5-51e3-4a81-b496-f8b6ba0b130c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:03.162561 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9101cbf5-51e3-4a81-b496-f8b6ba0b130c admin admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:03.162859 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9101cbf5-51e3-4a81-b496-f8b6ba0b130c admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:03.163200 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9101cbf5-51e3-4a81-b496-f8b6ba0b130c admin admin] PATH_INFO: `/v3/users` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:03.169340 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 954/1911] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 14 17:56:02 2022] DELETE /identity/v3/users/b5a0af3c83244573aac3de58c64ec31e => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:56:03.169923 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9101cbf5-51e3-4a81-b496-f8b6ba0b130c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:03.169923 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9101cbf5-51e3-4a81-b496-f8b6ba0b130c admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:03.171663 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff0aa21-5615-4b2e-bba6-329039f3703c None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:03.172185 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff0aa21-5615-4b2e-bba6-329039f3703c None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:03.172676 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff0aa21-5615-4b2e-bba6-329039f3703c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:03.207609 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 958/1912] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 14 17:56:02 2022] POST /identity/v3/users => generated 290 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 17:56:03.209275 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9101cbf5-51e3-4a81-b496-f8b6ba0b130c admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:03.214769 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-6ff0aa21-5615-4b2e-bba6-329039f3703c None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:56:03.217251 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-6ff0aa21-5615-4b2e-bba6-329039f3703c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:03.220180 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-9101cbf5-51e3-4a81-b496-f8b6ba0b130c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:03.248100 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9101cbf5-51e3-4a81-b496-f8b6ba0b130c admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:03.373469 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5326d80e-eb17-4738-8e91-2f3c2e6b7ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:03.374525 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5326d80e-eb17-4738-8e91-2f3c2e6b7ea2 admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:03.374939 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5326d80e-eb17-4738-8e91-2f3c2e6b7ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:03.375327 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5326d80e-eb17-4738-8e91-2f3c2e6b7ea2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:03.376837 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5326d80e-eb17-4738-8e91-2f3c2e6b7ea2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:03.378729 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5326d80e-eb17-4738-8e91-2f3c2e6b7ea2 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:03.392408 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 955/1913] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:56:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:56:03.404422 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff0aa21-5615-4b2e-bba6-329039f3703c None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:03.405620 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 959/1914] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:56:03 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:56:03.407236 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-6ff0aa21-5615-4b2e-bba6-329039f3703c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:03.408118 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5326d80e-eb17-4738-8e91-2f3c2e6b7ea2 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:03.431847 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5326d80e-eb17-4738-8e91-2f3c2e6b7ea2 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:03.445486 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9ecdff-cc38-4ce5-b400-bb7e4fb29bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:03.446611 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9ecdff-cc38-4ce5-b400-bb7e4fb29bcf admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:03.447054 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9ecdff-cc38-4ce5-b400-bb7e4fb29bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:03.448376 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9ecdff-cc38-4ce5-b400-bb7e4fb29bcf admin admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:03.449626 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9ecdff-cc38-4ce5-b400-bb7e4fb29bcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:03.452778 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9ecdff-cc38-4ce5-b400-bb7e4fb29bcf admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:03.473572 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 960/1915] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:56:03 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:56:03.481399 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9ecdff-cc38-4ce5-b400-bb7e4fb29bcf admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:03.499608 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9ecdff-cc38-4ce5-b400-bb7e4fb29bcf admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:03.514816 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721fe1af-01c2-4556-a206-560b72d416e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:03.517228 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721fe1af-01c2-4556-a206-560b72d416e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:03.517565 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721fe1af-01c2-4556-a206-560b72d416e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:03.517865 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721fe1af-01c2-4556-a206-560b72d416e5 admin admin] PATH_INFO: `/v3/projects/ce1308d5b8e3407189c278141355a941/users/f48d7ca1bf124870bae6b6e8c57c0d46/roles/95d753870f97426cb1ce32e078621a4c` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:03.521138 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff0aa21-5615-4b2e-bba6-329039f3703c None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:03.528166 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab08ecee-b0ad-4808-92d3-3ea1ebb728b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:03.529266 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab08ecee-b0ad-4808-92d3-3ea1ebb728b8 service neutron] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:03.529738 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab08ecee-b0ad-4808-92d3-3ea1ebb728b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:03.530133 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab08ecee-b0ad-4808-92d3-3ea1ebb728b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:03.544527 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721fe1af-01c2-4556-a206-560b72d416e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce1308d5b8e3407189c278141355a941, user_id=f48d7ca1bf124870bae6b6e8c57c0d46, role_id=95d753870f97426cb1ce32e078621a4c)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:03.549096 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721fe1af-01c2-4556-a206-560b72d416e5 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:03.550603 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab08ecee-b0ad-4808-92d3-3ea1ebb728b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:03.551886 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:56:03.552624 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab08ecee-b0ad-4808-92d3-3ea1ebb728b8 service neutron] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:03.572478 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 956/1916] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:56:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:56:03.581512 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 961/1917] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 17:56:03 2022] PUT /identity/v3/projects/ce1308d5b8e3407189c278141355a941/users/f48d7ca1bf124870bae6b6e8c57c0d46/roles/95d753870f97426cb1ce32e078621a4c => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:56:03.593207 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b21236e-bdb5-4c85-aaa8-d0f2a6924bb5 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:03.593755 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b21236e-bdb5-4c85-aaa8-d0f2a6924bb5 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:03.594135 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b21236e-bdb5-4c85-aaa8-d0f2a6924bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:03.632012 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-8b21236e-bdb5-4c85-aaa8-d0f2a6924bb5 None None] MFA Rules not processed for user `f48d7ca1bf124870bae6b6e8c57c0d46`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:56:03.633698 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-8b21236e-bdb5-4c85-aaa8-d0f2a6924bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:03.746735 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721fe1af-01c2-4556-a206-560b72d416e5 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:03.748945 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 957/1918] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:56:03 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:56:03.857714 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721fe1af-01c2-4556-a206-560b72d416e5 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:03.878748 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39879080-d082-446e-bab9-a5839b1a391c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:03.880383 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39879080-d082-446e-bab9-a5839b1a391c admin admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:03.880739 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39879080-d082-446e-bab9-a5839b1a391c admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:03.881164 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39879080-d082-446e-bab9-a5839b1a391c admin admin] PATH_INFO: `/v3/projects` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:03.882074 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39879080-d082-446e-bab9-a5839b1a391c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:03.884518 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39879080-d082-446e-bab9-a5839b1a391c admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:03.933398 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 962/1919] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 14 17:56:03 2022] POST /identity/v3/projects => generated 377 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:56:03.938878 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b21236e-bdb5-4c85-aaa8-d0f2a6924bb5 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:03.956918 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b21236e-bdb5-4c85-aaa8-d0f2a6924bb5 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:03.991112 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:56:04.063089 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b87085-744e-4b27-af82-2dfa5bf0151b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:04.063495 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39879080-d082-446e-bab9-a5839b1a391c admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:04.064301 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b87085-744e-4b27-af82-2dfa5bf0151b admin admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:04.064809 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b87085-744e-4b27-af82-2dfa5bf0151b admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:04.065203 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b87085-744e-4b27-af82-2dfa5bf0151b admin admin] PATH_INFO: `/v3/users` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:04.065376 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-39879080-d082-446e-bab9-a5839b1a391c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:04.066374 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b87085-744e-4b27-af82-2dfa5bf0151b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:04.070155 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b87085-744e-4b27-af82-2dfa5bf0151b admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:04.097347 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39879080-d082-446e-bab9-a5839b1a391c admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:04.103275 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8bdbf3-d430-4eaa-a29e-9bed303d27d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:04.104470 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8bdbf3-d430-4eaa-a29e-9bed303d27d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:04.105302 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8bdbf3-d430-4eaa-a29e-9bed303d27d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:04.105302 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8bdbf3-d430-4eaa-a29e-9bed303d27d0 admin admin] PATH_INFO: `/v3/projects/e1b832cfb04c4ef1be0dca90003d2a88` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:04.106644 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8bdbf3-d430-4eaa-a29e-9bed303d27d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1b832cfb04c4ef1be0dca90003d2a88)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:04.108731 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8bdbf3-d430-4eaa-a29e-9bed303d27d0 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:04.110967 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 958/1920] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 14 17:56:03 2022] POST /identity/v3/users => generated 295 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:56:04.115258 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b87085-744e-4b27-af82-2dfa5bf0151b admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:04.127474 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b87085-744e-4b27-af82-2dfa5bf0151b admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:04.132778 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aee4866-9817-4339-8f8c-400a2e95bc41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:04.133675 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee4866-9817-4339-8f8c-400a2e95bc41 admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:04.133952 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee4866-9817-4339-8f8c-400a2e95bc41 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:04.134229 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee4866-9817-4339-8f8c-400a2e95bc41 admin admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:04.134988 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aee4866-9817-4339-8f8c-400a2e95bc41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:04.137209 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aee4866-9817-4339-8f8c-400a2e95bc41 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:04.168851 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 959/1921] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:56:04 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 17:56:04.175620 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aee4866-9817-4339-8f8c-400a2e95bc41 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:04.182829 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-1c8bdbf3-d430-4eaa-a29e-9bed303d27d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1b832cfb04c4ef1be0dca90003d2a88', 'request_id': 'req-1c8bdbf3-d430-4eaa-a29e-9bed303d27d0'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:04.196945 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-1c8bdbf3-d430-4eaa-a29e-9bed303d27d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1b832cfb04c4ef1be0dca90003d2a88', 'request_id': 'req-1c8bdbf3-d430-4eaa-a29e-9bed303d27d0'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:04.197909 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aee4866-9817-4339-8f8c-400a2e95bc41 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:04.224146 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-1c8bdbf3-d430-4eaa-a29e-9bed303d27d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1b832cfb04c4ef1be0dca90003d2a88', 'request_id': 'req-1c8bdbf3-d430-4eaa-a29e-9bed303d27d0'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:04.257088 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-1c8bdbf3-d430-4eaa-a29e-9bed303d27d0 admin admin] The token cache is being invalidate because project e1b832cfb04c4ef1be0dca90003d2a88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86773) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 17:56:04.257389 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-1c8bdbf3-d430-4eaa-a29e-9bed303d27d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:04.259257 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-1c8bdbf3-d430-4eaa-a29e-9bed303d27d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:04.262447 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 963/1922] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 14 17:56:04 2022] DELETE /identity/v3/projects/e1b832cfb04c4ef1be0dca90003d2a88 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 17:56:04.268159 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8bdbf3-d430-4eaa-a29e-9bed303d27d0 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:04.273456 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-1c8bdbf3-d430-4eaa-a29e-9bed303d27d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:04.357107 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279e1b72-7a3e-42c3-8590-051e80959a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:04.360789 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e1b72-7a3e-42c3-8590-051e80959a74 admin admin] REQUEST_METHOD: `PUT` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:04.361214 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e1b72-7a3e-42c3-8590-051e80959a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:04.361831 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e1b72-7a3e-42c3-8590-051e80959a74 admin admin] PATH_INFO: `/v3/projects/6f990aa69c2f49659bed93f69bf0811d/users/eaf64df9e8c94dba96202589a5fd8c45/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:04.401591 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279e1b72-7a3e-42c3-8590-051e80959a74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f990aa69c2f49659bed93f69bf0811d, user_id=eaf64df9e8c94dba96202589a5fd8c45, role_id=4651a1cc7b4d4ab7a7a9ca1e77e58e71)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:04.419277 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279e1b72-7a3e-42c3-8590-051e80959a74 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:04.432684 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8bdbf3-d430-4eaa-a29e-9bed303d27d0 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:04.440110 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:56:04.466361 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 960/1923] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 17:56:04 2022] PUT /identity/v3/projects/6f990aa69c2f49659bed93f69bf0811d/users/eaf64df9e8c94dba96202589a5fd8c45/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:56:04.468807 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279e1b72-7a3e-42c3-8590-051e80959a74 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:04.473675 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-279e1b72-7a3e-42c3-8590-051e80959a74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:04.606294 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bda483-c10e-4af7-bd86-17033d3c9554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:04.610077 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bda483-c10e-4af7-bd86-17033d3c9554 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:04.610560 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bda483-c10e-4af7-bd86-17033d3c9554 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:04.611080 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bda483-c10e-4af7-bd86-17033d3c9554 admin admin] PATH_INFO: `/v3/users/f2bd56e927d34130b83ea44d621fd04c` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:04.615976 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bda483-c10e-4af7-bd86-17033d3c9554 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2bd56e927d34130b83ea44d621fd04c)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:04.620971 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bda483-c10e-4af7-bd86-17033d3c9554 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:04.695109 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279e1b72-7a3e-42c3-8590-051e80959a74 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:04.708287 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76e8c42-2209-4eb6-9795-02b0f2ede85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:04.708967 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e8c42-2209-4eb6-9795-02b0f2ede85c admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:04.709277 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e8c42-2209-4eb6-9795-02b0f2ede85c admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:04.710021 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e8c42-2209-4eb6-9795-02b0f2ede85c admin admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:04.710439 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76e8c42-2209-4eb6-9795-02b0f2ede85c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:04.712212 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76e8c42-2209-4eb6-9795-02b0f2ede85c admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:04.734427 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-03bda483-c10e-4af7-bd86-17033d3c9554 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2bd56e927d34130b83ea44d621fd04c'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:04.743594 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 961/1924] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:56:04 2022] GET /identity/v3/roles => generated 1420 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:56:04.748506 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76e8c42-2209-4eb6-9795-02b0f2ede85c admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:04.751335 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-03bda483-c10e-4af7-bd86-17033d3c9554 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2bd56e927d34130b83ea44d621fd04c'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:04.776057 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76e8c42-2209-4eb6-9795-02b0f2ede85c admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:04.790774 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b209f8-62a5-4105-99c5-d40db0c44a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:04.791709 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b209f8-62a5-4105-99c5-d40db0c44a3e admin admin] REQUEST_METHOD: `PUT` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:04.792207 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b209f8-62a5-4105-99c5-d40db0c44a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:04.792975 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b209f8-62a5-4105-99c5-d40db0c44a3e admin admin] PATH_INFO: `/v3/projects/6f990aa69c2f49659bed93f69bf0811d/users/eaf64df9e8c94dba96202589a5fd8c45/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:04.799197 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-03bda483-c10e-4af7-bd86-17033d3c9554 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2bd56e927d34130b83ea44d621fd04c'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:04.799497 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b209f8-62a5-4105-99c5-d40db0c44a3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f990aa69c2f49659bed93f69bf0811d, user_id=eaf64df9e8c94dba96202589a5fd8c45, role_id=4651a1cc7b4d4ab7a7a9ca1e77e58e71)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:04.799616 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-03bda483-c10e-4af7-bd86-17033d3c9554 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2bd56e927d34130b83ea44d621fd04c'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:04.801819 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-03bda483-c10e-4af7-bd86-17033d3c9554 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2bd56e927d34130b83ea44d621fd04c'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:04.802932 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b209f8-62a5-4105-99c5-d40db0c44a3e admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:04.830909 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 964/1925] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 14 17:56:04 2022] DELETE /identity/v3/users/f2bd56e927d34130b83ea44d621fd04c => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:56:04.841649 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 962/1926] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 17:56:04 2022] PUT /identity/v3/projects/6f990aa69c2f49659bed93f69bf0811d/users/eaf64df9e8c94dba96202589a5fd8c45/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:56:04.856148 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ceb7a7-038f-439f-b5c3-d34703bfb489 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:04.856446 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ceb7a7-038f-439f-b5c3-d34703bfb489 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:04.857169 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ceb7a7-038f-439f-b5c3-d34703bfb489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:04.899004 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-f5ceb7a7-038f-439f-b5c3-d34703bfb489 None None] MFA Rules not processed for user `eaf64df9e8c94dba96202589a5fd8c45`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:56:04.901708 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-f5ceb7a7-038f-439f-b5c3-d34703bfb489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:05.049042 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 965/1927] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:56:04 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:56:05.067896 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b209f8-62a5-4105-99c5-d40db0c44a3e admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:05.071427 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-71b209f8-62a5-4105-99c5-d40db0c44a3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:05.096066 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:56:05.219566 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcb0238-f832-4144-b434-881df14bf0f6 None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:05.220812 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcb0238-f832-4144-b434-881df14bf0f6 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:05.221637 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcb0238-f832-4144-b434-881df14bf0f6 None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:05.225913 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 966/1928] 10.222.0.67 () {54 vars in 921 bytes} [Thu Jul 14 17:56:05 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 17:56:05.246384 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e59caa-0cb5-4c1c-901b-8ac0254b3910 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:05.247435 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e59caa-0cb5-4c1c-901b-8ac0254b3910 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:05.249887 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e59caa-0cb5-4c1c-901b-8ac0254b3910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:05.285403 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b209f8-62a5-4105-99c5-d40db0c44a3e admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:05.298108 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-42e59caa-0cb5-4c1c-901b-8ac0254b3910 None None] MFA Rules not processed for user `41b893bdf4ec474dbfa819c22fc29ce9`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:56:05.301290 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-42e59caa-0cb5-4c1c-901b-8ac0254b3910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:05.334017 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:56:05.447732 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaad7ae-7865-49be-9c53-0c52cd099b32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de55cae1600841889668e36402861203', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:05.448516 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaad7ae-7865-49be-9c53-0c52cd099b32 service cinder] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:05.448864 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaad7ae-7865-49be-9c53-0c52cd099b32 service cinder] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:05.449201 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaad7ae-7865-49be-9c53-0c52cd099b32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:05.452896 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-2aaad7ae-7865-49be-9c53-0c52cd099b32 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:05.527625 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 967/1929] 10.222.0.67 () {58 vars in 1018 bytes} [Thu Jul 14 17:56:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:56:05.630846 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaad7ae-7865-49be-9c53-0c52cd099b32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:05.633339 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaad7ae-7865-49be-9c53-0c52cd099b32 service cinder] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:05.646841 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 963/1930] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:56:05 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 580 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:56:05.848835 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e59caa-0cb5-4c1c-901b-8ac0254b3910 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:05.854654 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-42e59caa-0cb5-4c1c-901b-8ac0254b3910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:05.889821 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e59caa-0cb5-4c1c-901b-8ac0254b3910 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:05.899588 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaad7ae-7865-49be-9c53-0c52cd099b32 service cinder] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:05.900886 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-2aaad7ae-7865-49be-9c53-0c52cd099b32 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:05.915666 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecb6306-ead7-4d24-aadd-fdac4ebb0f34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41b893bdf4ec474dbfa819c22fc29ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:05.916458 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb6306-ead7-4d24-aadd-fdac4ebb0f34 service nova] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:05.916813 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb6306-ead7-4d24-aadd-fdac4ebb0f34 service nova] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:05.917024 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb6306-ead7-4d24-aadd-fdac4ebb0f34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:05.941063 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecb6306-ead7-4d24-aadd-fdac4ebb0f34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:05.946010 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecb6306-ead7-4d24-aadd-fdac4ebb0f34 service nova] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:05.996004 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 968/1931] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:56:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:56:06.086139 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaad7ae-7865-49be-9c53-0c52cd099b32 service cinder] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:06.092281 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2897503b-e606-47c4-b800-8cb5063b19db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:06.093194 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2897503b-e606-47c4-b800-8cb5063b19db admin admin] REQUEST_METHOD: `DELETE` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:06.093475 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2897503b-e606-47c4-b800-8cb5063b19db admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:06.094004 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2897503b-e606-47c4-b800-8cb5063b19db admin admin] PATH_INFO: `/v3/projects/eea8d9510b3c4a42886cce84e988731c` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:06.095523 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2897503b-e606-47c4-b800-8cb5063b19db admin admin] RBAC: Authorizing `identity:delete_project(project_id=eea8d9510b3c4a42886cce84e988731c)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:06.097710 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2897503b-e606-47c4-b800-8cb5063b19db admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:06.134752 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:56:06.186400 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-2897503b-e606-47c4-b800-8cb5063b19db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eea8d9510b3c4a42886cce84e988731c', 'request_id': 'req-2897503b-e606-47c4-b800-8cb5063b19db'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:06.195048 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-2897503b-e606-47c4-b800-8cb5063b19db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eea8d9510b3c4a42886cce84e988731c', 'request_id': 'req-2897503b-e606-47c4-b800-8cb5063b19db'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:06.208362 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-2897503b-e606-47c4-b800-8cb5063b19db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eea8d9510b3c4a42886cce84e988731c', 'request_id': 'req-2897503b-e606-47c4-b800-8cb5063b19db'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:06.224379 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-2897503b-e606-47c4-b800-8cb5063b19db admin admin] The token cache is being invalidate because project eea8d9510b3c4a42886cce84e988731c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86772) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 17:56:06.224677 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-2897503b-e606-47c4-b800-8cb5063b19db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:06.225463 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-2897503b-e606-47c4-b800-8cb5063b19db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:06.227197 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 964/1932] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 14 17:56:05 2022] DELETE /identity/v3/projects/eea8d9510b3c4a42886cce84e988731c => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:56:06.233148 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecb6306-ead7-4d24-aadd-fdac4ebb0f34 service nova] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:06.249697 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecb6306-ead7-4d24-aadd-fdac4ebb0f34 service nova] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:06.340330 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eb235f-a9f9-4a72-aee8-b43ff0dc7138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:06.340581 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb235f-a9f9-4a72-aee8-b43ff0dc7138 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:06.340992 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb235f-a9f9-4a72-aee8-b43ff0dc7138 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:06.341480 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb235f-a9f9-4a72-aee8-b43ff0dc7138 admin admin] PATH_INFO: `/v3/users/0efb5974b666422e8addbb14ee2a32be` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:06.343755 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eb235f-a9f9-4a72-aee8-b43ff0dc7138 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0efb5974b666422e8addbb14ee2a32be)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:06.347420 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eb235f-a9f9-4a72-aee8-b43ff0dc7138 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:06.428274 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-80eb235f-a9f9-4a72-aee8-b43ff0dc7138 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0efb5974b666422e8addbb14ee2a32be'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:06.438122 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-80eb235f-a9f9-4a72-aee8-b43ff0dc7138 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0efb5974b666422e8addbb14ee2a32be'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:06.454977 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-80eb235f-a9f9-4a72-aee8-b43ff0dc7138 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0efb5974b666422e8addbb14ee2a32be'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:06.455722 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-80eb235f-a9f9-4a72-aee8-b43ff0dc7138 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0efb5974b666422e8addbb14ee2a32be'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:06.456565 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-80eb235f-a9f9-4a72-aee8-b43ff0dc7138 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0efb5974b666422e8addbb14ee2a32be'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:06.482427 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 969/1933] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 14 17:56:06 2022] DELETE /identity/v3/users/0efb5974b666422e8addbb14ee2a32be => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:56:06.895637 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2897503b-e606-47c4-b800-8cb5063b19db admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:06.897829 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-2897503b-e606-47c4-b800-8cb5063b19db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:06.960222 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2897503b-e606-47c4-b800-8cb5063b19db admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:07.090355 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2909463-ef16-43b0-93e9-b6f80aa34f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:07.096756 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2909463-ef16-43b0-93e9-b6f80aa34f18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:07.096756 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2909463-ef16-43b0-93e9-b6f80aa34f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:07.096756 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2909463-ef16-43b0-93e9-b6f80aa34f18 admin admin] PATH_INFO: `/v3/projects/eb39c82d4218440bb02fa84ed37f7efd` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:07.096756 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2909463-ef16-43b0-93e9-b6f80aa34f18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb39c82d4218440bb02fa84ed37f7efd)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:07.096756 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2909463-ef16-43b0-93e9-b6f80aa34f18 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:07.206501 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-a2909463-ef16-43b0-93e9-b6f80aa34f18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb39c82d4218440bb02fa84ed37f7efd', 'request_id': 'req-a2909463-ef16-43b0-93e9-b6f80aa34f18'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:07.215125 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-a2909463-ef16-43b0-93e9-b6f80aa34f18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb39c82d4218440bb02fa84ed37f7efd', 'request_id': 'req-a2909463-ef16-43b0-93e9-b6f80aa34f18'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:07.231635 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-a2909463-ef16-43b0-93e9-b6f80aa34f18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb39c82d4218440bb02fa84ed37f7efd', 'request_id': 'req-a2909463-ef16-43b0-93e9-b6f80aa34f18'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:07.260781 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-a2909463-ef16-43b0-93e9-b6f80aa34f18 admin admin] The token cache is being invalidate because project eb39c82d4218440bb02fa84ed37f7efd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86772) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 17:56:07.261488 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-a2909463-ef16-43b0-93e9-b6f80aa34f18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:07.262629 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-a2909463-ef16-43b0-93e9-b6f80aa34f18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:07.269518 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 965/1934] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 14 17:56:06 2022] DELETE /identity/v3/projects/eb39c82d4218440bb02fa84ed37f7efd => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 17:56:07.271547 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eecff74-91b6-4517-b804-4acfaf533afe None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:07.272341 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eecff74-91b6-4517-b804-4acfaf533afe None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:07.272535 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eecff74-91b6-4517-b804-4acfaf533afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:07.322390 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2909463-ef16-43b0-93e9-b6f80aa34f18 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:07.322390 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-a2909463-ef16-43b0-93e9-b6f80aa34f18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:07.323024 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-1eecff74-91b6-4517-b804-4acfaf533afe None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:56:07.323024 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-1eecff74-91b6-4517-b804-4acfaf533afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:07.335795 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:56:07.420806 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:56:07.449337 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2909463-ef16-43b0-93e9-b6f80aa34f18 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:07.458394 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0d59a7-9ce0-47ae-a2af-95ff72e1eeb0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de55cae1600841889668e36402861203', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:07.458394 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0d59a7-9ce0-47ae-a2af-95ff72e1eeb0 service cinder] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:07.458394 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0d59a7-9ce0-47ae-a2af-95ff72e1eeb0 service cinder] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:07.458394 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0d59a7-9ce0-47ae-a2af-95ff72e1eeb0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:07.458972 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-af0d59a7-9ce0-47ae-a2af-95ff72e1eeb0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:07.507256 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 970/1935] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:56:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 17:56:07.519242 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457af1a7-e282-4e8d-94bb-0a515754d83d None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:07.519588 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457af1a7-e282-4e8d-94bb-0a515754d83d None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:07.519813 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457af1a7-e282-4e8d-94bb-0a515754d83d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:07.571311 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-457af1a7-e282-4e8d-94bb-0a515754d83d None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:56:07.575004 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-457af1a7-e282-4e8d-94bb-0a515754d83d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:07.586807 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0d59a7-9ce0-47ae-a2af-95ff72e1eeb0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:07.588588 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0d59a7-9ce0-47ae-a2af-95ff72e1eeb0 service cinder] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:07.599409 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 971/1936] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:56:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:56:07.602916 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457af1a7-e282-4e8d-94bb-0a515754d83d None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:07.604441 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 966/1937] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:56:07 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:56:07.622382 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457af1a7-e282-4e8d-94bb-0a515754d83d None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:07.628752 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02bc319-f836-49d9-b266-1ea84f77f522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:07.630076 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02bc319-f836-49d9-b266-1ea84f77f522 admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:07.630583 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02bc319-f836-49d9-b266-1ea84f77f522 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:07.631283 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02bc319-f836-49d9-b266-1ea84f77f522 admin admin] PATH_INFO: `/v3/domains` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:07.632697 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02bc319-f836-49d9-b266-1ea84f77f522 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:56:07.641639 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02bc319-f836-49d9-b266-1ea84f77f522 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:07.646024 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02bc319-f836-49d9-b266-1ea84f77f522 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:07.668332 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 972/1938] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 14 17:56:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:56:07.674862 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0d59a7-9ce0-47ae-a2af-95ff72e1eeb0 service cinder] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:07.689173 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0d59a7-9ce0-47ae-a2af-95ff72e1eeb0 service cinder] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:07.695457 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce87071-e284-4742-8733-7a7d29f0e7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:07.697140 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce87071-e284-4742-8733-7a7d29f0e7cc admin admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:07.698004 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce87071-e284-4742-8733-7a7d29f0e7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:07.698515 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce87071-e284-4742-8733-7a7d29f0e7cc admin admin] PATH_INFO: `/v3/projects` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:07.700272 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce87071-e284-4742-8733-7a7d29f0e7cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:07.702584 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce87071-e284-4742-8733-7a7d29f0e7cc admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:07.736120 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 967/1939] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 14 17:56:07 2022] POST /identity/v3/projects => generated 379 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:56:07.740592 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02bc319-f836-49d9-b266-1ea84f77f522 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:07.753933 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02bc319-f836-49d9-b266-1ea84f77f522 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:07.840204 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d3806c-2b77-4aed-94e4-97e51b8fb384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:07.841278 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d3806c-2b77-4aed-94e4-97e51b8fb384 admin admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:07.841819 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d3806c-2b77-4aed-94e4-97e51b8fb384 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:07.842358 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d3806c-2b77-4aed-94e4-97e51b8fb384 admin admin] PATH_INFO: `/v3/users` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:07.845377 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d3806c-2b77-4aed-94e4-97e51b8fb384 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:07.849850 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d3806c-2b77-4aed-94e4-97e51b8fb384 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:07.891456 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce87071-e284-4742-8733-7a7d29f0e7cc admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:07.892129 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 973/1940] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 14 17:56:07 2022] POST /identity/v3/users => generated 290 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 17:56:07.910539 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce87071-e284-4742-8733-7a7d29f0e7cc admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:07.937866 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fc9e7f-ba11-47a0-b28b-d3a38e24726c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:07.939846 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc9e7f-ba11-47a0-b28b-d3a38e24726c admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:07.940140 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc9e7f-ba11-47a0-b28b-d3a38e24726c admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:07.941682 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc9e7f-ba11-47a0-b28b-d3a38e24726c admin admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:07.942485 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fc9e7f-ba11-47a0-b28b-d3a38e24726c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:07.948466 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fc9e7f-ba11-47a0-b28b-d3a38e24726c admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:08.057164 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 968/1941] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:56:07 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:56:08.058702 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d3806c-2b77-4aed-94e4-97e51b8fb384 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:08.070191 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d3806c-2b77-4aed-94e4-97e51b8fb384 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:08.090730 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232ab9a9-4642-46e4-acf0-e179b4e433f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:08.091808 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ab9a9-4642-46e4-acf0-e179b4e433f1 admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:08.092281 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ab9a9-4642-46e4-acf0-e179b4e433f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:08.092760 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ab9a9-4642-46e4-acf0-e179b4e433f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:08.094213 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232ab9a9-4642-46e4-acf0-e179b4e433f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:08.096356 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232ab9a9-4642-46e4-acf0-e179b4e433f1 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:08.119446 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 974/1942] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:56:08 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:56:08.123855 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fc9e7f-ba11-47a0-b28b-d3a38e24726c admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:08.142187 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fc9e7f-ba11-47a0-b28b-d3a38e24726c admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:08.153021 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e577c7-db95-43e3-ae95-327ee0606d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:08.154839 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e577c7-db95-43e3-ae95-327ee0606d7f admin admin] REQUEST_METHOD: `PUT` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:08.155296 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e577c7-db95-43e3-ae95-327ee0606d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:08.155840 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e577c7-db95-43e3-ae95-327ee0606d7f admin admin] PATH_INFO: `/v3/projects/fd80079ad04a47b4b320cae9c167086d/users/03841e9b24c848e2948ae7c5ffa82c86/roles/95d753870f97426cb1ce32e078621a4c` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:08.187859 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e577c7-db95-43e3-ae95-327ee0606d7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd80079ad04a47b4b320cae9c167086d, user_id=03841e9b24c848e2948ae7c5ffa82c86, role_id=95d753870f97426cb1ce32e078621a4c)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:08.193049 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e577c7-db95-43e3-ae95-327ee0606d7f admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:08.234271 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 969/1943] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 17:56:08 2022] PUT /identity/v3/projects/fd80079ad04a47b4b320cae9c167086d/users/03841e9b24c848e2948ae7c5ffa82c86/roles/95d753870f97426cb1ce32e078621a4c => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:56:08.245990 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffb77e6-693e-445a-9714-570cad4b142f None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:08.246251 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffb77e6-693e-445a-9714-570cad4b142f None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:08.246524 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffb77e6-693e-445a-9714-570cad4b142f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:08.298331 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-1ffb77e6-693e-445a-9714-570cad4b142f None None] MFA Rules not processed for user `03841e9b24c848e2948ae7c5ffa82c86`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:56:08.300317 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-1ffb77e6-693e-445a-9714-570cad4b142f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:08.488452 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:56:08.499547 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 975/1944] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:56:08 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:56:08.507095 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e577c7-db95-43e3-ae95-327ee0606d7f admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:08.705357 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e577c7-db95-43e3-ae95-327ee0606d7f admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:08.724553 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9f8cfa-2900-4faf-986e-e523fe593bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:08.725980 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f8cfa-2900-4faf-986e-e523fe593bef admin admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:08.726461 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f8cfa-2900-4faf-986e-e523fe593bef admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:08.726944 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f8cfa-2900-4faf-986e-e523fe593bef admin admin] PATH_INFO: `/v3/projects` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:08.728105 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9f8cfa-2900-4faf-986e-e523fe593bef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:08.731149 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9f8cfa-2900-4faf-986e-e523fe593bef admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:08.794765 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 970/1945] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 14 17:56:08 2022] POST /identity/v3/projects => generated 381 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:56:08.799542 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffb77e6-693e-445a-9714-570cad4b142f None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:08.813283 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffb77e6-693e-445a-9714-570cad4b142f None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:08.898683 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea5bcec-e158-4942-9f09-0f984804a53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:08.900450 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea5bcec-e158-4942-9f09-0f984804a53b admin admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:08.901052 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea5bcec-e158-4942-9f09-0f984804a53b admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:08.901990 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea5bcec-e158-4942-9f09-0f984804a53b admin admin] PATH_INFO: `/v3/users` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:08.904071 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea5bcec-e158-4942-9f09-0f984804a53b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:08.908283 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea5bcec-e158-4942-9f09-0f984804a53b admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:08.959395 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 976/1946] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 14 17:56:08 2022] POST /identity/v3/users => generated 297 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:56:08.964911 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9f8cfa-2900-4faf-986e-e523fe593bef admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:08.977839 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9f8cfa-2900-4faf-986e-e523fe593bef admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:08.983616 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b41c7f3-0042-4d3a-88fe-15e818c33caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:08.984337 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b41c7f3-0042-4d3a-88fe-15e818c33caf admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:08.984622 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b41c7f3-0042-4d3a-88fe-15e818c33caf admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:08.984906 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b41c7f3-0042-4d3a-88fe-15e818c33caf admin admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:08.985877 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b41c7f3-0042-4d3a-88fe-15e818c33caf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:08.987551 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b41c7f3-0042-4d3a-88fe-15e818c33caf admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:09.000983 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 971/1947] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:56:08 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:56:09.006311 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea5bcec-e158-4942-9f09-0f984804a53b admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:09.025231 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea5bcec-e158-4942-9f09-0f984804a53b admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:09.033835 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4e88ca-f9dd-43ff-ba7e-110a3d1e747c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:09.035447 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e88ca-f9dd-43ff-ba7e-110a3d1e747c admin admin] REQUEST_METHOD: `PUT` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:09.035974 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e88ca-f9dd-43ff-ba7e-110a3d1e747c admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:09.036560 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e88ca-f9dd-43ff-ba7e-110a3d1e747c admin admin] PATH_INFO: `/v3/projects/3ad2d0f2521b4a0e84778a60468f02b6/users/67e783b3603f42bdb15df0ef4e82fac4/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:09.069210 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4e88ca-f9dd-43ff-ba7e-110a3d1e747c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ad2d0f2521b4a0e84778a60468f02b6, user_id=67e783b3603f42bdb15df0ef4e82fac4, role_id=4651a1cc7b4d4ab7a7a9ca1e77e58e71)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:09.074823 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4e88ca-f9dd-43ff-ba7e-110a3d1e747c admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:09.094552 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 977/1948] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 17:56:09 2022] PUT /identity/v3/projects/3ad2d0f2521b4a0e84778a60468f02b6/users/67e783b3603f42bdb15df0ef4e82fac4/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 17:56:09.099110 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b41c7f3-0042-4d3a-88fe-15e818c33caf admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:09.107680 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:56:09.113626 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b41c7f3-0042-4d3a-88fe-15e818c33caf admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:09.214505 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbb1063-bb47-4187-bbd9-2c8e9ae76a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:09.215541 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbb1063-bb47-4187-bbd9-2c8e9ae76a7c admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:09.216085 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbb1063-bb47-4187-bbd9-2c8e9ae76a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:09.216543 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbb1063-bb47-4187-bbd9-2c8e9ae76a7c admin admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:09.218079 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbb1063-bb47-4187-bbd9-2c8e9ae76a7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:09.221492 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbb1063-bb47-4187-bbd9-2c8e9ae76a7c admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:09.240919 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 972/1949] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:56:09 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:56:09.249769 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4e88ca-f9dd-43ff-ba7e-110a3d1e747c admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:09.269350 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4e88ca-f9dd-43ff-ba7e-110a3d1e747c admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:09.275566 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3dedc9-1409-44ae-9fc1-922999d12836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:09.276492 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3dedc9-1409-44ae-9fc1-922999d12836 admin admin] REQUEST_METHOD: `PUT` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:09.276789 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3dedc9-1409-44ae-9fc1-922999d12836 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:09.277643 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3dedc9-1409-44ae-9fc1-922999d12836 admin admin] PATH_INFO: `/v3/projects/3ad2d0f2521b4a0e84778a60468f02b6/users/67e783b3603f42bdb15df0ef4e82fac4/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:09.279748 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3dedc9-1409-44ae-9fc1-922999d12836 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ad2d0f2521b4a0e84778a60468f02b6, user_id=67e783b3603f42bdb15df0ef4e82fac4, role_id=4651a1cc7b4d4ab7a7a9ca1e77e58e71)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:09.282507 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3dedc9-1409-44ae-9fc1-922999d12836 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:09.297442 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 978/1950] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 17:56:09 2022] PUT /identity/v3/projects/3ad2d0f2521b4a0e84778a60468f02b6/users/67e783b3603f42bdb15df0ef4e82fac4/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:56:09.310849 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e0e8e-777d-4040-9456-4b4fc521a508 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:09.311286 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e0e8e-777d-4040-9456-4b4fc521a508 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:09.311731 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e0e8e-777d-4040-9456-4b4fc521a508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:09.364612 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-f29e0e8e-777d-4040-9456-4b4fc521a508 None None] MFA Rules not processed for user `67e783b3603f42bdb15df0ef4e82fac4`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:56:09.366981 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-f29e0e8e-777d-4040-9456-4b4fc521a508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:09.494444 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 973/1951] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:56:09 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:56:09.507052 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3dedc9-1409-44ae-9fc1-922999d12836 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:09.508917 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-4b3dedc9-1409-44ae-9fc1-922999d12836 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:09.579732 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3dedc9-1409-44ae-9fc1-922999d12836 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:09.583899 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a523cc-341f-42a3-ad17-00b441871bed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de55cae1600841889668e36402861203', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:09.584678 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a523cc-341f-42a3-ad17-00b441871bed service cinder] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:09.585030 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a523cc-341f-42a3-ad17-00b441871bed service cinder] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:09.585380 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a523cc-341f-42a3-ad17-00b441871bed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:09.597707 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a523cc-341f-42a3-ad17-00b441871bed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:09.599493 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a523cc-341f-42a3-ad17-00b441871bed service cinder] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:09.615370 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 979/1952] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:56:09 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:56:10.259117 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29e0e8e-777d-4040-9456-4b4fc521a508 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:10.263420 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-f29e0e8e-777d-4040-9456-4b4fc521a508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:10.506069 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29e0e8e-777d-4040-9456-4b4fc521a508 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:10.519335 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7839557d-b1cb-4b39-821d-2394e76f4dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:10.520800 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7839557d-b1cb-4b39-821d-2394e76f4dd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:10.521184 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7839557d-b1cb-4b39-821d-2394e76f4dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:10.521889 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7839557d-b1cb-4b39-821d-2394e76f4dd6 admin admin] PATH_INFO: `/v3/users/145984f1273d47e2a9b4aa4e5cec37c9` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:10.524215 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7839557d-b1cb-4b39-821d-2394e76f4dd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=145984f1273d47e2a9b4aa4e5cec37c9)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:10.528419 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7839557d-b1cb-4b39-821d-2394e76f4dd6 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:10.600064 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:56:10.633445 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-7839557d-b1cb-4b39-821d-2394e76f4dd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '145984f1273d47e2a9b4aa4e5cec37c9'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:10.651237 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-7839557d-b1cb-4b39-821d-2394e76f4dd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '145984f1273d47e2a9b4aa4e5cec37c9'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:10.653646 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a523cc-341f-42a3-ad17-00b441871bed service cinder] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:10.661091 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-7839557d-b1cb-4b39-821d-2394e76f4dd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '145984f1273d47e2a9b4aa4e5cec37c9'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:10.661924 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-7839557d-b1cb-4b39-821d-2394e76f4dd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '145984f1273d47e2a9b4aa4e5cec37c9'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:10.666565 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a523cc-341f-42a3-ad17-00b441871bed service cinder] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:10.674338 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402f3d0d-6223-48fb-ad80-cc6d245c0977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:10.675555 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f3d0d-6223-48fb-ad80-cc6d245c0977 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:10.676035 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f3d0d-6223-48fb-ad80-cc6d245c0977 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:10.676552 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f3d0d-6223-48fb-ad80-cc6d245c0977 admin admin] PATH_INFO: `/v3/users/03841e9b24c848e2948ae7c5ffa82c86` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:10.678925 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402f3d0d-6223-48fb-ad80-cc6d245c0977 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03841e9b24c848e2948ae7c5ffa82c86)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:10.682098 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402f3d0d-6223-48fb-ad80-cc6d245c0977 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:10.682884 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-7839557d-b1cb-4b39-821d-2394e76f4dd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '145984f1273d47e2a9b4aa4e5cec37c9'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:10.692447 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 974/1953] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 14 17:56:10 2022] DELETE /identity/v3/users/145984f1273d47e2a9b4aa4e5cec37c9 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:56:10.699522 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b991a6c7-d190-40c9-925c-23978e668b2c None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:10.699833 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b991a6c7-d190-40c9-925c-23978e668b2c None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:10.700123 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b991a6c7-d190-40c9-925c-23978e668b2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:10.744723 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-b991a6c7-d190-40c9-925c-23978e668b2c None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:56:10.746991 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-b991a6c7-d190-40c9-925c-23978e668b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:10.812236 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-402f3d0d-6223-48fb-ad80-cc6d245c0977 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03841e9b24c848e2948ae7c5ffa82c86'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:10.820097 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:56:10.845118 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-402f3d0d-6223-48fb-ad80-cc6d245c0977 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03841e9b24c848e2948ae7c5ffa82c86'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:10.879950 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-402f3d0d-6223-48fb-ad80-cc6d245c0977 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03841e9b24c848e2948ae7c5ffa82c86'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:10.881148 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-402f3d0d-6223-48fb-ad80-cc6d245c0977 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03841e9b24c848e2948ae7c5ffa82c86'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:10.882196 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-402f3d0d-6223-48fb-ad80-cc6d245c0977 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03841e9b24c848e2948ae7c5ffa82c86'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:10.914650 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 975/1954] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:56:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:56:10.924670 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b991a6c7-d190-40c9-925c-23978e668b2c None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:10.927635 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-b991a6c7-d190-40c9-925c-23978e668b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:10.937881 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 980/1955] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 14 17:56:10 2022] DELETE /identity/v3/users/03841e9b24c848e2948ae7c5ffa82c86 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 17:56:10.950240 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8962cc1a-8271-4c67-b487-78abecfddc75 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:10.950675 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8962cc1a-8271-4c67-b487-78abecfddc75 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:10.951083 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8962cc1a-8271-4c67-b487-78abecfddc75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:10.997618 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-8962cc1a-8271-4c67-b487-78abecfddc75 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:56:11.002109 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-8962cc1a-8271-4c67-b487-78abecfddc75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:11.010110 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b991a6c7-d190-40c9-925c-23978e668b2c None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:11.086852 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6ed31c-b2ac-42a7-89c6-825621bfe314 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:11.087523 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6ed31c-b2ac-42a7-89c6-825621bfe314 service neutron] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:11.087910 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6ed31c-b2ac-42a7-89c6-825621bfe314 service neutron] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:11.088259 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6ed31c-b2ac-42a7-89c6-825621bfe314 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:11.106169 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:56:11.133567 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 981/1956] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:56:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:56:11.145098 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8962cc1a-8271-4c67-b487-78abecfddc75 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:11.159372 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8962cc1a-8271-4c67-b487-78abecfddc75 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:11.163634 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f75a85b-bbd7-4c56-b724-d42e754826df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:11.164392 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f75a85b-bbd7-4c56-b724-d42e754826df service neutron] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:11.164980 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f75a85b-bbd7-4c56-b724-d42e754826df service neutron] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:11.165135 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f75a85b-bbd7-4c56-b724-d42e754826df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:11.177476 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f75a85b-bbd7-4c56-b724-d42e754826df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:11.179197 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f75a85b-bbd7-4c56-b724-d42e754826df service neutron] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:11.211796 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 982/1957] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:56:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 17:56:11.234364 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6ed31c-b2ac-42a7-89c6-825621bfe314 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:11.238201 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6ed31c-b2ac-42a7-89c6-825621bfe314 service neutron] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:11.268068 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 976/1958] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:56:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 17:56:12.055087 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f75a85b-bbd7-4c56-b724-d42e754826df service neutron] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:12.057139 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-9f75a85b-bbd7-4c56-b724-d42e754826df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:12.092508 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f75a85b-bbd7-4c56-b724-d42e754826df service neutron] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:12.101752 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fa2bfb-d627-43f9-a486-32dc077193aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:12.104473 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fa2bfb-d627-43f9-a486-32dc077193aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:12.105091 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fa2bfb-d627-43f9-a486-32dc077193aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:12.106356 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fa2bfb-d627-43f9-a486-32dc077193aa admin admin] PATH_INFO: `/v3/users/f48d7ca1bf124870bae6b6e8c57c0d46` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:12.111323 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fa2bfb-d627-43f9-a486-32dc077193aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=f48d7ca1bf124870bae6b6e8c57c0d46)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:12.118802 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fa2bfb-d627-43f9-a486-32dc077193aa admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:12.231823 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-57fa2bfb-d627-43f9-a486-32dc077193aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f48d7ca1bf124870bae6b6e8c57c0d46'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:12.249789 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-57fa2bfb-d627-43f9-a486-32dc077193aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f48d7ca1bf124870bae6b6e8c57c0d46'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:12.269379 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-57fa2bfb-d627-43f9-a486-32dc077193aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f48d7ca1bf124870bae6b6e8c57c0d46'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:12.270471 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-57fa2bfb-d627-43f9-a486-32dc077193aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f48d7ca1bf124870bae6b6e8c57c0d46'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:12.271208 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-57fa2bfb-d627-43f9-a486-32dc077193aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f48d7ca1bf124870bae6b6e8c57c0d46'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:12.299782 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 983/1959] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 14 17:56:12 2022] DELETE /identity/v3/users/f48d7ca1bf124870bae6b6e8c57c0d46 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 17:56:12.308065 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e6ea3-6a18-4df3-9123-9596df79d347 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:12.309889 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e6ea3-6a18-4df3-9123-9596df79d347 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:12.310507 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e6ea3-6a18-4df3-9123-9596df79d347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:12.352249 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-9e7e6ea3-6a18-4df3-9123-9596df79d347 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:56:12.354831 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-9e7e6ea3-6a18-4df3-9123-9596df79d347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:12.552340 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 977/1960] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:56:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:56:12.650537 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fa2bfb-d627-43f9-a486-32dc077193aa admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:12.655261 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-57fa2bfb-d627-43f9-a486-32dc077193aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:12.733592 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:56:12.775579 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fa2bfb-d627-43f9-a486-32dc077193aa admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:12.781444 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674cbbe0-3210-4338-abda-24c5a615a29d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:12.784288 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674cbbe0-3210-4338-abda-24c5a615a29d service neutron] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:12.784816 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674cbbe0-3210-4338-abda-24c5a615a29d service neutron] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:12.785110 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674cbbe0-3210-4338-abda-24c5a615a29d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:12.799750 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674cbbe0-3210-4338-abda-24c5a615a29d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:12.801423 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674cbbe0-3210-4338-abda-24c5a615a29d service neutron] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:12.816359 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 984/1961] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:56:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:56:12.886514 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7e6ea3-6a18-4df3-9123-9596df79d347 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:12.889137 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-9e7e6ea3-6a18-4df3-9123-9596df79d347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:12.914956 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7e6ea3-6a18-4df3-9123-9596df79d347 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:12.926595 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72acdbcc-232d-4daa-8876-7cf00b44145c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:12.928568 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72acdbcc-232d-4daa-8876-7cf00b44145c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:12.929297 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72acdbcc-232d-4daa-8876-7cf00b44145c admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:12.929850 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72acdbcc-232d-4daa-8876-7cf00b44145c admin admin] PATH_INFO: `/v3/projects/fd80079ad04a47b4b320cae9c167086d` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:12.932499 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72acdbcc-232d-4daa-8876-7cf00b44145c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd80079ad04a47b4b320cae9c167086d)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:12.937123 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72acdbcc-232d-4daa-8876-7cf00b44145c admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:13.092997 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-72acdbcc-232d-4daa-8876-7cf00b44145c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd80079ad04a47b4b320cae9c167086d', 'request_id': 'req-72acdbcc-232d-4daa-8876-7cf00b44145c'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:13.101608 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-72acdbcc-232d-4daa-8876-7cf00b44145c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd80079ad04a47b4b320cae9c167086d', 'request_id': 'req-72acdbcc-232d-4daa-8876-7cf00b44145c'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:13.112092 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-72acdbcc-232d-4daa-8876-7cf00b44145c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd80079ad04a47b4b320cae9c167086d', 'request_id': 'req-72acdbcc-232d-4daa-8876-7cf00b44145c'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:13.143999 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-72acdbcc-232d-4daa-8876-7cf00b44145c admin admin] The token cache is being invalidate because project fd80079ad04a47b4b320cae9c167086d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86772) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 17:56:13.144838 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-72acdbcc-232d-4daa-8876-7cf00b44145c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:13.146590 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-72acdbcc-232d-4daa-8876-7cf00b44145c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:13.154572 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 978/1962] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 14 17:56:12 2022] DELETE /identity/v3/projects/fd80079ad04a47b4b320cae9c167086d => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:56:13.156235 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674cbbe0-3210-4338-abda-24c5a615a29d service neutron] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:13.171679 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674cbbe0-3210-4338-abda-24c5a615a29d service neutron] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:13.297229 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23d1d8e-18aa-4225-ae10-240c07cbdb1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:13.299084 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23d1d8e-18aa-4225-ae10-240c07cbdb1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:13.299607 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23d1d8e-18aa-4225-ae10-240c07cbdb1f admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:13.300179 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23d1d8e-18aa-4225-ae10-240c07cbdb1f admin admin] PATH_INFO: `/v3/users/67e783b3603f42bdb15df0ef4e82fac4` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:13.302798 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23d1d8e-18aa-4225-ae10-240c07cbdb1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=67e783b3603f42bdb15df0ef4e82fac4)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:13.306796 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23d1d8e-18aa-4225-ae10-240c07cbdb1f admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:13.433961 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-a23d1d8e-18aa-4225-ae10-240c07cbdb1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67e783b3603f42bdb15df0ef4e82fac4'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:13.453227 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-a23d1d8e-18aa-4225-ae10-240c07cbdb1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67e783b3603f42bdb15df0ef4e82fac4'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:13.496699 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72acdbcc-232d-4daa-8876-7cf00b44145c admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:13.499846 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-72acdbcc-232d-4daa-8876-7cf00b44145c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:13.547301 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-a23d1d8e-18aa-4225-ae10-240c07cbdb1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67e783b3603f42bdb15df0ef4e82fac4'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:13.552666 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-a23d1d8e-18aa-4225-ae10-240c07cbdb1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67e783b3603f42bdb15df0ef4e82fac4'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:13.556418 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-a23d1d8e-18aa-4225-ae10-240c07cbdb1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67e783b3603f42bdb15df0ef4e82fac4'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:13.609310 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72acdbcc-232d-4daa-8876-7cf00b44145c admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:13.638700 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebd3e61-6572-444e-8324-1023396db5e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:13.644942 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 985/1963] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 14 17:56:13 2022] DELETE /identity/v3/users/67e783b3603f42bdb15df0ef4e82fac4 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:56:13.651358 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebd3e61-6572-444e-8324-1023396db5e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:13.652912 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebd3e61-6572-444e-8324-1023396db5e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:13.653625 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebd3e61-6572-444e-8324-1023396db5e0 admin admin] PATH_INFO: `/v3/projects/cc1a3146d93a4fb4aa2094ce0f2eba6b` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:13.657050 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebd3e61-6572-444e-8324-1023396db5e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc1a3146d93a4fb4aa2094ce0f2eba6b)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:13.661321 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebd3e61-6572-444e-8324-1023396db5e0 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:13.753325 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:56:13.790856 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-cebd3e61-6572-444e-8324-1023396db5e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc1a3146d93a4fb4aa2094ce0f2eba6b', 'request_id': 'req-cebd3e61-6572-444e-8324-1023396db5e0'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:13.802475 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-cebd3e61-6572-444e-8324-1023396db5e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc1a3146d93a4fb4aa2094ce0f2eba6b', 'request_id': 'req-cebd3e61-6572-444e-8324-1023396db5e0'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:13.819359 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-cebd3e61-6572-444e-8324-1023396db5e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc1a3146d93a4fb4aa2094ce0f2eba6b', 'request_id': 'req-cebd3e61-6572-444e-8324-1023396db5e0'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:13.866458 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-cebd3e61-6572-444e-8324-1023396db5e0 admin admin] The token cache is being invalidate because project cc1a3146d93a4fb4aa2094ce0f2eba6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86772) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 17:56:13.866774 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-cebd3e61-6572-444e-8324-1023396db5e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:13.869975 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-cebd3e61-6572-444e-8324-1023396db5e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:13.876438 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 979/1964] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 14 17:56:13 2022] DELETE /identity/v3/projects/cc1a3146d93a4fb4aa2094ce0f2eba6b => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 17:56:13.883156 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23d1d8e-18aa-4225-ae10-240c07cbdb1f admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:13.886114 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-a23d1d8e-18aa-4225-ae10-240c07cbdb1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:13.999195 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:56:14.039759 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23d1d8e-18aa-4225-ae10-240c07cbdb1f admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:14.184314 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25df7afc-e7c9-4718-af38-8860f53980b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:14.185945 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25df7afc-e7c9-4718-af38-8860f53980b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:14.186278 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25df7afc-e7c9-4718-af38-8860f53980b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:14.186571 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25df7afc-e7c9-4718-af38-8860f53980b1 admin admin] PATH_INFO: `/v3/users/3285825b91754db88c94cb6c10132473` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:14.188803 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25df7afc-e7c9-4718-af38-8860f53980b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3285825b91754db88c94cb6c10132473)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:14.191209 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25df7afc-e7c9-4718-af38-8860f53980b1 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:14.196718 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebd3e61-6572-444e-8324-1023396db5e0 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:14.200133 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-cebd3e61-6572-444e-8324-1023396db5e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:14.258082 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebd3e61-6572-444e-8324-1023396db5e0 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:14.284581 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673060b4-4a01-4e2b-a618-4410ba39a156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:14.289969 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673060b4-4a01-4e2b-a618-4410ba39a156 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:14.290266 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673060b4-4a01-4e2b-a618-4410ba39a156 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:14.290557 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673060b4-4a01-4e2b-a618-4410ba39a156 admin admin] PATH_INFO: `/v3/projects/ce1308d5b8e3407189c278141355a941` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:14.292458 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673060b4-4a01-4e2b-a618-4410ba39a156 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce1308d5b8e3407189c278141355a941)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:14.295769 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673060b4-4a01-4e2b-a618-4410ba39a156 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:14.323779 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-25df7afc-e7c9-4718-af38-8860f53980b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3285825b91754db88c94cb6c10132473'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:14.338524 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-25df7afc-e7c9-4718-af38-8860f53980b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3285825b91754db88c94cb6c10132473'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:14.361870 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-673060b4-4a01-4e2b-a618-4410ba39a156 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce1308d5b8e3407189c278141355a941', 'request_id': 'req-673060b4-4a01-4e2b-a618-4410ba39a156'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:14.363613 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-25df7afc-e7c9-4718-af38-8860f53980b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3285825b91754db88c94cb6c10132473'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:14.364607 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-25df7afc-e7c9-4718-af38-8860f53980b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3285825b91754db88c94cb6c10132473'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:14.365649 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-25df7afc-e7c9-4718-af38-8860f53980b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3285825b91754db88c94cb6c10132473'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:14.369986 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-673060b4-4a01-4e2b-a618-4410ba39a156 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce1308d5b8e3407189c278141355a941', 'request_id': 'req-673060b4-4a01-4e2b-a618-4410ba39a156'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:14.381466 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-673060b4-4a01-4e2b-a618-4410ba39a156 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce1308d5b8e3407189c278141355a941', 'request_id': 'req-673060b4-4a01-4e2b-a618-4410ba39a156'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:14.387795 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 986/1965] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 14 17:56:13 2022] DELETE /identity/v3/users/3285825b91754db88c94cb6c10132473 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:56:14.398309 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-673060b4-4a01-4e2b-a618-4410ba39a156 admin admin] The token cache is being invalidate because project ce1308d5b8e3407189c278141355a941 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86772) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 17:56:14.399510 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-673060b4-4a01-4e2b-a618-4410ba39a156 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:14.400492 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-673060b4-4a01-4e2b-a618-4410ba39a156 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:14.403083 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 980/1966] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 14 17:56:14 2022] DELETE /identity/v3/projects/ce1308d5b8e3407189c278141355a941 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:56:14.406898 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25df7afc-e7c9-4718-af38-8860f53980b1 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:14.408404 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-25df7afc-e7c9-4718-af38-8860f53980b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:14.568489 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25df7afc-e7c9-4718-af38-8860f53980b1 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:14.581352 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5714b656-4d6e-44cf-bd01-dbe569f6772c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:14.583017 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5714b656-4d6e-44cf-bd01-dbe569f6772c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:14.583563 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5714b656-4d6e-44cf-bd01-dbe569f6772c admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:14.584091 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5714b656-4d6e-44cf-bd01-dbe569f6772c admin admin] PATH_INFO: `/v3/users/eaf64df9e8c94dba96202589a5fd8c45` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:14.588159 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5714b656-4d6e-44cf-bd01-dbe569f6772c admin admin] RBAC: Authorizing `identity:delete_user(user_id=eaf64df9e8c94dba96202589a5fd8c45)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:14.594462 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5714b656-4d6e-44cf-bd01-dbe569f6772c admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:14.622973 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:56:14.692268 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-5714b656-4d6e-44cf-bd01-dbe569f6772c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eaf64df9e8c94dba96202589a5fd8c45'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:14.703811 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-5714b656-4d6e-44cf-bd01-dbe569f6772c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eaf64df9e8c94dba96202589a5fd8c45'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:14.721422 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-5714b656-4d6e-44cf-bd01-dbe569f6772c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eaf64df9e8c94dba96202589a5fd8c45'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:14.723728 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-5714b656-4d6e-44cf-bd01-dbe569f6772c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eaf64df9e8c94dba96202589a5fd8c45'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:14.724902 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-5714b656-4d6e-44cf-bd01-dbe569f6772c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eaf64df9e8c94dba96202589a5fd8c45'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:14.757580 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 987/1967] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 14 17:56:14 2022] DELETE /identity/v3/users/eaf64df9e8c94dba96202589a5fd8c45 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:56:15.034472 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673060b4-4a01-4e2b-a618-4410ba39a156 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:15.038594 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-673060b4-4a01-4e2b-a618-4410ba39a156 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:15.109147 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5714b656-4d6e-44cf-bd01-dbe569f6772c admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:15.111698 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-5714b656-4d6e-44cf-bd01-dbe569f6772c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:15.224477 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673060b4-4a01-4e2b-a618-4410ba39a156 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:15.247769 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5714b656-4d6e-44cf-bd01-dbe569f6772c admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:15.253367 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9e8859-4063-4436-ad12-0fa95f536895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:15.254162 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e8859-4063-4436-ad12-0fa95f536895 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:15.254440 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e8859-4063-4436-ad12-0fa95f536895 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:15.254911 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e8859-4063-4436-ad12-0fa95f536895 admin admin] PATH_INFO: `/v3/projects/ae19ffc96daf418599c3331beb346856` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:15.256380 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9e8859-4063-4436-ad12-0fa95f536895 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae19ffc96daf418599c3331beb346856)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:15.258501 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9e8859-4063-4436-ad12-0fa95f536895 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:15.341336 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-bb9e8859-4063-4436-ad12-0fa95f536895 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae19ffc96daf418599c3331beb346856', 'request_id': 'req-bb9e8859-4063-4436-ad12-0fa95f536895'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:15.355148 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-bb9e8859-4063-4436-ad12-0fa95f536895 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae19ffc96daf418599c3331beb346856', 'request_id': 'req-bb9e8859-4063-4436-ad12-0fa95f536895'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:15.363997 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-bb9e8859-4063-4436-ad12-0fa95f536895 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae19ffc96daf418599c3331beb346856', 'request_id': 'req-bb9e8859-4063-4436-ad12-0fa95f536895'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:15.384763 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-bb9e8859-4063-4436-ad12-0fa95f536895 admin admin] The token cache is being invalidate because project ae19ffc96daf418599c3331beb346856 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86773) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 17:56:15.385058 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-bb9e8859-4063-4436-ad12-0fa95f536895 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:15.385869 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-bb9e8859-4063-4436-ad12-0fa95f536895 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:15.388496 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 988/1968] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 14 17:56:15 2022] DELETE /identity/v3/projects/ae19ffc96daf418599c3331beb346856 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:56:15.389678 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9e8859-4063-4436-ad12-0fa95f536895 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:15.394746 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-bb9e8859-4063-4436-ad12-0fa95f536895 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:15.423718 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:56:15.470595 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7a7232-4d7b-4b82-baf1-69e528275f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:15.479854 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7a7232-4d7b-4b82-baf1-69e528275f5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:15.480143 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7a7232-4d7b-4b82-baf1-69e528275f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:15.482625 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7a7232-4d7b-4b82-baf1-69e528275f5d admin admin] PATH_INFO: `/v3/projects/3ad2d0f2521b4a0e84778a60468f02b6` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:15.485647 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7a7232-4d7b-4b82-baf1-69e528275f5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ad2d0f2521b4a0e84778a60468f02b6)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:15.493474 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7a7232-4d7b-4b82-baf1-69e528275f5d admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:15.511338 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:56:15.619893 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9e8859-4063-4436-ad12-0fa95f536895 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:15.631327 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-fe7a7232-4d7b-4b82-baf1-69e528275f5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ad2d0f2521b4a0e84778a60468f02b6', 'request_id': 'req-fe7a7232-4d7b-4b82-baf1-69e528275f5d'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:15.645478 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-fe7a7232-4d7b-4b82-baf1-69e528275f5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ad2d0f2521b4a0e84778a60468f02b6', 'request_id': 'req-fe7a7232-4d7b-4b82-baf1-69e528275f5d'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:15.662372 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-fe7a7232-4d7b-4b82-baf1-69e528275f5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ad2d0f2521b4a0e84778a60468f02b6', 'request_id': 'req-fe7a7232-4d7b-4b82-baf1-69e528275f5d'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:15.720416 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-fe7a7232-4d7b-4b82-baf1-69e528275f5d admin admin] The token cache is being invalidate because project 3ad2d0f2521b4a0e84778a60468f02b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86772) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 17:56:15.721380 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-fe7a7232-4d7b-4b82-baf1-69e528275f5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:15.722569 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d64fe47-9560-4571-83b2-d4d74176e8c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:15.723568 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d64fe47-9560-4571-83b2-d4d74176e8c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:15.723766 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d64fe47-9560-4571-83b2-d4d74176e8c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:15.724045 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d64fe47-9560-4571-83b2-d4d74176e8c0 admin admin] PATH_INFO: `/v3/projects/6f990aa69c2f49659bed93f69bf0811d` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:15.727256 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-fe7a7232-4d7b-4b82-baf1-69e528275f5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:15.730636 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d64fe47-9560-4571-83b2-d4d74176e8c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f990aa69c2f49659bed93f69bf0811d)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:15.738363 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d64fe47-9560-4571-83b2-d4d74176e8c0 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:15.739304 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 981/1969] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 14 17:56:15 2022] DELETE /identity/v3/projects/3ad2d0f2521b4a0e84778a60468f02b6 => generated 0 bytes in 701 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:56:15.745054 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e2de5-298d-43ef-81a2-0d1d4c8d9039 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:15.748041 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e2de5-298d-43ef-81a2-0d1d4c8d9039 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:15.748376 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e2de5-298d-43ef-81a2-0d1d4c8d9039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:15.827362 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-586e2de5-298d-43ef-81a2-0d1d4c8d9039 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:56:15.828768 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-5d64fe47-9560-4571-83b2-d4d74176e8c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f990aa69c2f49659bed93f69bf0811d', 'request_id': 'req-5d64fe47-9560-4571-83b2-d4d74176e8c0'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:15.832540 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-586e2de5-298d-43ef-81a2-0d1d4c8d9039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:15.838303 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-5d64fe47-9560-4571-83b2-d4d74176e8c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f990aa69c2f49659bed93f69bf0811d', 'request_id': 'req-5d64fe47-9560-4571-83b2-d4d74176e8c0'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:15.847378 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-5d64fe47-9560-4571-83b2-d4d74176e8c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f990aa69c2f49659bed93f69bf0811d', 'request_id': 'req-5d64fe47-9560-4571-83b2-d4d74176e8c0'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:15.866193 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-5d64fe47-9560-4571-83b2-d4d74176e8c0 admin admin] The token cache is being invalidate because project 6f990aa69c2f49659bed93f69bf0811d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86773) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 17:56:15.866489 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-5d64fe47-9560-4571-83b2-d4d74176e8c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:15.867185 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-5d64fe47-9560-4571-83b2-d4d74176e8c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:15.868964 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 989/1970] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 14 17:56:15 2022] DELETE /identity/v3/projects/6f990aa69c2f49659bed93f69bf0811d => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:56:15.870450 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d6861-0c3e-4984-8935-84833fd8317f None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:15.870740 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d6861-0c3e-4984-8935-84833fd8317f None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:15.871048 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d6861-0c3e-4984-8935-84833fd8317f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:15.908858 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-767d6861-0c3e-4984-8935-84833fd8317f None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:56:15.910195 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-767d6861-0c3e-4984-8935-84833fd8317f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:15.995790 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 982/1971] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:56:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:56:16.012510 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79ea521-3b2f-457f-8c5b-9bbe126a8aa4 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:16.013278 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79ea521-3b2f-457f-8c5b-9bbe126a8aa4 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:16.014422 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79ea521-3b2f-457f-8c5b-9bbe126a8aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:16.026160 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 990/1972] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:56:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:56:16.031130 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b760fccd-05ec-49e1-9cf2-7b213e54642d None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:16.033998 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b760fccd-05ec-49e1-9cf2-7b213e54642d None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:16.034450 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b760fccd-05ec-49e1-9cf2-7b213e54642d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:16.055975 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-b79ea521-3b2f-457f-8c5b-9bbe126a8aa4 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:56:16.058115 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-b79ea521-3b2f-457f-8c5b-9bbe126a8aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:16.075411 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 983/1973] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:56:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:56:16.078526 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47021f5-0b55-4603-adb0-40c01b74fddf None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:16.079065 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47021f5-0b55-4603-adb0-40c01b74fddf None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:16.079587 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47021f5-0b55-4603-adb0-40c01b74fddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:16.081103 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:56:16.150899 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-b760fccd-05ec-49e1-9cf2-7b213e54642d None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:56:16.152459 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-b47021f5-0b55-4603-adb0-40c01b74fddf None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:56:16.153350 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-b760fccd-05ec-49e1-9cf2-7b213e54642d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:16.154749 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-b47021f5-0b55-4603-adb0-40c01b74fddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:16.172017 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 984/1974] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:56:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:56:16.175038 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a9160-2722-458c-ab05-98bff4e781ee None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:16.175738 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a9160-2722-458c-ab05-98bff4e781ee None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:16.176171 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a9160-2722-458c-ab05-98bff4e781ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:16.196807 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 991/1975] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:56:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:56:16.199581 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b760fccd-05ec-49e1-9cf2-7b213e54642d None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:16.217380 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-905a9160-2722-458c-ab05-98bff4e781ee None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:56:16.222108 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-905a9160-2722-458c-ab05-98bff4e781ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:16.226323 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b760fccd-05ec-49e1-9cf2-7b213e54642d None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:16.243253 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b187809-c64a-4d5a-a346-eeb1df5b9418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:16.244765 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b187809-c64a-4d5a-a346-eeb1df5b9418 admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:16.245337 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b187809-c64a-4d5a-a346-eeb1df5b9418 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:16.245758 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b187809-c64a-4d5a-a346-eeb1df5b9418 admin admin] PATH_INFO: `/v3/domains` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:16.264490 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b187809-c64a-4d5a-a346-eeb1df5b9418 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:56:16.264490 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b187809-c64a-4d5a-a346-eeb1df5b9418 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:16.264490 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b187809-c64a-4d5a-a346-eeb1df5b9418 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:16.270046 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 985/1976] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:56:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:56:16.271861 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905a9160-2722-458c-ab05-98bff4e781ee None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:16.286793 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905a9160-2722-458c-ab05-98bff4e781ee None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:16.295404 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 992/1977] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 14 17:56:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:56:16.296882 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b187809-c64a-4d5a-a346-eeb1df5b9418 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:16.300778 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f532051b-ca1e-44f9-a062-e0c5bcbe6b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:16.302048 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f532051b-ca1e-44f9-a062-e0c5bcbe6b89 admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:16.302739 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f532051b-ca1e-44f9-a062-e0c5bcbe6b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:16.303169 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f532051b-ca1e-44f9-a062-e0c5bcbe6b89 admin admin] PATH_INFO: `/v3/domains` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:16.304523 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f532051b-ca1e-44f9-a062-e0c5bcbe6b89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:56:16.305029 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f532051b-ca1e-44f9-a062-e0c5bcbe6b89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:16.308048 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f532051b-ca1e-44f9-a062-e0c5bcbe6b89 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:16.331704 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b187809-c64a-4d5a-a346-eeb1df5b9418 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:16.343002 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 986/1978] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 14 17:56:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:56:16.344662 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f532051b-ca1e-44f9-a062-e0c5bcbe6b89 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:16.344973 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5a1132-2bd0-4fc8-910b-fe8302e14068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:16.346430 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a1132-2bd0-4fc8-910b-fe8302e14068 admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:16.347285 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a1132-2bd0-4fc8-910b-fe8302e14068 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:16.347851 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a1132-2bd0-4fc8-910b-fe8302e14068 admin admin] PATH_INFO: `/v3/domains` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:16.349412 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5a1132-2bd0-4fc8-910b-fe8302e14068 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:56:16.350133 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5a1132-2bd0-4fc8-910b-fe8302e14068 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:16.354695 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5a1132-2bd0-4fc8-910b-fe8302e14068 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:16.367473 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f532051b-ca1e-44f9-a062-e0c5bcbe6b89 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:16.376117 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64a843c-e22c-4cad-9f5f-450b7ad4880c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:16.377491 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a843c-e22c-4cad-9f5f-450b7ad4880c admin admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:16.377709 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a843c-e22c-4cad-9f5f-450b7ad4880c admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:16.378301 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a843c-e22c-4cad-9f5f-450b7ad4880c admin admin] PATH_INFO: `/v3/projects` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:16.379510 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64a843c-e22c-4cad-9f5f-450b7ad4880c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:16.383593 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64a843c-e22c-4cad-9f5f-450b7ad4880c admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:16.393622 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 993/1979] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 14 17:56:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:56:16.396113 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5a1132-2bd0-4fc8-910b-fe8302e14068 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:16.423841 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5a1132-2bd0-4fc8-910b-fe8302e14068 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:16.433393 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 987/1980] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 14 17:56:16 2022] POST /identity/v3/projects => generated 359 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:56:16.433393 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64a843c-e22c-4cad-9f5f-450b7ad4880c admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:16.439481 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f7e7d0-6c24-4422-a445-70bf2a4de6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:16.442470 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f7e7d0-6c24-4422-a445-70bf2a4de6da admin admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:16.442470 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f7e7d0-6c24-4422-a445-70bf2a4de6da admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:16.442470 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f7e7d0-6c24-4422-a445-70bf2a4de6da admin admin] PATH_INFO: `/v3/projects` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:16.443725 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f7e7d0-6c24-4422-a445-70bf2a4de6da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:16.447837 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f7e7d0-6c24-4422-a445-70bf2a4de6da admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:16.482309 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:56:16.509685 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 994/1981] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 14 17:56:16 2022] POST /identity/v3/projects => generated 387 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:56:16.511245 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f7e7d0-6c24-4422-a445-70bf2a4de6da admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:16.549840 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64a843c-e22c-4cad-9f5f-450b7ad4880c admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:16.631163 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f7e7d0-6c24-4422-a445-70bf2a4de6da admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:16.639283 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92914f8b-35fb-41ea-b978-a09361081bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:16.640434 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92914f8b-35fb-41ea-b978-a09361081bfc admin admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:16.640902 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92914f8b-35fb-41ea-b978-a09361081bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:16.641385 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92914f8b-35fb-41ea-b978-a09361081bfc admin admin] PATH_INFO: `/v3/users` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:16.642443 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92914f8b-35fb-41ea-b978-a09361081bfc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:16.645111 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92914f8b-35fb-41ea-b978-a09361081bfc admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:16.657490 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316c28fa-2f53-4d49-aa15-57302e5937ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:16.658635 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316c28fa-2f53-4d49-aa15-57302e5937ac admin admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:16.659055 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316c28fa-2f53-4d49-aa15-57302e5937ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:16.659569 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316c28fa-2f53-4d49-aa15-57302e5937ac admin admin] PATH_INFO: `/v3/projects` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:16.660795 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316c28fa-2f53-4d49-aa15-57302e5937ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:16.664262 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316c28fa-2f53-4d49-aa15-57302e5937ac admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:16.679626 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 995/1982] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 14 17:56:16 2022] POST /identity/v3/users => generated 280 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:56:16.680747 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92914f8b-35fb-41ea-b978-a09361081bfc admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:16.694201 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92914f8b-35fb-41ea-b978-a09361081bfc admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:16.703632 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70b4ec3-69c2-46f7-9472-c7b137afa57a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:16.705009 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b4ec3-69c2-46f7-9472-c7b137afa57a admin admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:16.705708 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b4ec3-69c2-46f7-9472-c7b137afa57a admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:16.706262 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b4ec3-69c2-46f7-9472-c7b137afa57a admin admin] PATH_INFO: `/v3/users` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:16.707580 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70b4ec3-69c2-46f7-9472-c7b137afa57a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:16.711191 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70b4ec3-69c2-46f7-9472-c7b137afa57a admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:16.725099 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 988/1983] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 14 17:56:16 2022] POST /identity/v3/projects => generated 393 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:56:16.725099 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316c28fa-2f53-4d49-aa15-57302e5937ac admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:16.748317 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 996/1984] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 14 17:56:16 2022] POST /identity/v3/users => generated 294 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:56:16.749714 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70b4ec3-69c2-46f7-9472-c7b137afa57a admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:16.766397 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70b4ec3-69c2-46f7-9472-c7b137afa57a admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:16.877835 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316c28fa-2f53-4d49-aa15-57302e5937ac admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:16.883830 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c36eda3-8845-4659-a087-ca5dff74fad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:16.884860 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c36eda3-8845-4659-a087-ca5dff74fad1 admin admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:16.885331 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c36eda3-8845-4659-a087-ca5dff74fad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:16.886014 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c36eda3-8845-4659-a087-ca5dff74fad1 admin admin] PATH_INFO: `/v3/users` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:16.888196 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c36eda3-8845-4659-a087-ca5dff74fad1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:16.889448 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3797ed9-9043-49e8-9d64-0557dd5e2106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:16.891440 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3797ed9-9043-49e8-9d64-0557dd5e2106 admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:16.891812 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c36eda3-8845-4659-a087-ca5dff74fad1 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:16.892148 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3797ed9-9043-49e8-9d64-0557dd5e2106 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:16.892724 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3797ed9-9043-49e8-9d64-0557dd5e2106 admin admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:16.894447 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3797ed9-9043-49e8-9d64-0557dd5e2106 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:16.898598 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3797ed9-9043-49e8-9d64-0557dd5e2106 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:16.921099 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 989/1985] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:56:16 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:56:16.923076 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3797ed9-9043-49e8-9d64-0557dd5e2106 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:16.935983 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 997/1986] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 14 17:56:16 2022] POST /identity/v3/users => generated 297 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:56:16.937465 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c36eda3-8845-4659-a087-ca5dff74fad1 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:16.955144 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3797ed9-9043-49e8-9d64-0557dd5e2106 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:16.958776 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c36eda3-8845-4659-a087-ca5dff74fad1 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:16.966079 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec02f477-c13f-4dae-aa13-d94f5e77303e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:16.966989 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec02f477-c13f-4dae-aa13-d94f5e77303e admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:16.967417 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec02f477-c13f-4dae-aa13-d94f5e77303e admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:16.967863 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec02f477-c13f-4dae-aa13-d94f5e77303e admin admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:16.969161 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec02f477-c13f-4dae-aa13-d94f5e77303e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:16.972198 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec02f477-c13f-4dae-aa13-d94f5e77303e admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:16.972801 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1ddbd1-9c51-4a6a-b3b1-bcc2112f7825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:16.974369 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1ddbd1-9c51-4a6a-b3b1-bcc2112f7825 admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:16.975028 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1ddbd1-9c51-4a6a-b3b1-bcc2112f7825 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:16.975554 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1ddbd1-9c51-4a6a-b3b1-bcc2112f7825 admin admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:16.976928 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1ddbd1-9c51-4a6a-b3b1-bcc2112f7825 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:16.977134 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:56:16.980064 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1ddbd1-9c51-4a6a-b3b1-bcc2112f7825 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:17.001025 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 990/1988] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:56:16 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:56:17.001513 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 998/1988] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:56:16 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:56:17.002271 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1ddbd1-9c51-4a6a-b3b1-bcc2112f7825 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:17.007148 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec02f477-c13f-4dae-aa13-d94f5e77303e admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:17.026386 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec02f477-c13f-4dae-aa13-d94f5e77303e admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:17.031142 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1ddbd1-9c51-4a6a-b3b1-bcc2112f7825 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:17.037003 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6ba284-1289-4b16-9482-d25d16609007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:17.038345 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ba284-1289-4b16-9482-d25d16609007 admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:17.039171 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ba284-1289-4b16-9482-d25d16609007 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:17.039678 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ba284-1289-4b16-9482-d25d16609007 admin admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:17.041175 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6ba284-1289-4b16-9482-d25d16609007 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:17.044524 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6ba284-1289-4b16-9482-d25d16609007 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:17.047089 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96593e7-7d6f-4034-9719-9fbed9dcf744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:17.047932 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96593e7-7d6f-4034-9719-9fbed9dcf744 admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:17.048589 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96593e7-7d6f-4034-9719-9fbed9dcf744 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:17.048905 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96593e7-7d6f-4034-9719-9fbed9dcf744 admin admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:17.050762 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96593e7-7d6f-4034-9719-9fbed9dcf744 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:17.053921 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96593e7-7d6f-4034-9719-9fbed9dcf744 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:17.069296 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 999/1989] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:56:17 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 17:56:17.076925 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6ba284-1289-4b16-9482-d25d16609007 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:17.077400 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 991/1990] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:56:17 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:56:17.079078 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96593e7-7d6f-4034-9719-9fbed9dcf744 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:17.104267 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6ba284-1289-4b16-9482-d25d16609007 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:17.110186 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96593e7-7d6f-4034-9719-9fbed9dcf744 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:17.114949 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab8e391-7001-412f-8268-7a93b83e42d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:17.116661 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab8e391-7001-412f-8268-7a93b83e42d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:17.117210 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab8e391-7001-412f-8268-7a93b83e42d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:17.118673 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab8e391-7001-412f-8268-7a93b83e42d7 admin admin] PATH_INFO: `/v3/projects/03fe16e5cd7b423185318b921519b935/users/62798dbcd01f4561aae23d78c809fab2/roles/95d753870f97426cb1ce32e078621a4c` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:17.121022 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79aaa33-ac8b-4449-8421-d823ab1c7de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:17.123076 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79aaa33-ac8b-4449-8421-d823ab1c7de8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:17.123606 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79aaa33-ac8b-4449-8421-d823ab1c7de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:17.124174 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79aaa33-ac8b-4449-8421-d823ab1c7de8 admin admin] PATH_INFO: `/v3/projects/721ba2a14e6b443dbae60aa41cf66fdf/users/5da602b1b3af4e1fa0b141a402c6f971/roles/95d753870f97426cb1ce32e078621a4c` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:17.150948 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab8e391-7001-412f-8268-7a93b83e42d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03fe16e5cd7b423185318b921519b935, user_id=62798dbcd01f4561aae23d78c809fab2, role_id=95d753870f97426cb1ce32e078621a4c)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:17.157682 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab8e391-7001-412f-8268-7a93b83e42d7 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:17.159068 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79aaa33-ac8b-4449-8421-d823ab1c7de8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=721ba2a14e6b443dbae60aa41cf66fdf, user_id=5da602b1b3af4e1fa0b141a402c6f971, role_id=95d753870f97426cb1ce32e078621a4c)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:17.165368 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79aaa33-ac8b-4449-8421-d823ab1c7de8 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:17.186582 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1000/1991] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 17:56:17 2022] PUT /identity/v3/projects/03fe16e5cd7b423185318b921519b935/users/62798dbcd01f4561aae23d78c809fab2/roles/95d753870f97426cb1ce32e078621a4c => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:56:17.197144 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab8e391-7001-412f-8268-7a93b83e42d7 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:17.207304 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 992/1992] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 17:56:17 2022] PUT /identity/v3/projects/721ba2a14e6b443dbae60aa41cf66fdf/users/5da602b1b3af4e1fa0b141a402c6f971/roles/95d753870f97426cb1ce32e078621a4c => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:56:17.209518 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa4af2b-e68d-4e61-bf2f-1e8fdf386d1c None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:17.210091 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa4af2b-e68d-4e61-bf2f-1e8fdf386d1c None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:17.210656 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa4af2b-e68d-4e61-bf2f-1e8fdf386d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:17.231961 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:56:17.263609 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-9aa4af2b-e68d-4e61-bf2f-1e8fdf386d1c None None] MFA Rules not processed for user `62798dbcd01f4561aae23d78c809fab2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:56:17.265551 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-9aa4af2b-e68d-4e61-bf2f-1e8fdf386d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:17.356535 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab8e391-7001-412f-8268-7a93b83e42d7 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:17.441248 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 993/1993] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:56:17 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:56:17.450661 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f60b21-7141-4840-a3b2-b41dae4ebebb None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:17.451668 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f60b21-7141-4840-a3b2-b41dae4ebebb None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:17.451668 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f60b21-7141-4840-a3b2-b41dae4ebebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:17.490922 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb16fe26-dc5e-4e60-a7cb-a8fbf5b59c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:17.492369 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb16fe26-dc5e-4e60-a7cb-a8fbf5b59c50 admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:17.492754 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb16fe26-dc5e-4e60-a7cb-a8fbf5b59c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:17.493134 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb16fe26-dc5e-4e60-a7cb-a8fbf5b59c50 admin admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:17.494367 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb16fe26-dc5e-4e60-a7cb-a8fbf5b59c50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:17.497360 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb16fe26-dc5e-4e60-a7cb-a8fbf5b59c50 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:17.511328 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1001/1994] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:56:17 2022] GET /identity/v3/roles => generated 1420 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:56:17.518736 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb16fe26-dc5e-4e60-a7cb-a8fbf5b59c50 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:17.535324 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb16fe26-dc5e-4e60-a7cb-a8fbf5b59c50 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:17.564586 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-66f60b21-7141-4840-a3b2-b41dae4ebebb None None] MFA Rules not processed for user `5da602b1b3af4e1fa0b141a402c6f971`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:56:17.567889 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-66f60b21-7141-4840-a3b2-b41dae4ebebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:17.575370 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38389ef-9f5d-4c3c-b00a-b952f5dc2d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:17.582334 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38389ef-9f5d-4c3c-b00a-b952f5dc2d07 admin admin] REQUEST_METHOD: `PUT` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:17.586291 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38389ef-9f5d-4c3c-b00a-b952f5dc2d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:17.586291 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38389ef-9f5d-4c3c-b00a-b952f5dc2d07 admin admin] PATH_INFO: `/v3/projects/f1e48baabda1481082fff7caeab10180/users/e3aa995b3cdc4798b43b0c818e8adb2d/roles/95d753870f97426cb1ce32e078621a4c` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:17.657930 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38389ef-9f5d-4c3c-b00a-b952f5dc2d07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1e48baabda1481082fff7caeab10180, user_id=e3aa995b3cdc4798b43b0c818e8adb2d, role_id=95d753870f97426cb1ce32e078621a4c)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:17.677115 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38389ef-9f5d-4c3c-b00a-b952f5dc2d07 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:17.722017 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1002/1995] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 17:56:17 2022] PUT /identity/v3/projects/f1e48baabda1481082fff7caeab10180/users/e3aa995b3cdc4798b43b0c818e8adb2d/roles/95d753870f97426cb1ce32e078621a4c => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:56:17.723726 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38389ef-9f5d-4c3c-b00a-b952f5dc2d07 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:17.736062 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-f38389ef-9f5d-4c3c-b00a-b952f5dc2d07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:17.762552 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 994/1996] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:56:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:56:17.765077 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c20d7-5c9d-44bd-a24f-f29fc4a37c59 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:17.765614 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c20d7-5c9d-44bd-a24f-f29fc4a37c59 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:17.766134 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c20d7-5c9d-44bd-a24f-f29fc4a37c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:17.819863 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-b29c20d7-5c9d-44bd-a24f-f29fc4a37c59 None None] MFA Rules not processed for user `e3aa995b3cdc4798b43b0c818e8adb2d`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:56:17.822380 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-b29c20d7-5c9d-44bd-a24f-f29fc4a37c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:17.842890 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:56:17.878556 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38389ef-9f5d-4c3c-b00a-b952f5dc2d07 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:17.887241 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53715d81-8be7-42ae-a466-1e9e807ec035 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de55cae1600841889668e36402861203', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:17.888639 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53715d81-8be7-42ae-a466-1e9e807ec035 service cinder] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:17.889225 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53715d81-8be7-42ae-a466-1e9e807ec035 service cinder] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:17.889830 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53715d81-8be7-42ae-a466-1e9e807ec035 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:18.001312 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 995/1997] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:56:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:56:18.003489 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29c20d7-5c9d-44bd-a24f-f29fc4a37c59 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:18.039369 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:56:18.066518 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53715d81-8be7-42ae-a466-1e9e807ec035 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:18.070091 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53715d81-8be7-42ae-a466-1e9e807ec035 service cinder] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:18.088150 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1003/1998] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:56:17 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:56:18.089379 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53715d81-8be7-42ae-a466-1e9e807ec035 service cinder] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:18.097480 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29c20d7-5c9d-44bd-a24f-f29fc4a37c59 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:18.104858 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c282c368-66b0-4537-bdfb-a34b64383e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:18.106325 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53715d81-8be7-42ae-a466-1e9e807ec035 service cinder] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:18.106479 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c282c368-66b0-4537-bdfb-a34b64383e9d admin admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:18.106942 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c282c368-66b0-4537-bdfb-a34b64383e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:18.107117 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c282c368-66b0-4537-bdfb-a34b64383e9d admin admin] PATH_INFO: `/v3/projects` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:18.107847 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c282c368-66b0-4537-bdfb-a34b64383e9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:18.110198 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c282c368-66b0-4537-bdfb-a34b64383e9d admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:18.112169 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2751e13-ebd3-48b0-884f-dcd90841e9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:18.113035 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2751e13-ebd3-48b0-884f-dcd90841e9dd admin admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:18.113994 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2751e13-ebd3-48b0-884f-dcd90841e9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:18.114544 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2751e13-ebd3-48b0-884f-dcd90841e9dd admin admin] PATH_INFO: `/v3/projects` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:18.116301 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2751e13-ebd3-48b0-884f-dcd90841e9dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:18.118428 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2751e13-ebd3-48b0-884f-dcd90841e9dd admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:18.151203 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1004/1999] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 14 17:56:18 2022] POST /identity/v3/projects => generated 393 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:56:18.152237 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2751e13-ebd3-48b0-884f-dcd90841e9dd admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:18.156939 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 996/2000] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 14 17:56:18 2022] POST /identity/v3/projects => generated 385 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:56:18.158804 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c282c368-66b0-4537-bdfb-a34b64383e9d admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:18.249757 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c282c368-66b0-4537-bdfb-a34b64383e9d admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:18.258685 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122bf7b6-5513-44dd-a7a0-860958a7175c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:18.259907 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122bf7b6-5513-44dd-a7a0-860958a7175c admin admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:18.260420 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122bf7b6-5513-44dd-a7a0-860958a7175c admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:18.261198 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122bf7b6-5513-44dd-a7a0-860958a7175c admin admin] PATH_INFO: `/v3/users` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:18.263113 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122bf7b6-5513-44dd-a7a0-860958a7175c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:18.267831 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122bf7b6-5513-44dd-a7a0-860958a7175c admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:18.269708 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2751e13-ebd3-48b0-884f-dcd90841e9dd admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:18.275819 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc90132-edac-4705-ae90-e601834e1627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:18.277309 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc90132-edac-4705-ae90-e601834e1627 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:18.277826 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc90132-edac-4705-ae90-e601834e1627 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:18.278286 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc90132-edac-4705-ae90-e601834e1627 admin admin] PATH_INFO: `/v3/users/62798dbcd01f4561aae23d78c809fab2` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:18.280052 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc90132-edac-4705-ae90-e601834e1627 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62798dbcd01f4561aae23d78c809fab2)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:18.283122 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc90132-edac-4705-ae90-e601834e1627 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:18.311567 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 997/2001] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 14 17:56:18 2022] POST /identity/v3/users => generated 303 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:56:18.311567 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122bf7b6-5513-44dd-a7a0-860958a7175c admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:18.330455 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122bf7b6-5513-44dd-a7a0-860958a7175c admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:18.344816 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a305e9c-5b23-41a8-80e5-623c3feddb18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:18.345572 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a305e9c-5b23-41a8-80e5-623c3feddb18 admin admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:18.345847 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a305e9c-5b23-41a8-80e5-623c3feddb18 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:18.346134 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a305e9c-5b23-41a8-80e5-623c3feddb18 admin admin] PATH_INFO: `/v3/users` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:18.346849 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a305e9c-5b23-41a8-80e5-623c3feddb18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:18.349215 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a305e9c-5b23-41a8-80e5-623c3feddb18 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:18.381980 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 998/2002] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 14 17:56:18 2022] POST /identity/v3/users => generated 299 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:56:18.381980 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a305e9c-5b23-41a8-80e5-623c3feddb18 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:18.394730 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a305e9c-5b23-41a8-80e5-623c3feddb18 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:18.398074 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-2cc90132-edac-4705-ae90-e601834e1627 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62798dbcd01f4561aae23d78c809fab2'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:18.400794 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d26ecf-f2a6-4547-b5f0-1cefe00b01ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:18.401494 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d26ecf-f2a6-4547-b5f0-1cefe00b01ad admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:18.401830 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d26ecf-f2a6-4547-b5f0-1cefe00b01ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:18.402110 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d26ecf-f2a6-4547-b5f0-1cefe00b01ad admin admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:18.403997 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d26ecf-f2a6-4547-b5f0-1cefe00b01ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:18.404719 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d26ecf-f2a6-4547-b5f0-1cefe00b01ad admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:18.421073 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 999/2003] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:56:18 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:56:18.422248 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d26ecf-f2a6-4547-b5f0-1cefe00b01ad admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:18.438706 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-2cc90132-edac-4705-ae90-e601834e1627 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62798dbcd01f4561aae23d78c809fab2'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:18.440135 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d26ecf-f2a6-4547-b5f0-1cefe00b01ad admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:18.446560 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35291c53-d72c-4b0d-aba7-5c44b1399f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:18.447422 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35291c53-d72c-4b0d-aba7-5c44b1399f9a admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:18.447779 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35291c53-d72c-4b0d-aba7-5c44b1399f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:18.448089 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35291c53-d72c-4b0d-aba7-5c44b1399f9a admin admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:18.449263 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35291c53-d72c-4b0d-aba7-5c44b1399f9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:18.452300 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35291c53-d72c-4b0d-aba7-5c44b1399f9a admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:18.465711 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1000/2004] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:56:18 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:56:18.467329 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35291c53-d72c-4b0d-aba7-5c44b1399f9a admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:18.480128 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35291c53-d72c-4b0d-aba7-5c44b1399f9a admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:18.486609 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6ce00d-f0da-4d82-87a7-535a1ab7efad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:18.487540 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ce00d-f0da-4d82-87a7-535a1ab7efad admin admin] REQUEST_METHOD: `PUT` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:18.487822 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ce00d-f0da-4d82-87a7-535a1ab7efad admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:18.488106 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ce00d-f0da-4d82-87a7-535a1ab7efad admin admin] PATH_INFO: `/v3/projects/a154ed46d78d49cd9f6221f1827f13bd/users/fb7fd74c3669453bb3324cd2d4821d4a/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:18.505318 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-2cc90132-edac-4705-ae90-e601834e1627 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62798dbcd01f4561aae23d78c809fab2'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:18.506886 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-2cc90132-edac-4705-ae90-e601834e1627 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62798dbcd01f4561aae23d78c809fab2'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:18.507855 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6ce00d-f0da-4d82-87a7-535a1ab7efad admin admin] RBAC: Authorizing `identity:create_grant(project_id=a154ed46d78d49cd9f6221f1827f13bd, user_id=fb7fd74c3669453bb3324cd2d4821d4a, role_id=4651a1cc7b4d4ab7a7a9ca1e77e58e71)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:18.508649 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-2cc90132-edac-4705-ae90-e601834e1627 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62798dbcd01f4561aae23d78c809fab2'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:18.510738 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6ce00d-f0da-4d82-87a7-535a1ab7efad admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:18.531192 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:56:18.542072 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1001/2005] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 17:56:18 2022] PUT /identity/v3/projects/a154ed46d78d49cd9f6221f1827f13bd/users/fb7fd74c3669453bb3324cd2d4821d4a/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:56:18.543332 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6ce00d-f0da-4d82-87a7-535a1ab7efad admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:18.547880 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-cd6ce00d-f0da-4d82-87a7-535a1ab7efad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:18.565204 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1005/2006] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 14 17:56:18 2022] DELETE /identity/v3/users/62798dbcd01f4561aae23d78c809fab2 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:56:18.568222 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc90132-edac-4705-ae90-e601834e1627 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:18.575000 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-2cc90132-edac-4705-ae90-e601834e1627 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:18.596512 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:56:18.655028 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6ce00d-f0da-4d82-87a7-535a1ab7efad admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:18.772893 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc90132-edac-4705-ae90-e601834e1627 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:18.778449 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1819320-0be5-445e-b82e-5c3f292c6229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:18.779272 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1819320-0be5-445e-b82e-5c3f292c6229 admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:18.779662 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1819320-0be5-445e-b82e-5c3f292c6229 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:18.780049 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1819320-0be5-445e-b82e-5c3f292c6229 admin admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:18.780901 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1819320-0be5-445e-b82e-5c3f292c6229 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:18.782776 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1819320-0be5-445e-b82e-5c3f292c6229 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:18.803193 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1006/2007] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:56:18 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:56:18.803193 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3182f7-f0cd-452f-a914-b62405a0d6bd None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:18.803193 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3182f7-f0cd-452f-a914-b62405a0d6bd None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:18.803193 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3182f7-f0cd-452f-a914-b62405a0d6bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:18.823938 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-0a3182f7-f0cd-452f-a914-b62405a0d6bd None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:56:18.825982 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-0a3182f7-f0cd-452f-a914-b62405a0d6bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:18.838837 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1007/2008] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:56:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:56:18.839612 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3182f7-f0cd-452f-a914-b62405a0d6bd None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:18.866461 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3182f7-f0cd-452f-a914-b62405a0d6bd None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:18.870317 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dacf159-5619-4127-bbdc-51616268f3a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:18.872316 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dacf159-5619-4127-bbdc-51616268f3a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:18.872798 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dacf159-5619-4127-bbdc-51616268f3a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:18.873274 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dacf159-5619-4127-bbdc-51616268f3a5 admin admin] PATH_INFO: `/v3/projects/5fdbf724cb1d4a3e9005af9121bdaa87/users/c10d129e59574df58d26dbbb13754877/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:18.875968 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b6f35a-f702-4ee0-bd12-6d9303718684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:18.877922 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b6f35a-f702-4ee0-bd12-6d9303718684 admin admin] REQUEST_METHOD: `PUT` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:18.878509 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b6f35a-f702-4ee0-bd12-6d9303718684 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:18.880163 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b6f35a-f702-4ee0-bd12-6d9303718684 admin admin] PATH_INFO: `/v3/projects/a154ed46d78d49cd9f6221f1827f13bd/users/fb7fd74c3669453bb3324cd2d4821d4a/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:18.884308 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b6f35a-f702-4ee0-bd12-6d9303718684 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a154ed46d78d49cd9f6221f1827f13bd, user_id=fb7fd74c3669453bb3324cd2d4821d4a, role_id=4651a1cc7b4d4ab7a7a9ca1e77e58e71)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:18.894169 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b6f35a-f702-4ee0-bd12-6d9303718684 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:18.903119 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dacf159-5619-4127-bbdc-51616268f3a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fdbf724cb1d4a3e9005af9121bdaa87, user_id=c10d129e59574df58d26dbbb13754877, role_id=4651a1cc7b4d4ab7a7a9ca1e77e58e71)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:18.908436 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dacf159-5619-4127-bbdc-51616268f3a5 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:18.918498 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1008/2009] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 17:56:18 2022] PUT /identity/v3/projects/a154ed46d78d49cd9f6221f1827f13bd/users/fb7fd74c3669453bb3324cd2d4821d4a/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:56:18.920278 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b6f35a-f702-4ee0-bd12-6d9303718684 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:18.937074 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-43b6f35a-f702-4ee0-bd12-6d9303718684 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:18.953415 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1002/2010] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 17:56:18 2022] PUT /identity/v3/projects/5fdbf724cb1d4a3e9005af9121bdaa87/users/c10d129e59574df58d26dbbb13754877/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:56:18.955399 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de41fe2-c708-4076-be34-b6b10d034429 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:18.955759 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de41fe2-c708-4076-be34-b6b10d034429 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:18.956652 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de41fe2-c708-4076-be34-b6b10d034429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:19.001495 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-9de41fe2-c708-4076-be34-b6b10d034429 None None] MFA Rules not processed for user `fb7fd74c3669453bb3324cd2d4821d4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:56:19.006012 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-9de41fe2-c708-4076-be34-b6b10d034429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:19.110243 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1003/2011] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:56:18 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:56:19.115424 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b6f35a-f702-4ee0-bd12-6d9303718684 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:19.122348 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de41fe2-c708-4076-be34-b6b10d034429 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:19.184686 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:56:19.221788 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de41fe2-c708-4076-be34-b6b10d034429 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:19.228628 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eae40f0-e4a6-4d90-a7c8-883982b9e081 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:19.228970 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2044a7f6-e900-4d2f-9ba0-383495d20584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:19.229521 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eae40f0-e4a6-4d90-a7c8-883982b9e081 service neutron] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:19.229783 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2044a7f6-e900-4d2f-9ba0-383495d20584 admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:19.229959 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eae40f0-e4a6-4d90-a7c8-883982b9e081 service neutron] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:19.230103 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2044a7f6-e900-4d2f-9ba0-383495d20584 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:19.230261 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eae40f0-e4a6-4d90-a7c8-883982b9e081 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:19.230403 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2044a7f6-e900-4d2f-9ba0-383495d20584 admin admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:19.231668 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2044a7f6-e900-4d2f-9ba0-383495d20584 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:19.233310 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2044a7f6-e900-4d2f-9ba0-383495d20584 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:19.243197 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eae40f0-e4a6-4d90-a7c8-883982b9e081 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:19.244729 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eae40f0-e4a6-4d90-a7c8-883982b9e081 service neutron] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:19.251700 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1004/2012] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:56:19 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:56:19.253514 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2044a7f6-e900-4d2f-9ba0-383495d20584 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:19.256197 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-2044a7f6-e900-4d2f-9ba0-383495d20584 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:19.260436 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1009/2013] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:56:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:56:19.261322 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eae40f0-e4a6-4d90-a7c8-883982b9e081 service neutron] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:19.273915 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eae40f0-e4a6-4d90-a7c8-883982b9e081 service neutron] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:19.280821 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b183d08-9aa2-4619-bfa8-41322704bf69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:19.281944 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b183d08-9aa2-4619-bfa8-41322704bf69 admin admin] REQUEST_METHOD: `PUT` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:19.282577 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b183d08-9aa2-4619-bfa8-41322704bf69 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:19.283023 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b183d08-9aa2-4619-bfa8-41322704bf69 admin admin] PATH_INFO: `/v3/projects/5fdbf724cb1d4a3e9005af9121bdaa87/users/c10d129e59574df58d26dbbb13754877/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:19.285552 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b183d08-9aa2-4619-bfa8-41322704bf69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fdbf724cb1d4a3e9005af9121bdaa87, user_id=c10d129e59574df58d26dbbb13754877, role_id=4651a1cc7b4d4ab7a7a9ca1e77e58e71)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:19.289082 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b183d08-9aa2-4619-bfa8-41322704bf69 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:19.306717 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1010/2014] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 17:56:19 2022] PUT /identity/v3/projects/5fdbf724cb1d4a3e9005af9121bdaa87/users/c10d129e59574df58d26dbbb13754877/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:56:19.317749 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deee1fa-b67a-4e37-8338-bccee0636a4b None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:19.318139 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deee1fa-b67a-4e37-8338-bccee0636a4b None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:19.318497 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deee1fa-b67a-4e37-8338-bccee0636a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:19.341653 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2044a7f6-e900-4d2f-9ba0-383495d20584 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:19.375855 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-8deee1fa-b67a-4e37-8338-bccee0636a4b None None] MFA Rules not processed for user `c10d129e59574df58d26dbbb13754877`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:56:19.378715 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-8deee1fa-b67a-4e37-8338-bccee0636a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:19.393352 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:56:19.442459 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96921529-1bc8-4fc3-b94d-b8aebb93d196 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de55cae1600841889668e36402861203', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:19.443454 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96921529-1bc8-4fc3-b94d-b8aebb93d196 service cinder] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:19.443823 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96921529-1bc8-4fc3-b94d-b8aebb93d196 service cinder] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:19.444645 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96921529-1bc8-4fc3-b94d-b8aebb93d196 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:19.595875 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96921529-1bc8-4fc3-b94d-b8aebb93d196 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:19.598163 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1011/2015] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:56:19 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 17:56:19.609179 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96921529-1bc8-4fc3-b94d-b8aebb93d196 service cinder] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:19.617584 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deee1fa-b67a-4e37-8338-bccee0636a4b None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:19.623509 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-8deee1fa-b67a-4e37-8338-bccee0636a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:19.630372 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1005/2016] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:56:19 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:56:19.674336 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deee1fa-b67a-4e37-8338-bccee0636a4b None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:19.681970 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df2efcf-283c-4622-afca-11b88a16d2b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de55cae1600841889668e36402861203', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:19.683504 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df2efcf-283c-4622-afca-11b88a16d2b9 service cinder] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:19.684541 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df2efcf-283c-4622-afca-11b88a16d2b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:19.685179 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df2efcf-283c-4622-afca-11b88a16d2b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:19.710064 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df2efcf-283c-4622-afca-11b88a16d2b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:19.712674 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96921529-1bc8-4fc3-b94d-b8aebb93d196 service cinder] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:19.726799 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df2efcf-283c-4622-afca-11b88a16d2b9 service cinder] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:19.738130 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96921529-1bc8-4fc3-b94d-b8aebb93d196 service cinder] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:19.755393 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875fc5f7-be6e-4228-b48c-c7b6a6628ebb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de55cae1600841889668e36402861203', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:19.756737 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875fc5f7-be6e-4228-b48c-c7b6a6628ebb service cinder] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:19.757755 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875fc5f7-be6e-4228-b48c-c7b6a6628ebb service cinder] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:19.760726 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875fc5f7-be6e-4228-b48c-c7b6a6628ebb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:19.767175 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-875fc5f7-be6e-4228-b48c-c7b6a6628ebb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:19.793823 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1012/2017] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:56:19 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:56:19.830032 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df2efcf-283c-4622-afca-11b88a16d2b9 service cinder] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:19.834183 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-8df2efcf-283c-4622-afca-11b88a16d2b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:20.002726 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:56:20.036632 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df2efcf-283c-4622-afca-11b88a16d2b9 service cinder] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:20.043219 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7236131-a029-478a-828a-5427d5446c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:20.044292 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7236131-a029-478a-828a-5427d5446c6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:20.044673 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7236131-a029-478a-828a-5427d5446c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:20.045053 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7236131-a029-478a-828a-5427d5446c6c admin admin] PATH_INFO: `/v3/projects/03fe16e5cd7b423185318b921519b935` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:20.046896 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875fc5f7-be6e-4228-b48c-c7b6a6628ebb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:20.047344 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7236131-a029-478a-828a-5427d5446c6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=03fe16e5cd7b423185318b921519b935)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:20.048515 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875fc5f7-be6e-4228-b48c-c7b6a6628ebb service cinder] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:20.052672 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7236131-a029-478a-828a-5427d5446c6c admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:20.065703 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1006/2018] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:56:19 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:56:20.170263 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-c7236131-a029-478a-828a-5427d5446c6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03fe16e5cd7b423185318b921519b935', 'request_id': 'req-c7236131-a029-478a-828a-5427d5446c6c'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:20.203414 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-c7236131-a029-478a-828a-5427d5446c6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03fe16e5cd7b423185318b921519b935', 'request_id': 'req-c7236131-a029-478a-828a-5427d5446c6c'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:20.225881 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-c7236131-a029-478a-828a-5427d5446c6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03fe16e5cd7b423185318b921519b935', 'request_id': 'req-c7236131-a029-478a-828a-5427d5446c6c'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:20.251478 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-c7236131-a029-478a-828a-5427d5446c6c admin admin] The token cache is being invalidate because project 03fe16e5cd7b423185318b921519b935 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86773) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 17:56:20.251749 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-c7236131-a029-478a-828a-5427d5446c6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:20.252880 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-c7236131-a029-478a-828a-5427d5446c6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:20.258110 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1013/2019] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 14 17:56:19 2022] DELETE /identity/v3/projects/03fe16e5cd7b423185318b921519b935 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:56:20.263998 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5684036c-82f3-408b-a6b7-a4a4950526af None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:20.264784 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5684036c-82f3-408b-a6b7-a4a4950526af None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:20.264784 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5684036c-82f3-408b-a6b7-a4a4950526af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:20.287971 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-5684036c-82f3-408b-a6b7-a4a4950526af None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:56:20.289235 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-5684036c-82f3-408b-a6b7-a4a4950526af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:20.422363 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1007/2020] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:56:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:56:20.432147 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092ef2df-5f12-457a-a75e-ee57699230eb None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:20.433086 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092ef2df-5f12-457a-a75e-ee57699230eb None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:20.433328 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092ef2df-5f12-457a-a75e-ee57699230eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:20.497096 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-092ef2df-5f12-457a-a75e-ee57699230eb None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:56:20.499596 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-092ef2df-5f12-457a-a75e-ee57699230eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:20.523634 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1014/2021] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:56:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:56:20.524938 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5684036c-82f3-408b-a6b7-a4a4950526af None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:20.547868 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5684036c-82f3-408b-a6b7-a4a4950526af None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:20.555052 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83912bfe-6895-421d-9d0b-0217a0638bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:20.555321 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83912bfe-6895-421d-9d0b-0217a0638bfb admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:20.555686 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83912bfe-6895-421d-9d0b-0217a0638bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:20.556094 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83912bfe-6895-421d-9d0b-0217a0638bfb admin admin] PATH_INFO: `/v3/domains` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:20.557309 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83912bfe-6895-421d-9d0b-0217a0638bfb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:56:20.557734 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83912bfe-6895-421d-9d0b-0217a0638bfb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:20.560489 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83912bfe-6895-421d-9d0b-0217a0638bfb admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:20.593767 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1008/2022] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 14 17:56:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:56:20.603453 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092ef2df-5f12-457a-a75e-ee57699230eb None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:20.623649 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092ef2df-5f12-457a-a75e-ee57699230eb None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:20.636535 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52ccd53-5a7e-42b9-abec-576b397cdd45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:20.638340 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52ccd53-5a7e-42b9-abec-576b397cdd45 admin admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:20.639003 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52ccd53-5a7e-42b9-abec-576b397cdd45 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:20.640825 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52ccd53-5a7e-42b9-abec-576b397cdd45 admin admin] PATH_INFO: `/v3/projects` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:20.643613 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52ccd53-5a7e-42b9-abec-576b397cdd45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:20.653703 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52ccd53-5a7e-42b9-abec-576b397cdd45 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:20.679004 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:56:20.764709 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1015/2023] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 14 17:56:20 2022] POST /identity/v3/projects => generated 385 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:56:20.769471 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83912bfe-6895-421d-9d0b-0217a0638bfb admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:20.794881 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83912bfe-6895-421d-9d0b-0217a0638bfb admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:20.939047 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a9161c-d34e-4f99-81d9-4e8c613d6343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:20.939876 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a9161c-d34e-4f99-81d9-4e8c613d6343 admin admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:20.940221 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a9161c-d34e-4f99-81d9-4e8c613d6343 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:20.940575 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a9161c-d34e-4f99-81d9-4e8c613d6343 admin admin] PATH_INFO: `/v3/users` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:20.941651 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a9161c-d34e-4f99-81d9-4e8c613d6343 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:20.945347 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a9161c-d34e-4f99-81d9-4e8c613d6343 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:21.005978 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1009/2024] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 14 17:56:20 2022] POST /identity/v3/users => generated 293 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:56:21.007682 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52ccd53-5a7e-42b9-abec-576b397cdd45 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:21.029731 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52ccd53-5a7e-42b9-abec-576b397cdd45 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:21.037182 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2caed1-3021-482f-a276-7bc6b4f8b8ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:21.038448 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2caed1-3021-482f-a276-7bc6b4f8b8ea admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:21.039047 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2caed1-3021-482f-a276-7bc6b4f8b8ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:21.039743 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2caed1-3021-482f-a276-7bc6b4f8b8ea admin admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:21.041016 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2caed1-3021-482f-a276-7bc6b4f8b8ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:21.044790 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2caed1-3021-482f-a276-7bc6b4f8b8ea admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:21.067537 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1016/2025] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:56:21 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 17:56:21.075120 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a9161c-d34e-4f99-81d9-4e8c613d6343 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:21.106969 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a9161c-d34e-4f99-81d9-4e8c613d6343 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:21.135617 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55166d1-09a1-4c33-9d77-fb4a49f7eb26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:21.142147 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55166d1-09a1-4c33-9d77-fb4a49f7eb26 admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:21.142570 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55166d1-09a1-4c33-9d77-fb4a49f7eb26 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:21.143232 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55166d1-09a1-4c33-9d77-fb4a49f7eb26 admin admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:21.144132 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55166d1-09a1-4c33-9d77-fb4a49f7eb26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:21.146188 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55166d1-09a1-4c33-9d77-fb4a49f7eb26 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:21.177125 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1010/2026] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:56:21 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:56:21.184929 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2caed1-3021-482f-a276-7bc6b4f8b8ea admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:21.213281 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2caed1-3021-482f-a276-7bc6b4f8b8ea admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:21.228354 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9670a91-62b9-4026-94be-fdf91cc396fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:21.230622 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9670a91-62b9-4026-94be-fdf91cc396fa admin admin] REQUEST_METHOD: `PUT` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:21.231480 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9670a91-62b9-4026-94be-fdf91cc396fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:21.232476 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9670a91-62b9-4026-94be-fdf91cc396fa admin admin] PATH_INFO: `/v3/projects/b43e35e1c4ca4047a6c5575a8597cb23/users/a35ae25dcd8c44fc9e4e333221d607ac/roles/95d753870f97426cb1ce32e078621a4c` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:21.298690 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9670a91-62b9-4026-94be-fdf91cc396fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=b43e35e1c4ca4047a6c5575a8597cb23, user_id=a35ae25dcd8c44fc9e4e333221d607ac, role_id=95d753870f97426cb1ce32e078621a4c)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:21.301675 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9670a91-62b9-4026-94be-fdf91cc396fa admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:21.346393 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1017/2027] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 17:56:21 2022] PUT /identity/v3/projects/b43e35e1c4ca4047a6c5575a8597cb23/users/a35ae25dcd8c44fc9e4e333221d607ac/roles/95d753870f97426cb1ce32e078621a4c => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:56:21.362645 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67a7eb9-58f7-45b7-8e2d-573563c4575a None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:21.363248 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67a7eb9-58f7-45b7-8e2d-573563c4575a None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:21.363248 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67a7eb9-58f7-45b7-8e2d-573563c4575a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:21.425372 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-e67a7eb9-58f7-45b7-8e2d-573563c4575a None None] MFA Rules not processed for user `a35ae25dcd8c44fc9e4e333221d607ac`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:56:21.426764 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-e67a7eb9-58f7-45b7-8e2d-573563c4575a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:21.519370 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9670a91-62b9-4026-94be-fdf91cc396fa admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:21.522850 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-d9670a91-62b9-4026-94be-fdf91cc396fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:21.544682 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:56:21.639489 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1011/2028] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:56:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:56:21.643784 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9670a91-62b9-4026-94be-fdf91cc396fa admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:21.649061 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67a7eb9-58f7-45b7-8e2d-573563c4575a None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:21.649622 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00725dc3-16f2-4a8d-ba7f-ace56c7e500f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:21.650551 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00725dc3-16f2-4a8d-ba7f-ace56c7e500f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:21.650828 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00725dc3-16f2-4a8d-ba7f-ace56c7e500f admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:21.650993 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-e67a7eb9-58f7-45b7-8e2d-573563c4575a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:21.651245 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00725dc3-16f2-4a8d-ba7f-ace56c7e500f admin admin] PATH_INFO: `/v3/users/5da602b1b3af4e1fa0b141a402c6f971` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:21.653197 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00725dc3-16f2-4a8d-ba7f-ace56c7e500f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5da602b1b3af4e1fa0b141a402c6f971)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:21.655503 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00725dc3-16f2-4a8d-ba7f-ace56c7e500f admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:21.754022 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67a7eb9-58f7-45b7-8e2d-573563c4575a None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:21.756057 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-00725dc3-16f2-4a8d-ba7f-ace56c7e500f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5da602b1b3af4e1fa0b141a402c6f971'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:21.765225 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2782734b-db94-4159-ba9e-e00c5d308dbf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de55cae1600841889668e36402861203', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:21.765950 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2782734b-db94-4159-ba9e-e00c5d308dbf service cinder] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:21.766586 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2782734b-db94-4159-ba9e-e00c5d308dbf service cinder] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:21.766777 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2782734b-db94-4159-ba9e-e00c5d308dbf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:21.770882 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-00725dc3-16f2-4a8d-ba7f-ace56c7e500f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5da602b1b3af4e1fa0b141a402c6f971'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:21.785682 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2782734b-db94-4159-ba9e-e00c5d308dbf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:21.786871 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2782734b-db94-4159-ba9e-e00c5d308dbf service cinder] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:21.808015 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-00725dc3-16f2-4a8d-ba7f-ace56c7e500f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5da602b1b3af4e1fa0b141a402c6f971'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:21.809100 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-00725dc3-16f2-4a8d-ba7f-ace56c7e500f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5da602b1b3af4e1fa0b141a402c6f971'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:21.810589 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-00725dc3-16f2-4a8d-ba7f-ace56c7e500f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5da602b1b3af4e1fa0b141a402c6f971'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:21.827026 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1012/2029] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:56:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 17:56:21.842662 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1018/2030] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 14 17:56:21 2022] DELETE /identity/v3/users/5da602b1b3af4e1fa0b141a402c6f971 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:56:21.848850 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff8b1c5-c0f3-4d48-8750-6c4be5de9010 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:21.849215 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff8b1c5-c0f3-4d48-8750-6c4be5de9010 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:21.849554 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff8b1c5-c0f3-4d48-8750-6c4be5de9010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:21.877591 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-7ff8b1c5-c0f3-4d48-8750-6c4be5de9010 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:56:21.879083 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-7ff8b1c5-c0f3-4d48-8750-6c4be5de9010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:21.978634 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1013/2031] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:56:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:56:21.987098 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00725dc3-16f2-4a8d-ba7f-ace56c7e500f admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:21.988662 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-00725dc3-16f2-4a8d-ba7f-ace56c7e500f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:22.039664 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:56:22.075499 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00725dc3-16f2-4a8d-ba7f-ace56c7e500f admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:22.080907 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20da307e-ea8a-4d30-98d5-551f926379c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:22.081900 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da307e-ea8a-4d30-98d5-551f926379c8 service neutron] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:22.082263 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da307e-ea8a-4d30-98d5-551f926379c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:22.082595 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da307e-ea8a-4d30-98d5-551f926379c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:22.117594 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20da307e-ea8a-4d30-98d5-551f926379c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:22.126120 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20da307e-ea8a-4d30-98d5-551f926379c8 service neutron] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:22.153747 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1019/2032] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:56:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:56:23.415400 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff8b1c5-c0f3-4d48-8750-6c4be5de9010 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:23.417700 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-7ff8b1c5-c0f3-4d48-8750-6c4be5de9010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:23.491485 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff8b1c5-c0f3-4d48-8750-6c4be5de9010 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:23.503461 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ae25f2-d980-4b6f-80b9-47f16a8b18ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:23.505925 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ae25f2-d980-4b6f-80b9-47f16a8b18ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:23.506758 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ae25f2-d980-4b6f-80b9-47f16a8b18ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:23.507535 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ae25f2-d980-4b6f-80b9-47f16a8b18ed admin admin] PATH_INFO: `/v3/projects/721ba2a14e6b443dbae60aa41cf66fdf` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:23.522073 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ae25f2-d980-4b6f-80b9-47f16a8b18ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=721ba2a14e6b443dbae60aa41cf66fdf)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:23.539629 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ae25f2-d980-4b6f-80b9-47f16a8b18ed admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:23.717269 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-c7ae25f2-d980-4b6f-80b9-47f16a8b18ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '721ba2a14e6b443dbae60aa41cf66fdf', 'request_id': 'req-c7ae25f2-d980-4b6f-80b9-47f16a8b18ed'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:23.732401 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-c7ae25f2-d980-4b6f-80b9-47f16a8b18ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '721ba2a14e6b443dbae60aa41cf66fdf', 'request_id': 'req-c7ae25f2-d980-4b6f-80b9-47f16a8b18ed'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:23.747378 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-c7ae25f2-d980-4b6f-80b9-47f16a8b18ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '721ba2a14e6b443dbae60aa41cf66fdf', 'request_id': 'req-c7ae25f2-d980-4b6f-80b9-47f16a8b18ed'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:23.795663 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-c7ae25f2-d980-4b6f-80b9-47f16a8b18ed admin admin] The token cache is being invalidate because project 721ba2a14e6b443dbae60aa41cf66fdf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86772) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 17:56:23.796430 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-c7ae25f2-d980-4b6f-80b9-47f16a8b18ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:23.798226 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-c7ae25f2-d980-4b6f-80b9-47f16a8b18ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:23.804829 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1014/2033] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 14 17:56:23 2022] DELETE /identity/v3/projects/721ba2a14e6b443dbae60aa41cf66fdf => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:56:23.810932 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20da307e-ea8a-4d30-98d5-551f926379c8 service neutron] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:23.832128 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20da307e-ea8a-4d30-98d5-551f926379c8 service neutron] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:23.963564 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a546914-c300-4df8-a343-7b399d4128d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:23.965749 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a546914-c300-4df8-a343-7b399d4128d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:23.966523 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a546914-c300-4df8-a343-7b399d4128d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:23.967005 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a546914-c300-4df8-a343-7b399d4128d2 admin admin] PATH_INFO: `/v3/users/c10d129e59574df58d26dbbb13754877` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:23.968943 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a546914-c300-4df8-a343-7b399d4128d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c10d129e59574df58d26dbbb13754877)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:23.972703 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a546914-c300-4df8-a343-7b399d4128d2 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:24.089069 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-5a546914-c300-4df8-a343-7b399d4128d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c10d129e59574df58d26dbbb13754877'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:24.104282 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-5a546914-c300-4df8-a343-7b399d4128d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c10d129e59574df58d26dbbb13754877'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:24.149427 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-5a546914-c300-4df8-a343-7b399d4128d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c10d129e59574df58d26dbbb13754877'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:24.151157 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-5a546914-c300-4df8-a343-7b399d4128d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c10d129e59574df58d26dbbb13754877'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:24.153103 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-5a546914-c300-4df8-a343-7b399d4128d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c10d129e59574df58d26dbbb13754877'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:24.218024 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1020/2034] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 14 17:56:23 2022] DELETE /identity/v3/users/c10d129e59574df58d26dbbb13754877 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:56:24.753760 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ae25f2-d980-4b6f-80b9-47f16a8b18ed admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:24.756034 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-c7ae25f2-d980-4b6f-80b9-47f16a8b18ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:24.785474 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:56:24.797068 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ae25f2-d980-4b6f-80b9-47f16a8b18ed admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:24.884909 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f708c60-fbe3-450a-89a2-40530c63984a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:24.886143 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f708c60-fbe3-450a-89a2-40530c63984a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:24.886662 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f708c60-fbe3-450a-89a2-40530c63984a admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:24.887221 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f708c60-fbe3-450a-89a2-40530c63984a admin admin] PATH_INFO: `/v3/projects/5fdbf724cb1d4a3e9005af9121bdaa87` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:24.889064 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f708c60-fbe3-450a-89a2-40530c63984a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fdbf724cb1d4a3e9005af9121bdaa87)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:24.891572 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f708c60-fbe3-450a-89a2-40530c63984a admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:24.956028 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a546914-c300-4df8-a343-7b399d4128d2 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:24.957672 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-5a546914-c300-4df8-a343-7b399d4128d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:24.979606 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a546914-c300-4df8-a343-7b399d4128d2 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:24.993810 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-0f708c60-fbe3-450a-89a2-40530c63984a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fdbf724cb1d4a3e9005af9121bdaa87', 'request_id': 'req-0f708c60-fbe3-450a-89a2-40530c63984a'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:25.010957 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-0f708c60-fbe3-450a-89a2-40530c63984a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fdbf724cb1d4a3e9005af9121bdaa87', 'request_id': 'req-0f708c60-fbe3-450a-89a2-40530c63984a'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:25.029058 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-0f708c60-fbe3-450a-89a2-40530c63984a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fdbf724cb1d4a3e9005af9121bdaa87', 'request_id': 'req-0f708c60-fbe3-450a-89a2-40530c63984a'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:25.054450 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-0f708c60-fbe3-450a-89a2-40530c63984a admin admin] The token cache is being invalidate because project 5fdbf724cb1d4a3e9005af9121bdaa87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86772) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 17:56:25.054647 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-0f708c60-fbe3-450a-89a2-40530c63984a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:25.058355 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-0f708c60-fbe3-450a-89a2-40530c63984a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:25.060672 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1015/2035] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 14 17:56:24 2022] DELETE /identity/v3/projects/5fdbf724cb1d4a3e9005af9121bdaa87 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:56:25.073649 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7579a766-0aec-4dc7-bb3f-fb1f1cd94e01 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:25.074013 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7579a766-0aec-4dc7-bb3f-fb1f1cd94e01 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:25.074223 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7579a766-0aec-4dc7-bb3f-fb1f1cd94e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:25.096359 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:56:25.106321 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac08dc5f-849f-4c43-b6fb-051549a3c9a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:25.106772 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-7579a766-0aec-4dc7-bb3f-fb1f1cd94e01 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:56:25.108309 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-7579a766-0aec-4dc7-bb3f-fb1f1cd94e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:25.110188 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac08dc5f-849f-4c43-b6fb-051549a3c9a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:25.110856 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac08dc5f-849f-4c43-b6fb-051549a3c9a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:25.111438 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac08dc5f-849f-4c43-b6fb-051549a3c9a1 admin admin] PATH_INFO: `/v3/users/e3aa995b3cdc4798b43b0c818e8adb2d` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:25.114901 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac08dc5f-849f-4c43-b6fb-051549a3c9a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3aa995b3cdc4798b43b0c818e8adb2d)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:25.119473 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac08dc5f-849f-4c43-b6fb-051549a3c9a1 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:25.128509 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1016/2036] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:56:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:56:25.136052 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7579a766-0aec-4dc7-bb3f-fb1f1cd94e01 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:25.136263 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-7579a766-0aec-4dc7-bb3f-fb1f1cd94e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:25.160771 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7579a766-0aec-4dc7-bb3f-fb1f1cd94e01 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:25.188449 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69097f05-93b0-4034-b412-5caf29d30a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:25.190222 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69097f05-93b0-4034-b412-5caf29d30a13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:25.190743 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69097f05-93b0-4034-b412-5caf29d30a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:25.191218 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69097f05-93b0-4034-b412-5caf29d30a13 admin admin] PATH_INFO: `/v3/users/a35ae25dcd8c44fc9e4e333221d607ac` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:25.193509 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69097f05-93b0-4034-b412-5caf29d30a13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a35ae25dcd8c44fc9e4e333221d607ac)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:25.199183 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69097f05-93b0-4034-b412-5caf29d30a13 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:25.256973 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-ac08dc5f-849f-4c43-b6fb-051549a3c9a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3aa995b3cdc4798b43b0c818e8adb2d'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:25.271461 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-ac08dc5f-849f-4c43-b6fb-051549a3c9a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3aa995b3cdc4798b43b0c818e8adb2d'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:25.276925 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-69097f05-93b0-4034-b412-5caf29d30a13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a35ae25dcd8c44fc9e4e333221d607ac'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:25.293090 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-69097f05-93b0-4034-b412-5caf29d30a13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a35ae25dcd8c44fc9e4e333221d607ac'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:25.298256 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-ac08dc5f-849f-4c43-b6fb-051549a3c9a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3aa995b3cdc4798b43b0c818e8adb2d'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:25.298848 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-ac08dc5f-849f-4c43-b6fb-051549a3c9a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3aa995b3cdc4798b43b0c818e8adb2d'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:25.299937 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-ac08dc5f-849f-4c43-b6fb-051549a3c9a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3aa995b3cdc4798b43b0c818e8adb2d'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:25.306010 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-69097f05-93b0-4034-b412-5caf29d30a13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a35ae25dcd8c44fc9e4e333221d607ac'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:25.307623 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-69097f05-93b0-4034-b412-5caf29d30a13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a35ae25dcd8c44fc9e4e333221d607ac'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:25.322570 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-69097f05-93b0-4034-b412-5caf29d30a13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a35ae25dcd8c44fc9e4e333221d607ac'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:25.326463 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1021/2037] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 14 17:56:24 2022] DELETE /identity/v3/users/e3aa995b3cdc4798b43b0c818e8adb2d => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:56:25.330562 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:56:25.333951 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5341537c-4e73-4930-bc42-8137a80a434a None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:25.334312 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5341537c-4e73-4930-bc42-8137a80a434a None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:25.334848 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5341537c-4e73-4930-bc42-8137a80a434a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:25.343103 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1017/2038] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 14 17:56:25 2022] DELETE /identity/v3/users/a35ae25dcd8c44fc9e4e333221d607ac => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:56:25.343103 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9df0bf5-e400-46e9-8f10-d36ec0e95a45 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:25.343103 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9df0bf5-e400-46e9-8f10-d36ec0e95a45 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:25.343103 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9df0bf5-e400-46e9-8f10-d36ec0e95a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:25.368517 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-5341537c-4e73-4930-bc42-8137a80a434a None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:56:25.370291 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-5341537c-4e73-4930-bc42-8137a80a434a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:25.383141 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-b9df0bf5-e400-46e9-8f10-d36ec0e95a45 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:56:25.385626 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-b9df0bf5-e400-46e9-8f10-d36ec0e95a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:25.477481 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1022/2039] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:56:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:56:25.482690 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1131eee-b135-4548-8681-9a39f95ec4da None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:25.483252 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1131eee-b135-4548-8681-9a39f95ec4da None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:25.483500 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1131eee-b135-4548-8681-9a39f95ec4da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:25.516557 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-a1131eee-b135-4548-8681-9a39f95ec4da None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:56:25.518779 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-a1131eee-b135-4548-8681-9a39f95ec4da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:25.539288 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1023/2040] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:56:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:56:25.539288 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1131eee-b135-4548-8681-9a39f95ec4da None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:25.548136 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1018/2041] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:56:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:56:25.565026 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9df0bf5-e400-46e9-8f10-d36ec0e95a45 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:25.568593 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-b9df0bf5-e400-46e9-8f10-d36ec0e95a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:25.573016 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1131eee-b135-4548-8681-9a39f95ec4da None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:25.603109 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415f9d24-0c9a-4ac4-b013-fa050d640fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:25.605816 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415f9d24-0c9a-4ac4-b013-fa050d640fa3 admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:25.606437 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415f9d24-0c9a-4ac4-b013-fa050d640fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:25.606933 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415f9d24-0c9a-4ac4-b013-fa050d640fa3 admin admin] PATH_INFO: `/v3/domains` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:25.608500 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415f9d24-0c9a-4ac4-b013-fa050d640fa3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:56:25.609052 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415f9d24-0c9a-4ac4-b013-fa050d640fa3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:25.612731 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415f9d24-0c9a-4ac4-b013-fa050d640fa3 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:25.650017 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1024/2042] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 14 17:56:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:56:25.653502 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415f9d24-0c9a-4ac4-b013-fa050d640fa3 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:25.660602 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-415f9d24-0c9a-4ac4-b013-fa050d640fa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:25.749727 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9df0bf5-e400-46e9-8f10-d36ec0e95a45 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:25.763517 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c6bf7b-ebf3-42ed-8e4f-ff222a67d102 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:25.764534 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c6bf7b-ebf3-42ed-8e4f-ff222a67d102 service neutron] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:25.766268 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c6bf7b-ebf3-42ed-8e4f-ff222a67d102 service neutron] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:25.767362 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c6bf7b-ebf3-42ed-8e4f-ff222a67d102 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:25.800586 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c6bf7b-ebf3-42ed-8e4f-ff222a67d102 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:25.806591 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c6bf7b-ebf3-42ed-8e4f-ff222a67d102 service neutron] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:25.848796 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1019/2043] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:56:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:56:25.849754 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c6bf7b-ebf3-42ed-8e4f-ff222a67d102 service neutron] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:25.874299 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c6bf7b-ebf3-42ed-8e4f-ff222a67d102 service neutron] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:25.878462 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415f9d24-0c9a-4ac4-b013-fa050d640fa3 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:25.884881 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daf78fd-1f08-4a7e-a531-da6cc5e26d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:25.886039 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daf78fd-1f08-4a7e-a531-da6cc5e26d40 admin admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:25.886647 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daf78fd-1f08-4a7e-a531-da6cc5e26d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:25.888113 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daf78fd-1f08-4a7e-a531-da6cc5e26d40 admin admin] PATH_INFO: `/v3/projects` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:25.889155 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2413fff-3963-4dd8-8017-29c114c346c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:25.889643 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daf78fd-1f08-4a7e-a531-da6cc5e26d40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:25.892849 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daf78fd-1f08-4a7e-a531-da6cc5e26d40 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:25.894265 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2413fff-3963-4dd8-8017-29c114c346c6 service neutron] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:25.894265 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2413fff-3963-4dd8-8017-29c114c346c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:25.895056 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2413fff-3963-4dd8-8017-29c114c346c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:25.942530 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1020/2044] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 14 17:56:25 2022] POST /identity/v3/projects => generated 383 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:56:25.944057 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2413fff-3963-4dd8-8017-29c114c346c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:25.946824 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2413fff-3963-4dd8-8017-29c114c346c6 service neutron] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:25.948630 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daf78fd-1f08-4a7e-a531-da6cc5e26d40 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:25.956169 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:56:25.981817 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1025/2045] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:56:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:56:26.121199 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daf78fd-1f08-4a7e-a531-da6cc5e26d40 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:26.135647 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2593dad-66ab-412c-aabb-45521e27d2bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:26.136358 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2593dad-66ab-412c-aabb-45521e27d2bf admin admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:26.136667 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2593dad-66ab-412c-aabb-45521e27d2bf admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:26.136970 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2593dad-66ab-412c-aabb-45521e27d2bf admin admin] PATH_INFO: `/v3/users` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:26.138306 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2593dad-66ab-412c-aabb-45521e27d2bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:26.140311 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2593dad-66ab-412c-aabb-45521e27d2bf admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:26.207860 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1021/2046] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 14 17:56:25 2022] POST /identity/v3/users => generated 292 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 17:56:26.212671 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2413fff-3963-4dd8-8017-29c114c346c6 service neutron] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:26.228875 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2413fff-3963-4dd8-8017-29c114c346c6 service neutron] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:26.240233 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5146de84-3df5-44ef-98ff-15e7e40713c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:26.241117 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5146de84-3df5-44ef-98ff-15e7e40713c8 admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:26.241560 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5146de84-3df5-44ef-98ff-15e7e40713c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:26.241993 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5146de84-3df5-44ef-98ff-15e7e40713c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:26.243006 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5146de84-3df5-44ef-98ff-15e7e40713c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:26.244716 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5146de84-3df5-44ef-98ff-15e7e40713c8 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:26.286394 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1026/2047] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:56:26 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:56:26.292166 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2593dad-66ab-412c-aabb-45521e27d2bf admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:26.330664 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2593dad-66ab-412c-aabb-45521e27d2bf admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:26.359026 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730bb4a4-1bd1-4189-bd58-8f51b1741731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:26.361343 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730bb4a4-1bd1-4189-bd58-8f51b1741731 admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:26.362235 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730bb4a4-1bd1-4189-bd58-8f51b1741731 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:26.362750 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730bb4a4-1bd1-4189-bd58-8f51b1741731 admin admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:26.364648 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730bb4a4-1bd1-4189-bd58-8f51b1741731 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:26.368748 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730bb4a4-1bd1-4189-bd58-8f51b1741731 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:26.380499 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:56:26.392750 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1022/2048] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:56:26 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 17:56:26.399379 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5146de84-3df5-44ef-98ff-15e7e40713c8 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:26.419845 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5146de84-3df5-44ef-98ff-15e7e40713c8 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:26.426956 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9d395a-0632-4a19-992b-b1225ad0685a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:26.428325 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9d395a-0632-4a19-992b-b1225ad0685a admin admin] REQUEST_METHOD: `PUT` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:26.429192 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9d395a-0632-4a19-992b-b1225ad0685a admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:26.429192 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9d395a-0632-4a19-992b-b1225ad0685a admin admin] PATH_INFO: `/v3/projects/f2a07212dc1741f19a0e5f6982a4d58d/users/6cb37447d9024c49b2997e4d753f0059/roles/95d753870f97426cb1ce32e078621a4c` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:26.463909 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9d395a-0632-4a19-992b-b1225ad0685a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2a07212dc1741f19a0e5f6982a4d58d, user_id=6cb37447d9024c49b2997e4d753f0059, role_id=95d753870f97426cb1ce32e078621a4c)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:26.467890 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9d395a-0632-4a19-992b-b1225ad0685a admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:26.496477 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1027/2049] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 17:56:26 2022] PUT /identity/v3/projects/f2a07212dc1741f19a0e5f6982a4d58d/users/6cb37447d9024c49b2997e4d753f0059/roles/95d753870f97426cb1ce32e078621a4c => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:56:26.504807 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b3e7bd-f973-4344-ac4c-245a447831cc None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:26.505482 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b3e7bd-f973-4344-ac4c-245a447831cc None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:26.506074 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b3e7bd-f973-4344-ac4c-245a447831cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:26.572741 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-83b3e7bd-f973-4344-ac4c-245a447831cc None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:56:26.575141 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-83b3e7bd-f973-4344-ac4c-245a447831cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:26.601128 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9d395a-0632-4a19-992b-b1225ad0685a admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:26.614933 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-5e9d395a-0632-4a19-992b-b1225ad0685a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:26.669270 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1023/2050] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:56:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:56:26.684144 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b3e7bd-f973-4344-ac4c-245a447831cc None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:26.694127 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-83b3e7bd-f973-4344-ac4c-245a447831cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:26.731799 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b3e7bd-f973-4344-ac4c-245a447831cc None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:26.740561 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28cc027-91f7-45ec-a5d1-6a4cfb0251cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:26.750941 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28cc027-91f7-45ec-a5d1-6a4cfb0251cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:26.751244 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28cc027-91f7-45ec-a5d1-6a4cfb0251cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:26.751522 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28cc027-91f7-45ec-a5d1-6a4cfb0251cc admin admin] PATH_INFO: `/v3/projects/f1e48baabda1481082fff7caeab10180` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:26.757796 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28cc027-91f7-45ec-a5d1-6a4cfb0251cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1e48baabda1481082fff7caeab10180)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:26.759766 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28cc027-91f7-45ec-a5d1-6a4cfb0251cc admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:26.798332 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9d395a-0632-4a19-992b-b1225ad0685a admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:26.810699 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09d6805-931e-42fd-8ea5-a1a62c58374b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:26.811604 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09d6805-931e-42fd-8ea5-a1a62c58374b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:26.813140 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09d6805-931e-42fd-8ea5-a1a62c58374b admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:26.813140 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09d6805-931e-42fd-8ea5-a1a62c58374b admin admin] PATH_INFO: `/v3/projects/b43e35e1c4ca4047a6c5575a8597cb23` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:26.814426 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09d6805-931e-42fd-8ea5-a1a62c58374b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b43e35e1c4ca4047a6c5575a8597cb23)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:26.816706 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09d6805-931e-42fd-8ea5-a1a62c58374b admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:26.845183 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-e28cc027-91f7-45ec-a5d1-6a4cfb0251cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1e48baabda1481082fff7caeab10180', 'request_id': 'req-e28cc027-91f7-45ec-a5d1-6a4cfb0251cc'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:26.864346 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-e28cc027-91f7-45ec-a5d1-6a4cfb0251cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1e48baabda1481082fff7caeab10180', 'request_id': 'req-e28cc027-91f7-45ec-a5d1-6a4cfb0251cc'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:26.887939 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-e28cc027-91f7-45ec-a5d1-6a4cfb0251cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1e48baabda1481082fff7caeab10180', 'request_id': 'req-e28cc027-91f7-45ec-a5d1-6a4cfb0251cc'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:26.917911 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-e28cc027-91f7-45ec-a5d1-6a4cfb0251cc admin admin] The token cache is being invalidate because project f1e48baabda1481082fff7caeab10180 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86772) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 17:56:26.918563 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-e28cc027-91f7-45ec-a5d1-6a4cfb0251cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:26.919420 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-e28cc027-91f7-45ec-a5d1-6a4cfb0251cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:26.924107 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1024/2051] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 14 17:56:26 2022] DELETE /identity/v3/projects/f1e48baabda1481082fff7caeab10180 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:56:26.925772 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28cc027-91f7-45ec-a5d1-6a4cfb0251cc admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:26.929421 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-e28cc027-91f7-45ec-a5d1-6a4cfb0251cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:26.944434 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-f09d6805-931e-42fd-8ea5-a1a62c58374b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b43e35e1c4ca4047a6c5575a8597cb23', 'request_id': 'req-f09d6805-931e-42fd-8ea5-a1a62c58374b'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:26.952882 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-f09d6805-931e-42fd-8ea5-a1a62c58374b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b43e35e1c4ca4047a6c5575a8597cb23', 'request_id': 'req-f09d6805-931e-42fd-8ea5-a1a62c58374b'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:26.964614 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-f09d6805-931e-42fd-8ea5-a1a62c58374b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b43e35e1c4ca4047a6c5575a8597cb23', 'request_id': 'req-f09d6805-931e-42fd-8ea5-a1a62c58374b'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:27.001137 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-f09d6805-931e-42fd-8ea5-a1a62c58374b admin admin] The token cache is being invalidate because project b43e35e1c4ca4047a6c5575a8597cb23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86773) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 17:56:27.001428 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-f09d6805-931e-42fd-8ea5-a1a62c58374b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:27.003287 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-f09d6805-931e-42fd-8ea5-a1a62c58374b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:27.016185 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1028/2052] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 14 17:56:26 2022] DELETE /identity/v3/projects/b43e35e1c4ca4047a6c5575a8597cb23 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:56:27.016185 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09d6805-931e-42fd-8ea5-a1a62c58374b admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:27.017950 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-f09d6805-931e-42fd-8ea5-a1a62c58374b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:27.021959 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28cc027-91f7-45ec-a5d1-6a4cfb0251cc admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:27.139332 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:56:27.193198 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3cd63d-acdc-4ee8-b702-4038d8e77da9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:27.194600 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3cd63d-acdc-4ee8-b702-4038d8e77da9 service neutron] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:27.195148 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3cd63d-acdc-4ee8-b702-4038d8e77da9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:27.195723 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3cd63d-acdc-4ee8-b702-4038d8e77da9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:27.204799 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-ab3cd63d-acdc-4ee8-b702-4038d8e77da9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:27.225134 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:56:27.233073 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09d6805-931e-42fd-8ea5-a1a62c58374b admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:27.241625 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb8c370-d0d3-4338-a83c-2027cfe9f6c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:27.245219 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb8c370-d0d3-4338-a83c-2027cfe9f6c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:27.245843 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb8c370-d0d3-4338-a83c-2027cfe9f6c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:27.246115 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb8c370-d0d3-4338-a83c-2027cfe9f6c7 admin admin] PATH_INFO: `/v3/users/fb7fd74c3669453bb3324cd2d4821d4a` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:27.254439 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb8c370-d0d3-4338-a83c-2027cfe9f6c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb7fd74c3669453bb3324cd2d4821d4a)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:27.257283 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb8c370-d0d3-4338-a83c-2027cfe9f6c7 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:27.300435 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3cd63d-acdc-4ee8-b702-4038d8e77da9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:27.307404 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3cd63d-acdc-4ee8-b702-4038d8e77da9 service neutron] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:27.341648 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-abb8c370-d0d3-4338-a83c-2027cfe9f6c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb7fd74c3669453bb3324cd2d4821d4a'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:27.349448 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1025/2053] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:56:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:56:27.353134 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-abb8c370-d0d3-4338-a83c-2027cfe9f6c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb7fd74c3669453bb3324cd2d4821d4a'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:27.375318 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-abb8c370-d0d3-4338-a83c-2027cfe9f6c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb7fd74c3669453bb3324cd2d4821d4a'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:27.376945 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-abb8c370-d0d3-4338-a83c-2027cfe9f6c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb7fd74c3669453bb3324cd2d4821d4a'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:27.380472 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-abb8c370-d0d3-4338-a83c-2027cfe9f6c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb7fd74c3669453bb3324cd2d4821d4a'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:27.411314 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1029/2054] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 14 17:56:27 2022] DELETE /identity/v3/users/fb7fd74c3669453bb3324cd2d4821d4a => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:56:28.134622 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3cd63d-acdc-4ee8-b702-4038d8e77da9 service neutron] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:28.147228 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3cd63d-acdc-4ee8-b702-4038d8e77da9 service neutron] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:28.279186 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a33896-4c2d-4d12-8f30-0ccefe25739f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:28.281400 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a33896-4c2d-4d12-8f30-0ccefe25739f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:28.282312 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a33896-4c2d-4d12-8f30-0ccefe25739f admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:28.282606 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a33896-4c2d-4d12-8f30-0ccefe25739f admin admin] PATH_INFO: `/v3/projects/a154ed46d78d49cd9f6221f1827f13bd` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:28.287316 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a33896-4c2d-4d12-8f30-0ccefe25739f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a154ed46d78d49cd9f6221f1827f13bd)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:28.292264 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a33896-4c2d-4d12-8f30-0ccefe25739f admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:28.382877 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-f5a33896-4c2d-4d12-8f30-0ccefe25739f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a154ed46d78d49cd9f6221f1827f13bd', 'request_id': 'req-f5a33896-4c2d-4d12-8f30-0ccefe25739f'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:28.390794 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-f5a33896-4c2d-4d12-8f30-0ccefe25739f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a154ed46d78d49cd9f6221f1827f13bd', 'request_id': 'req-f5a33896-4c2d-4d12-8f30-0ccefe25739f'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:28.407205 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-f5a33896-4c2d-4d12-8f30-0ccefe25739f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a154ed46d78d49cd9f6221f1827f13bd', 'request_id': 'req-f5a33896-4c2d-4d12-8f30-0ccefe25739f'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:28.423989 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-f5a33896-4c2d-4d12-8f30-0ccefe25739f admin admin] The token cache is being invalidate because project a154ed46d78d49cd9f6221f1827f13bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86772) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 17:56:28.424278 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-f5a33896-4c2d-4d12-8f30-0ccefe25739f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:28.425044 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-f5a33896-4c2d-4d12-8f30-0ccefe25739f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:28.428327 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1026/2055] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 14 17:56:28 2022] DELETE /identity/v3/projects/a154ed46d78d49cd9f6221f1827f13bd => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 17:56:28.436548 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6594cf55-eac2-42e0-8ec4-709db2568ffb None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:28.437032 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6594cf55-eac2-42e0-8ec4-709db2568ffb None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:28.437119 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6594cf55-eac2-42e0-8ec4-709db2568ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:28.487277 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-6594cf55-eac2-42e0-8ec4-709db2568ffb None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:56:28.491454 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-6594cf55-eac2-42e0-8ec4-709db2568ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:28.654555 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1030/2056] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:56:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:56:28.661977 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8c4fb3-82f9-4ebf-964b-9e01bd486056 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:28.662333 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8c4fb3-82f9-4ebf-964b-9e01bd486056 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:28.663032 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8c4fb3-82f9-4ebf-964b-9e01bd486056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:28.692013 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-fa8c4fb3-82f9-4ebf-964b-9e01bd486056 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:56:28.696377 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-fa8c4fb3-82f9-4ebf-964b-9e01bd486056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:28.717684 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1027/2057] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:56:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:56:28.722338 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6594cf55-eac2-42e0-8ec4-709db2568ffb None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:28.736892 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6594cf55-eac2-42e0-8ec4-709db2568ffb None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:28.749034 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb36754-3832-4e8e-b2fc-ca5ab7cd1d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:28.750426 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb36754-3832-4e8e-b2fc-ca5ab7cd1d3d admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:28.751812 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb36754-3832-4e8e-b2fc-ca5ab7cd1d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:28.752555 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb36754-3832-4e8e-b2fc-ca5ab7cd1d3d admin admin] PATH_INFO: `/v3/domains` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:28.755254 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb36754-3832-4e8e-b2fc-ca5ab7cd1d3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:56:28.755812 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb36754-3832-4e8e-b2fc-ca5ab7cd1d3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:28.758095 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb36754-3832-4e8e-b2fc-ca5ab7cd1d3d admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:28.799792 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1031/2058] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 14 17:56:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:56:28.805608 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8c4fb3-82f9-4ebf-964b-9e01bd486056 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:28.824005 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8c4fb3-82f9-4ebf-964b-9e01bd486056 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:28.837045 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb7923c-648f-43cb-8da4-d315094e7b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:28.837868 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb7923c-648f-43cb-8da4-d315094e7b79 admin admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:28.838157 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb7923c-648f-43cb-8da4-d315094e7b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:28.843397 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb7923c-648f-43cb-8da4-d315094e7b79 admin admin] PATH_INFO: `/v3/projects` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:28.846289 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb7923c-648f-43cb-8da4-d315094e7b79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:28.860291 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb7923c-648f-43cb-8da4-d315094e7b79 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:28.872448 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c7b15b-17de-43f0-8a00-fa1658c5ba0c None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:28.872850 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c7b15b-17de-43f0-8a00-fa1658c5ba0c None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:28.873722 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c7b15b-17de-43f0-8a00-fa1658c5ba0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:28.945736 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1028/2059] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 14 17:56:28 2022] POST /identity/v3/projects => generated 365 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:56:28.948434 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-e0c7b15b-17de-43f0-8a00-fa1658c5ba0c None None] MFA Rules not processed for user `6cb37447d9024c49b2997e4d753f0059`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:56:28.951157 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-e0c7b15b-17de-43f0-8a00-fa1658c5ba0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:28.952689 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb7923c-648f-43cb-8da4-d315094e7b79 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:29.018666 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:56:29.046424 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb7923c-648f-43cb-8da4-d315094e7b79 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:29.047188 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:56:29.054358 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ed1638-419d-4f41-ab29-6583dfcb4483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:29.055330 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed1638-419d-4f41-ab29-6583dfcb4483 admin admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:29.055766 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed1638-419d-4f41-ab29-6583dfcb4483 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:29.056706 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed1638-419d-4f41-ab29-6583dfcb4483 admin admin] PATH_INFO: `/v3/users` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:29.057752 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ed1638-419d-4f41-ab29-6583dfcb4483 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:29.061006 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ed1638-419d-4f41-ab29-6583dfcb4483 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:29.094188 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1032/2060] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:56:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:56:29.104939 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c7b15b-17de-43f0-8a00-fa1658c5ba0c None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:29.107164 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-e0c7b15b-17de-43f0-8a00-fa1658c5ba0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:29.109027 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1029/2061] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 14 17:56:28 2022] POST /identity/v3/users => generated 283 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:56:29.112777 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ed1638-419d-4f41-ab29-6583dfcb4483 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:29.139183 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ed1638-419d-4f41-ab29-6583dfcb4483 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:29.155697 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db9c21c-5297-4943-aea0-4cd1995e2d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:29.156270 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db9c21c-5297-4943-aea0-4cd1995e2d5d admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:29.156562 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db9c21c-5297-4943-aea0-4cd1995e2d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:29.156841 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db9c21c-5297-4943-aea0-4cd1995e2d5d admin admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:29.157639 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db9c21c-5297-4943-aea0-4cd1995e2d5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:29.159287 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db9c21c-5297-4943-aea0-4cd1995e2d5d admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:29.175544 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1030/2062] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:56:29 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 17:56:29.180040 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db9c21c-5297-4943-aea0-4cd1995e2d5d admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:29.193983 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db9c21c-5297-4943-aea0-4cd1995e2d5d admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:29.201155 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16b7958-fc63-4f01-a8b8-c6e49972732c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:29.202888 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16b7958-fc63-4f01-a8b8-c6e49972732c admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:29.202888 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16b7958-fc63-4f01-a8b8-c6e49972732c admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:29.202888 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16b7958-fc63-4f01-a8b8-c6e49972732c admin admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:29.205432 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16b7958-fc63-4f01-a8b8-c6e49972732c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:29.208189 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16b7958-fc63-4f01-a8b8-c6e49972732c admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:29.223858 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1031/2063] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:56:29 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:56:29.227952 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16b7958-fc63-4f01-a8b8-c6e49972732c admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:29.242055 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16b7958-fc63-4f01-a8b8-c6e49972732c admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:29.247655 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1127e0eb-a1bd-4137-958b-8826328ba6ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:29.248908 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1127e0eb-a1bd-4137-958b-8826328ba6ac admin admin] REQUEST_METHOD: `PUT` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:29.249297 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1127e0eb-a1bd-4137-958b-8826328ba6ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:29.249729 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1127e0eb-a1bd-4137-958b-8826328ba6ac admin admin] PATH_INFO: `/v3/projects/855c335e374e442f8d9f6d852503c3f3/users/032c5ac6c1e9466094f53af302194e23/roles/95d753870f97426cb1ce32e078621a4c` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:29.252135 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c7b15b-17de-43f0-8a00-fa1658c5ba0c None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:29.258516 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60f918c-a0df-48fa-bd84-c314a13f5987 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de55cae1600841889668e36402861203', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:29.259283 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60f918c-a0df-48fa-bd84-c314a13f5987 service cinder] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:29.261567 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60f918c-a0df-48fa-bd84-c314a13f5987 service cinder] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:29.261912 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60f918c-a0df-48fa-bd84-c314a13f5987 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:29.273186 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1127e0eb-a1bd-4137-958b-8826328ba6ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=855c335e374e442f8d9f6d852503c3f3, user_id=032c5ac6c1e9466094f53af302194e23, role_id=95d753870f97426cb1ce32e078621a4c)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:29.274467 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60f918c-a0df-48fa-bd84-c314a13f5987 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:29.276184 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1127e0eb-a1bd-4137-958b-8826328ba6ac admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:29.276374 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60f918c-a0df-48fa-bd84-c314a13f5987 service cinder] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:29.290985 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1033/2064] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:56:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:56:29.319596 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1032/2065] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 17:56:29 2022] PUT /identity/v3/projects/855c335e374e442f8d9f6d852503c3f3/users/032c5ac6c1e9466094f53af302194e23/roles/95d753870f97426cb1ce32e078621a4c => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:56:29.321979 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff026b-7e4f-463b-a691-fb09254a2aa5 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:29.323486 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff026b-7e4f-463b-a691-fb09254a2aa5 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:29.324276 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff026b-7e4f-463b-a691-fb09254a2aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:29.384086 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-60ff026b-7e4f-463b-a691-fb09254a2aa5 None None] MFA Rules not processed for user `032c5ac6c1e9466094f53af302194e23`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:56:29.386205 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-60ff026b-7e4f-463b-a691-fb09254a2aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:29.483702 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1034/2066] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:56:29 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:56:29.496536 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1127e0eb-a1bd-4137-958b-8826328ba6ac admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:29.500440 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-1127e0eb-a1bd-4137-958b-8826328ba6ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:29.696244 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1127e0eb-a1bd-4137-958b-8826328ba6ac admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:29.707108 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9024ac05-0425-4616-a09c-388ac4a33710 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de55cae1600841889668e36402861203', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:29.707856 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9024ac05-0425-4616-a09c-388ac4a33710 service cinder] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:29.708316 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9024ac05-0425-4616-a09c-388ac4a33710 service cinder] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:29.708602 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9024ac05-0425-4616-a09c-388ac4a33710 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:29.728268 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9024ac05-0425-4616-a09c-388ac4a33710 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:29.730298 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9024ac05-0425-4616-a09c-388ac4a33710 service cinder] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:29.759653 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1033/2067] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:56:29 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:56:31.941123 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1271468-889a-4343-bb0c-2c97053b9376 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:31.941590 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1271468-889a-4343-bb0c-2c97053b9376 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:31.941708 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1271468-889a-4343-bb0c-2c97053b9376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:31.959981 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-c1271468-889a-4343-bb0c-2c97053b9376 None None] MFA Rules not processed for user `6cb37447d9024c49b2997e4d753f0059`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:56:31.961281 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-c1271468-889a-4343-bb0c-2c97053b9376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:32.019315 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1035/2068] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:56:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:56:37.534066 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9024ac05-0425-4616-a09c-388ac4a33710 service cinder] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:37.535959 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-9024ac05-0425-4616-a09c-388ac4a33710 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:37.688796 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9024ac05-0425-4616-a09c-388ac4a33710 service cinder] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:37.699348 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79e0e33-1c87-443b-9c33-f40f6d86836a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:37.701068 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e0e33-1c87-443b-9c33-f40f6d86836a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:37.701758 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e0e33-1c87-443b-9c33-f40f6d86836a admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:37.702337 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e0e33-1c87-443b-9c33-f40f6d86836a admin admin] PATH_INFO: `/v3/users/453add2ad3ab403392ab849bbdbd93f0` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:37.705913 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79e0e33-1c87-443b-9c33-f40f6d86836a admin admin] RBAC: Authorizing `identity:delete_user(user_id=453add2ad3ab403392ab849bbdbd93f0)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:37.711797 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79e0e33-1c87-443b-9c33-f40f6d86836a admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:37.782564 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:56:37.815551 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-d79e0e33-1c87-443b-9c33-f40f6d86836a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '453add2ad3ab403392ab849bbdbd93f0'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:37.839965 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-d79e0e33-1c87-443b-9c33-f40f6d86836a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '453add2ad3ab403392ab849bbdbd93f0'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:37.853486 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-d79e0e33-1c87-443b-9c33-f40f6d86836a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '453add2ad3ab403392ab849bbdbd93f0'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:37.854841 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-d79e0e33-1c87-443b-9c33-f40f6d86836a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '453add2ad3ab403392ab849bbdbd93f0'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:37.872965 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-d79e0e33-1c87-443b-9c33-f40f6d86836a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '453add2ad3ab403392ab849bbdbd93f0'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:37.880787 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1034/2069] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 14 17:56:37 2022] DELETE /identity/v3/users/453add2ad3ab403392ab849bbdbd93f0 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:56:37.885102 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ed8e4-c0ff-424d-b425-d03a25d59f03 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:37.885624 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ed8e4-c0ff-424d-b425-d03a25d59f03 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:37.885733 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ed8e4-c0ff-424d-b425-d03a25d59f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:37.907896 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-ba7ed8e4-c0ff-424d-b425-d03a25d59f03 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:56:37.909586 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-ba7ed8e4-c0ff-424d-b425-d03a25d59f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:37.942840 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:56:38.005035 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1036/2070] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:56:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:56:38.021725 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79e0e33-1c87-443b-9c33-f40f6d86836a admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:38.023313 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-d79e0e33-1c87-443b-9c33-f40f6d86836a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:38.088906 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23879dbe-bb44-4411-b89a-fc62e1527733 None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:38.089280 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23879dbe-bb44-4411-b89a-fc62e1527733 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:38.089811 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23879dbe-bb44-4411-b89a-fc62e1527733 None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:38.092953 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1037/2071] 10.222.0.67 () {54 vars in 921 bytes} [Thu Jul 14 17:56:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:56:38.098357 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79e0e33-1c87-443b-9c33-f40f6d86836a admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:38.101982 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f9b6ce-d56e-45d6-a92a-75786c72d874 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:38.102340 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f9b6ce-d56e-45d6-a92a-75786c72d874 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:38.102728 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f9b6ce-d56e-45d6-a92a-75786c72d874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:38.103992 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8ef7f5-8589-4c7b-8848-1fa6217210b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:38.104660 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ef7f5-8589-4c7b-8848-1fa6217210b7 service neutron] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:38.104949 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ef7f5-8589-4c7b-8848-1fa6217210b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:38.105224 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ef7f5-8589-4c7b-8848-1fa6217210b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:38.119278 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8ef7f5-8589-4c7b-8848-1fa6217210b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:38.121429 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8ef7f5-8589-4c7b-8848-1fa6217210b7 service neutron] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:38.126563 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-00f9b6ce-d56e-45d6-a92a-75786c72d874 None None] MFA Rules not processed for user `5324ab45f4a4449980dad920278f5034`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:56:38.127851 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-00f9b6ce-d56e-45d6-a92a-75786c72d874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:38.141943 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1035/2072] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:56:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:56:38.207820 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8ef7f5-8589-4c7b-8848-1fa6217210b7 service neutron] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:38.213776 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-ab8ef7f5-8589-4c7b-8848-1fa6217210b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:38.231236 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8ef7f5-8589-4c7b-8848-1fa6217210b7 service neutron] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:38.232429 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1038/2073] 10.222.0.67 () {58 vars in 1018 bytes} [Thu Jul 14 17:56:38 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 17:56:38.243888 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f9b6ce-d56e-45d6-a92a-75786c72d874 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:38.244053 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586146fc-1bba-4e8a-92cb-21a5a851af7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:38.245663 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586146fc-1bba-4e8a-92cb-21a5a851af7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:38.245927 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-00f9b6ce-d56e-45d6-a92a-75786c72d874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:38.246155 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586146fc-1bba-4e8a-92cb-21a5a851af7c admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:38.246530 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586146fc-1bba-4e8a-92cb-21a5a851af7c admin admin] PATH_INFO: `/v3/users/a5a7061dd1154fcf891c2c8af16d7841` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:38.248700 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586146fc-1bba-4e8a-92cb-21a5a851af7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5a7061dd1154fcf891c2c8af16d7841)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:38.252563 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586146fc-1bba-4e8a-92cb-21a5a851af7c admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:38.260611 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f9b6ce-d56e-45d6-a92a-75786c72d874 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:38.267956 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93f5fe9-bc0f-4fe7-9650-4fad0967db72 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5324ab45f4a4449980dad920278f5034', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:38.268960 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f5fe9-bc0f-4fe7-9650-4fad0967db72 service placement] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:38.269393 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f5fe9-bc0f-4fe7-9650-4fad0967db72 service placement] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:38.269842 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f5fe9-bc0f-4fe7-9650-4fad0967db72 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:38.280925 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93f5fe9-bc0f-4fe7-9650-4fad0967db72 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:38.282927 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93f5fe9-bc0f-4fe7-9650-4fad0967db72 service placement] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:38.295799 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1039/2074] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:56:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 17:56:38.346385 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-586146fc-1bba-4e8a-92cb-21a5a851af7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5a7061dd1154fcf891c2c8af16d7841'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:38.358218 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-586146fc-1bba-4e8a-92cb-21a5a851af7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5a7061dd1154fcf891c2c8af16d7841'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:38.369815 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-586146fc-1bba-4e8a-92cb-21a5a851af7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5a7061dd1154fcf891c2c8af16d7841'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:38.373756 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-586146fc-1bba-4e8a-92cb-21a5a851af7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5a7061dd1154fcf891c2c8af16d7841'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:38.393819 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-586146fc-1bba-4e8a-92cb-21a5a851af7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5a7061dd1154fcf891c2c8af16d7841'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:38.401920 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1036/2075] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 14 17:56:38 2022] DELETE /identity/v3/users/a5a7061dd1154fcf891c2c8af16d7841 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 17:56:38.668529 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93f5fe9-bc0f-4fe7-9650-4fad0967db72 service placement] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:38.670090 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-b93f5fe9-bc0f-4fe7-9650-4fad0967db72 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:38.690378 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93f5fe9-bc0f-4fe7-9650-4fad0967db72 service placement] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:38.695551 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586146fc-1bba-4e8a-92cb-21a5a851af7c admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:38.697080 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-586146fc-1bba-4e8a-92cb-21a5a851af7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:38.738507 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:56:38.779677 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5fb876-5c68-4354-bf42-84cbfd0d6dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:38.780565 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5fb876-5c68-4354-bf42-84cbfd0d6dac admin admin] REQUEST_METHOD: `DELETE` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:38.780848 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5fb876-5c68-4354-bf42-84cbfd0d6dac admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:38.781126 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5fb876-5c68-4354-bf42-84cbfd0d6dac admin admin] PATH_INFO: `/v3/projects/0f3b885a2cbf45368c7f64d611ad9f00` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:38.782109 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586146fc-1bba-4e8a-92cb-21a5a851af7c admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:38.782412 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5fb876-5c68-4354-bf42-84cbfd0d6dac admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f3b885a2cbf45368c7f64d611ad9f00)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:38.784345 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5fb876-5c68-4354-bf42-84cbfd0d6dac admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:38.786850 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f45f39a-312d-46e7-ad0c-79d93b403479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:38.787726 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45f39a-312d-46e7-ad0c-79d93b403479 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:38.788009 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45f39a-312d-46e7-ad0c-79d93b403479 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:38.788473 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45f39a-312d-46e7-ad0c-79d93b403479 admin admin] PATH_INFO: `/v3/projects/9383d769d3b5441ca8a91161c6f36a93` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:38.789757 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f45f39a-312d-46e7-ad0c-79d93b403479 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9383d769d3b5441ca8a91161c6f36a93)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:38.791719 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f45f39a-312d-46e7-ad0c-79d93b403479 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:38.836714 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-cd5fb876-5c68-4354-bf42-84cbfd0d6dac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f3b885a2cbf45368c7f64d611ad9f00', 'request_id': 'req-cd5fb876-5c68-4354-bf42-84cbfd0d6dac'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:38.838821 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:56:38.844374 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-cd5fb876-5c68-4354-bf42-84cbfd0d6dac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f3b885a2cbf45368c7f64d611ad9f00', 'request_id': 'req-cd5fb876-5c68-4354-bf42-84cbfd0d6dac'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:38.850724 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-cd5fb876-5c68-4354-bf42-84cbfd0d6dac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f3b885a2cbf45368c7f64d611ad9f00', 'request_id': 'req-cd5fb876-5c68-4354-bf42-84cbfd0d6dac'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:38.852636 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-8f45f39a-312d-46e7-ad0c-79d93b403479 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9383d769d3b5441ca8a91161c6f36a93', 'request_id': 'req-8f45f39a-312d-46e7-ad0c-79d93b403479'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:38.860889 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-8f45f39a-312d-46e7-ad0c-79d93b403479 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9383d769d3b5441ca8a91161c6f36a93', 'request_id': 'req-8f45f39a-312d-46e7-ad0c-79d93b403479'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:38.865964 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-cd5fb876-5c68-4354-bf42-84cbfd0d6dac admin admin] The token cache is being invalidate because project 0f3b885a2cbf45368c7f64d611ad9f00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86773) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 17:56:38.866231 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-cd5fb876-5c68-4354-bf42-84cbfd0d6dac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:38.866901 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-cd5fb876-5c68-4354-bf42-84cbfd0d6dac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:38.868767 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1040/2076] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 14 17:56:38 2022] DELETE /identity/v3/projects/0f3b885a2cbf45368c7f64d611ad9f00 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:56:38.869769 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-8f45f39a-312d-46e7-ad0c-79d93b403479 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9383d769d3b5441ca8a91161c6f36a93', 'request_id': 'req-8f45f39a-312d-46e7-ad0c-79d93b403479'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:38.873285 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5fb876-5c68-4354-bf42-84cbfd0d6dac admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:38.874684 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-cd5fb876-5c68-4354-bf42-84cbfd0d6dac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:38.885309 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-8f45f39a-312d-46e7-ad0c-79d93b403479 admin admin] The token cache is being invalidate because project 9383d769d3b5441ca8a91161c6f36a93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86772) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 17:56:38.885815 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-8f45f39a-312d-46e7-ad0c-79d93b403479 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:38.886770 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-8f45f39a-312d-46e7-ad0c-79d93b403479 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:38.890035 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1037/2077] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 14 17:56:38 2022] DELETE /identity/v3/projects/9383d769d3b5441ca8a91161c6f36a93 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 17:56:38.894978 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feede04-fa74-4d32-9fae-0680982f510b None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:38.895279 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feede04-fa74-4d32-9fae-0680982f510b None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:38.895536 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feede04-fa74-4d32-9fae-0680982f510b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:38.914476 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-4feede04-fa74-4d32-9fae-0680982f510b None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:56:38.915788 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-4feede04-fa74-4d32-9fae-0680982f510b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:38.962508 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5fb876-5c68-4354-bf42-84cbfd0d6dac admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:38.991605 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1038/2078] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:56:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 17:56:39.000288 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6adaa0b-93e3-46f6-94b1-a7f8c632b8e0 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:39.000581 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6adaa0b-93e3-46f6-94b1-a7f8c632b8e0 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:39.000863 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6adaa0b-93e3-46f6-94b1-a7f8c632b8e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:39.023128 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-d6adaa0b-93e3-46f6-94b1-a7f8c632b8e0 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:56:39.024390 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-d6adaa0b-93e3-46f6-94b1-a7f8c632b8e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:39.033600 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1039/2079] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:56:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 17:56:39.038897 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6adaa0b-93e3-46f6-94b1-a7f8c632b8e0 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:39.049276 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6adaa0b-93e3-46f6-94b1-a7f8c632b8e0 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:39.055358 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aca0cd-c523-4111-a57b-f5f47f4160bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:39.056078 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aca0cd-c523-4111-a57b-f5f47f4160bd admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:39.056376 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aca0cd-c523-4111-a57b-f5f47f4160bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:39.056658 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aca0cd-c523-4111-a57b-f5f47f4160bd admin admin] PATH_INFO: `/v3/domains` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:39.057415 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aca0cd-c523-4111-a57b-f5f47f4160bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:56:39.057765 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aca0cd-c523-4111-a57b-f5f47f4160bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:39.059421 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aca0cd-c523-4111-a57b-f5f47f4160bd admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:39.064462 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7370c9-74e5-46a3-94e2-8ef3f9af104a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:39.065692 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7370c9-74e5-46a3-94e2-8ef3f9af104a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:39.066100 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7370c9-74e5-46a3-94e2-8ef3f9af104a admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:39.066477 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7370c9-74e5-46a3-94e2-8ef3f9af104a admin admin] PATH_INFO: `/v3/users/b3fe7b2344884ecdb972c2daed170dc2` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:39.067904 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7370c9-74e5-46a3-94e2-8ef3f9af104a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3fe7b2344884ecdb972c2daed170dc2)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:39.070309 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7370c9-74e5-46a3-94e2-8ef3f9af104a admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:39.077425 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1040/2080] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 14 17:56:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:56:39.083370 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aca0cd-c523-4111-a57b-f5f47f4160bd admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:39.094705 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aca0cd-c523-4111-a57b-f5f47f4160bd admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:39.099642 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc889fa-a2a5-41ff-a78f-326867d5963c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:39.100408 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc889fa-a2a5-41ff-a78f-326867d5963c admin admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:39.100771 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc889fa-a2a5-41ff-a78f-326867d5963c admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:39.101130 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc889fa-a2a5-41ff-a78f-326867d5963c admin admin] PATH_INFO: `/v3/projects` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:39.101947 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc889fa-a2a5-41ff-a78f-326867d5963c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:39.103880 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc889fa-a2a5-41ff-a78f-326867d5963c admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:39.135361 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-0e7370c9-74e5-46a3-94e2-8ef3f9af104a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3fe7b2344884ecdb972c2daed170dc2'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:39.140133 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1041/2081] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 14 17:56:39 2022] POST /identity/v3/projects => generated 405 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:56:39.144456 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc889fa-a2a5-41ff-a78f-326867d5963c admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:39.144652 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-0e7370c9-74e5-46a3-94e2-8ef3f9af104a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3fe7b2344884ecdb972c2daed170dc2'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:39.160261 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:56:39.160532 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-0e7370c9-74e5-46a3-94e2-8ef3f9af104a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3fe7b2344884ecdb972c2daed170dc2'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:39.161650 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-0e7370c9-74e5-46a3-94e2-8ef3f9af104a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3fe7b2344884ecdb972c2daed170dc2'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:39.162351 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-0e7370c9-74e5-46a3-94e2-8ef3f9af104a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3fe7b2344884ecdb972c2daed170dc2'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:39.181626 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1041/2082] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 14 17:56:38 2022] DELETE /identity/v3/users/b3fe7b2344884ecdb972c2daed170dc2 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:56:39.223133 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc889fa-a2a5-41ff-a78f-326867d5963c admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:39.296736 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2a21d8-fd9f-4314-b471-dead80dde068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:39.297444 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2a21d8-fd9f-4314-b471-dead80dde068 admin admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:39.297773 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2a21d8-fd9f-4314-b471-dead80dde068 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:39.298045 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2a21d8-fd9f-4314-b471-dead80dde068 admin admin] PATH_INFO: `/v3/users` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:39.298754 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2a21d8-fd9f-4314-b471-dead80dde068 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:39.300770 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2a21d8-fd9f-4314-b471-dead80dde068 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:39.330252 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1042/2083] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 14 17:56:39 2022] POST /identity/v3/users => generated 303 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:56:39.333573 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7370c9-74e5-46a3-94e2-8ef3f9af104a admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:39.335233 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-0e7370c9-74e5-46a3-94e2-8ef3f9af104a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:39.353104 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7370c9-74e5-46a3-94e2-8ef3f9af104a admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:39.360091 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb8c258-a601-4843-9a44-3d231b5ebb67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:39.360819 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb8c258-a601-4843-9a44-3d231b5ebb67 admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:39.361621 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb8c258-a601-4843-9a44-3d231b5ebb67 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:39.361621 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb8c258-a601-4843-9a44-3d231b5ebb67 admin admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:39.362732 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb8c258-a601-4843-9a44-3d231b5ebb67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:39.364647 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb8c258-a601-4843-9a44-3d231b5ebb67 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:39.366840 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:56:39.384396 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1042/2084] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:56:39 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:56:39.386103 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2a21d8-fd9f-4314-b471-dead80dde068 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:39.402198 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2a21d8-fd9f-4314-b471-dead80dde068 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:39.409211 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696ec301-5468-4689-9d0f-4336e29ee4ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:39.411076 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ec301-5468-4689-9d0f-4336e29ee4ed admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:39.411484 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ec301-5468-4689-9d0f-4336e29ee4ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:39.412586 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ec301-5468-4689-9d0f-4336e29ee4ed admin admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:39.414594 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696ec301-5468-4689-9d0f-4336e29ee4ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:39.417331 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696ec301-5468-4689-9d0f-4336e29ee4ed admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:39.449402 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1043/2085] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:56:39 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 17:56:39.451519 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb8c258-a601-4843-9a44-3d231b5ebb67 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:39.466583 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb8c258-a601-4843-9a44-3d231b5ebb67 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:39.473477 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556f78d9-0af3-41e6-aa7c-046c23b0a38f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:39.474192 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556f78d9-0af3-41e6-aa7c-046c23b0a38f admin admin] REQUEST_METHOD: `PUT` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:39.474584 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556f78d9-0af3-41e6-aa7c-046c23b0a38f admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:39.475172 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556f78d9-0af3-41e6-aa7c-046c23b0a38f admin admin] PATH_INFO: `/v3/projects/34033a0528a9417c9615f8d8d9650f5d/users/2b60277eeae141f5b04447f4ba869c10/roles/95d753870f97426cb1ce32e078621a4c` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:39.492488 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556f78d9-0af3-41e6-aa7c-046c23b0a38f admin admin] RBAC: Authorizing `identity:create_grant(project_id=34033a0528a9417c9615f8d8d9650f5d, user_id=2b60277eeae141f5b04447f4ba869c10, role_id=95d753870f97426cb1ce32e078621a4c)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:39.495044 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556f78d9-0af3-41e6-aa7c-046c23b0a38f admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:39.514419 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1043/2086] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 17:56:39 2022] PUT /identity/v3/projects/34033a0528a9417c9615f8d8d9650f5d/users/2b60277eeae141f5b04447f4ba869c10/roles/95d753870f97426cb1ce32e078621a4c => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:56:39.525121 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8717588d-9638-4d32-9fbd-34839b764938 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:39.525461 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8717588d-9638-4d32-9fbd-34839b764938 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:39.525734 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8717588d-9638-4d32-9fbd-34839b764938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:39.581362 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-8717588d-9638-4d32-9fbd-34839b764938 None None] MFA Rules not processed for user `2b60277eeae141f5b04447f4ba869c10`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:56:39.583032 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-8717588d-9638-4d32-9fbd-34839b764938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:39.644696 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556f78d9-0af3-41e6-aa7c-046c23b0a38f admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:39.647195 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-556f78d9-0af3-41e6-aa7c-046c23b0a38f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:39.714251 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1044/2087] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:56:39 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:56:39.719706 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8717588d-9638-4d32-9fbd-34839b764938 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:39.762123 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:56:39.772436 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556f78d9-0af3-41e6-aa7c-046c23b0a38f admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:39.777894 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5446fe36-ff86-4d5f-aac4-9f7bd1298a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:39.779507 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5446fe36-ff86-4d5f-aac4-9f7bd1298a83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:39.779850 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5446fe36-ff86-4d5f-aac4-9f7bd1298a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:39.780088 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5446fe36-ff86-4d5f-aac4-9f7bd1298a83 admin admin] PATH_INFO: `/v3/projects/e19be4a5239946b6b1f750aa86c307a7` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:39.781430 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5446fe36-ff86-4d5f-aac4-9f7bd1298a83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e19be4a5239946b6b1f750aa86c307a7)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:39.792105 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5446fe36-ff86-4d5f-aac4-9f7bd1298a83 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:39.809650 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8717588d-9638-4d32-9fbd-34839b764938 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:39.814659 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24fd216-c50a-4fb8-9487-a7227cc0ece8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:39.815223 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24fd216-c50a-4fb8-9487-a7227cc0ece8 admin admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:39.815719 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24fd216-c50a-4fb8-9487-a7227cc0ece8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:39.816237 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24fd216-c50a-4fb8-9487-a7227cc0ece8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:39.816785 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24fd216-c50a-4fb8-9487-a7227cc0ece8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:39.819164 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24fd216-c50a-4fb8-9487-a7227cc0ece8 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:39.856051 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1045/2088] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 14 17:56:39 2022] POST /identity/v3/projects => generated 403 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 17:56:39.860174 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24fd216-c50a-4fb8-9487-a7227cc0ece8 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:39.876567 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-5446fe36-ff86-4d5f-aac4-9f7bd1298a83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e19be4a5239946b6b1f750aa86c307a7', 'request_id': 'req-5446fe36-ff86-4d5f-aac4-9f7bd1298a83'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:39.884244 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-5446fe36-ff86-4d5f-aac4-9f7bd1298a83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e19be4a5239946b6b1f750aa86c307a7', 'request_id': 'req-5446fe36-ff86-4d5f-aac4-9f7bd1298a83'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:39.899142 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-5446fe36-ff86-4d5f-aac4-9f7bd1298a83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e19be4a5239946b6b1f750aa86c307a7', 'request_id': 'req-5446fe36-ff86-4d5f-aac4-9f7bd1298a83'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:39.919766 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-5446fe36-ff86-4d5f-aac4-9f7bd1298a83 admin admin] The token cache is being invalidate because project e19be4a5239946b6b1f750aa86c307a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86773) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 17:56:39.919988 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-5446fe36-ff86-4d5f-aac4-9f7bd1298a83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:39.920763 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-5446fe36-ff86-4d5f-aac4-9f7bd1298a83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:39.926390 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1044/2089] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 14 17:56:39 2022] DELETE /identity/v3/projects/e19be4a5239946b6b1f750aa86c307a7 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 17:56:39.929028 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd4ee7a-05f9-401f-8a58-4b522b7bf107 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:39.929488 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd4ee7a-05f9-401f-8a58-4b522b7bf107 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:39.929926 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd4ee7a-05f9-401f-8a58-4b522b7bf107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:39.958836 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-7dd4ee7a-05f9-401f-8a58-4b522b7bf107 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:56:39.961034 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-7dd4ee7a-05f9-401f-8a58-4b522b7bf107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:39.989345 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24fd216-c50a-4fb8-9487-a7227cc0ece8 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:39.997357 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f295b0f-8386-41fc-8d36-9836ae7dde3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:39.998462 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f295b0f-8386-41fc-8d36-9836ae7dde3b admin admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:39.998929 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f295b0f-8386-41fc-8d36-9836ae7dde3b admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:39.999367 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f295b0f-8386-41fc-8d36-9836ae7dde3b admin admin] PATH_INFO: `/v3/users` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:40.000568 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f295b0f-8386-41fc-8d36-9836ae7dde3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:40.004032 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f295b0f-8386-41fc-8d36-9836ae7dde3b admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:40.037246 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1046/2090] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 14 17:56:39 2022] POST /identity/v3/users => generated 308 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:56:40.038269 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f295b0f-8386-41fc-8d36-9836ae7dde3b admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:40.040078 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-6f295b0f-8386-41fc-8d36-9836ae7dde3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:40.055539 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f295b0f-8386-41fc-8d36-9836ae7dde3b admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:40.061566 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f883a0-209e-4d6e-858a-304da2ca901c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:40.062265 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f883a0-209e-4d6e-858a-304da2ca901c admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:40.062548 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f883a0-209e-4d6e-858a-304da2ca901c admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:40.062827 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f883a0-209e-4d6e-858a-304da2ca901c admin admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:40.063573 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f883a0-209e-4d6e-858a-304da2ca901c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:40.065217 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f883a0-209e-4d6e-858a-304da2ca901c admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:40.072174 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1045/2091] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:56:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 17:56:40.080013 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1047/2092] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:56:40 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:56:40.082103 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec7ebeb-c3f7-4c0c-9442-dd973e143b44 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:40.082660 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec7ebeb-c3f7-4c0c-9442-dd973e143b44 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:40.083078 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec7ebeb-c3f7-4c0c-9442-dd973e143b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:40.085091 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f883a0-209e-4d6e-858a-304da2ca901c admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:40.091996 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:56:40.101334 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f883a0-209e-4d6e-858a-304da2ca901c admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:40.111005 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0d2adb-5051-43d3-9736-e80c6af92fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:40.112809 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0d2adb-5051-43d3-9736-e80c6af92fc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:40.113318 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-9ec7ebeb-c3f7-4c0c-9442-dd973e143b44 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:56:40.113879 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0d2adb-5051-43d3-9736-e80c6af92fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:40.114524 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0d2adb-5051-43d3-9736-e80c6af92fc1 admin admin] PATH_INFO: `/v3/projects/6292219672934e1089463ef7b36fcea8/users/6988bac6e2024bdca5ba10fa3be5063c/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:40.115985 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-9ec7ebeb-c3f7-4c0c-9442-dd973e143b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:40.133911 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1046/2093] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:56:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 17:56:40.140269 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec7ebeb-c3f7-4c0c-9442-dd973e143b44 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:40.146312 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0d2adb-5051-43d3-9736-e80c6af92fc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6292219672934e1089463ef7b36fcea8, user_id=6988bac6e2024bdca5ba10fa3be5063c, role_id=4651a1cc7b4d4ab7a7a9ca1e77e58e71)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:40.149353 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0d2adb-5051-43d3-9736-e80c6af92fc1 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:40.152011 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec7ebeb-c3f7-4c0c-9442-dd973e143b44 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:40.164421 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8533f59-84f5-4f64-a45d-89f263b617b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:40.165470 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8533f59-84f5-4f64-a45d-89f263b617b9 admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:40.165797 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8533f59-84f5-4f64-a45d-89f263b617b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:40.166068 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8533f59-84f5-4f64-a45d-89f263b617b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:40.167133 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8533f59-84f5-4f64-a45d-89f263b617b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:56:40.167691 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8533f59-84f5-4f64-a45d-89f263b617b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:40.168028 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1048/2094] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 17:56:40 2022] PUT /identity/v3/projects/6292219672934e1089463ef7b36fcea8/users/6988bac6e2024bdca5ba10fa3be5063c/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:56:40.169492 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8533f59-84f5-4f64-a45d-89f263b617b9 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:40.175133 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0d2adb-5051-43d3-9736-e80c6af92fc1 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:40.210445 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1047/2095] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 14 17:56:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:56:40.212679 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8533f59-84f5-4f64-a45d-89f263b617b9 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:40.236589 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8533f59-84f5-4f64-a45d-89f263b617b9 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:40.362445 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0d2adb-5051-43d3-9736-e80c6af92fc1 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:40.371825 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d00c81-9518-458e-8384-193b0b70e648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:40.372839 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d00c81-9518-458e-8384-193b0b70e648 admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:40.373299 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d00c81-9518-458e-8384-193b0b70e648 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:40.373939 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d00c81-9518-458e-8384-193b0b70e648 admin admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:40.375233 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d00c81-9518-458e-8384-193b0b70e648 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:40.378154 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d00c81-9518-458e-8384-193b0b70e648 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:40.393708 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af218648-a489-47ba-8c01-88a611170cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:40.400703 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1049/2096] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:56:40 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:56:40.400988 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af218648-a489-47ba-8c01-88a611170cc7 admin admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:40.400988 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af218648-a489-47ba-8c01-88a611170cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:40.400988 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af218648-a489-47ba-8c01-88a611170cc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:40.400988 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af218648-a489-47ba-8c01-88a611170cc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:40.407785 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d00c81-9518-458e-8384-193b0b70e648 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:40.413240 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af218648-a489-47ba-8c01-88a611170cc7 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:40.427552 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:56:40.436284 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d00c81-9518-458e-8384-193b0b70e648 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:40.443147 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8384d69-e5ed-4302-b3a0-cb163d16b56a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:40.444162 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8384d69-e5ed-4302-b3a0-cb163d16b56a admin admin] REQUEST_METHOD: `PUT` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:40.444518 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8384d69-e5ed-4302-b3a0-cb163d16b56a admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:40.444855 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8384d69-e5ed-4302-b3a0-cb163d16b56a admin admin] PATH_INFO: `/v3/projects/6292219672934e1089463ef7b36fcea8/users/6988bac6e2024bdca5ba10fa3be5063c/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:40.447753 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8384d69-e5ed-4302-b3a0-cb163d16b56a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6292219672934e1089463ef7b36fcea8, user_id=6988bac6e2024bdca5ba10fa3be5063c, role_id=4651a1cc7b4d4ab7a7a9ca1e77e58e71)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:40.452846 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8384d69-e5ed-4302-b3a0-cb163d16b56a admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:40.496233 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1048/2097] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 14 17:56:40 2022] POST /identity/v3/projects => generated 355 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 17:56:40.503153 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1050/2098] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 17:56:40 2022] PUT /identity/v3/projects/6292219672934e1089463ef7b36fcea8/users/6988bac6e2024bdca5ba10fa3be5063c/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:56:40.520000 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af218648-a489-47ba-8c01-88a611170cc7 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:40.526757 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574cf621-ab69-40b9-b20e-2e0ada2be77b None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:40.528207 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574cf621-ab69-40b9-b20e-2e0ada2be77b None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:40.529441 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574cf621-ab69-40b9-b20e-2e0ada2be77b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:40.580648 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-574cf621-ab69-40b9-b20e-2e0ada2be77b None None] MFA Rules not processed for user `6988bac6e2024bdca5ba10fa3be5063c`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:56:40.582288 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-574cf621-ab69-40b9-b20e-2e0ada2be77b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:40.647763 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af218648-a489-47ba-8c01-88a611170cc7 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:40.656244 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c84ac6b-464b-4959-a306-9ad3ea7fa697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:40.657053 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c84ac6b-464b-4959-a306-9ad3ea7fa697 admin admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:40.657406 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c84ac6b-464b-4959-a306-9ad3ea7fa697 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:40.658174 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c84ac6b-464b-4959-a306-9ad3ea7fa697 admin admin] PATH_INFO: `/v3/users` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:40.659041 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c84ac6b-464b-4959-a306-9ad3ea7fa697 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:40.661213 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c84ac6b-464b-4959-a306-9ad3ea7fa697 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:40.698931 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1049/2099] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 14 17:56:40 2022] POST /identity/v3/users => generated 278 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:56:40.704402 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c84ac6b-464b-4959-a306-9ad3ea7fa697 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:40.726370 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c84ac6b-464b-4959-a306-9ad3ea7fa697 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:40.740070 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabc83cf-ba40-4ee7-9951-ea47e97323ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:40.740760 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabc83cf-ba40-4ee7-9951-ea47e97323ca admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:40.741046 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabc83cf-ba40-4ee7-9951-ea47e97323ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:40.741356 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabc83cf-ba40-4ee7-9951-ea47e97323ca admin admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:40.742586 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabc83cf-ba40-4ee7-9951-ea47e97323ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:40.743790 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabc83cf-ba40-4ee7-9951-ea47e97323ca admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:40.758634 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1051/2100] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:56:40 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:56:40.769798 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1050/2101] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:56:40 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:56:40.771850 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574cf621-ab69-40b9-b20e-2e0ada2be77b None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:40.778997 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabc83cf-ba40-4ee7-9951-ea47e97323ca admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:40.782186 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-dabc83cf-ba40-4ee7-9951-ea47e97323ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:40.790613 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574cf621-ab69-40b9-b20e-2e0ada2be77b None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:40.799630 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d487113-5b11-4f08-9d26-b3087fc06ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:40.800912 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d487113-5b11-4f08-9d26-b3087fc06ac6 admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:40.801376 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d487113-5b11-4f08-9d26-b3087fc06ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:40.801872 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d487113-5b11-4f08-9d26-b3087fc06ac6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:40.803125 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d487113-5b11-4f08-9d26-b3087fc06ac6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:40.806886 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d487113-5b11-4f08-9d26-b3087fc06ac6 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:40.832703 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1052/2102] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:56:40 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 17:56:40.838390 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d487113-5b11-4f08-9d26-b3087fc06ac6 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:40.857363 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d487113-5b11-4f08-9d26-b3087fc06ac6 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:40.863839 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84446451-bf86-421a-ae91-7153ab67133e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:40.864874 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84446451-bf86-421a-ae91-7153ab67133e admin admin] REQUEST_METHOD: `PUT` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:40.865158 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84446451-bf86-421a-ae91-7153ab67133e admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:40.865434 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84446451-bf86-421a-ae91-7153ab67133e admin admin] PATH_INFO: `/v3/projects/718aa28c01c646bea346388fcce3775c/users/df425f920c05492fbd35e71b1d8d9a30/roles/95d753870f97426cb1ce32e078621a4c` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:40.871708 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:56:40.879078 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabc83cf-ba40-4ee7-9951-ea47e97323ca admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:40.885698 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84446451-bf86-421a-ae91-7153ab67133e admin admin] RBAC: Authorizing `identity:create_grant(project_id=718aa28c01c646bea346388fcce3775c, user_id=df425f920c05492fbd35e71b1d8d9a30, role_id=95d753870f97426cb1ce32e078621a4c)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:40.885911 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01bb6a2-22e4-42b3-afa7-a2c445e7c70f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de55cae1600841889668e36402861203', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:40.886653 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01bb6a2-22e4-42b3-afa7-a2c445e7c70f service cinder] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:40.887113 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01bb6a2-22e4-42b3-afa7-a2c445e7c70f service cinder] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:40.887464 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01bb6a2-22e4-42b3-afa7-a2c445e7c70f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:40.888682 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84446451-bf86-421a-ae91-7153ab67133e admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:40.901206 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01bb6a2-22e4-42b3-afa7-a2c445e7c70f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:40.902794 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01bb6a2-22e4-42b3-afa7-a2c445e7c70f service cinder] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:40.906815 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1053/2103] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 17:56:40 2022] PUT /identity/v3/projects/718aa28c01c646bea346388fcce3775c/users/df425f920c05492fbd35e71b1d8d9a30/roles/95d753870f97426cb1ce32e078621a4c => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 17:56:40.915963 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1051/2104] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:56:40 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 17:56:40.920041 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deffbd08-1cb0-4d79-9fe5-a539f9b2b9ec None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:40.920565 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deffbd08-1cb0-4d79-9fe5-a539f9b2b9ec None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:40.921089 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deffbd08-1cb0-4d79-9fe5-a539f9b2b9ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:40.960278 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-deffbd08-1cb0-4d79-9fe5-a539f9b2b9ec None None] MFA Rules not processed for user `df425f920c05492fbd35e71b1d8d9a30`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:56:40.961705 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-deffbd08-1cb0-4d79-9fe5-a539f9b2b9ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:41.057103 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01bb6a2-22e4-42b3-afa7-a2c445e7c70f service cinder] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:41.057694 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1054/2105] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:56:40 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 17:56:41.070940 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01bb6a2-22e4-42b3-afa7-a2c445e7c70f service cinder] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:41.104735 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deffbd08-1cb0-4d79-9fe5-a539f9b2b9ec None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:41.141071 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfd70b0-0741-4721-9206-d76e89898c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:41.141791 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd70b0-0741-4721-9206-d76e89898c63 admin admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:41.142074 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd70b0-0741-4721-9206-d76e89898c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:41.142353 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd70b0-0741-4721-9206-d76e89898c63 admin admin] PATH_INFO: `/v3/projects` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:41.143056 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfd70b0-0741-4721-9206-d76e89898c63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:41.145135 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfd70b0-0741-4721-9206-d76e89898c63 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:41.154758 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:56:41.189028 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1052/2106] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 14 17:56:41 2022] POST /identity/v3/projects => generated 355 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:56:41.191194 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfd70b0-0741-4721-9206-d76e89898c63 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:41.203187 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deffbd08-1cb0-4d79-9fe5-a539f9b2b9ec None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:41.270583 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfd70b0-0741-4721-9206-d76e89898c63 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:41.275782 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f60dd5d-4735-4e91-b3e4-d67fe35369ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:41.276456 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f60dd5d-4735-4e91-b3e4-d67fe35369ac admin admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:41.276741 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f60dd5d-4735-4e91-b3e4-d67fe35369ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:41.277012 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f60dd5d-4735-4e91-b3e4-d67fe35369ac admin admin] PATH_INFO: `/v3/users` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:41.277764 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f60dd5d-4735-4e91-b3e4-d67fe35369ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:41.280251 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f60dd5d-4735-4e91-b3e4-d67fe35369ac admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:41.297108 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912129fd-2021-402d-8223-357f1f150b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:41.298064 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912129fd-2021-402d-8223-357f1f150b2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:41.298465 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912129fd-2021-402d-8223-357f1f150b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:41.298824 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912129fd-2021-402d-8223-357f1f150b2a admin admin] PATH_INFO: `/v3/users/2b60277eeae141f5b04447f4ba869c10` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:41.300052 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912129fd-2021-402d-8223-357f1f150b2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b60277eeae141f5b04447f4ba869c10)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:41.302074 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912129fd-2021-402d-8223-357f1f150b2a admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:41.303088 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1053/2107] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 14 17:56:41 2022] POST /identity/v3/users => generated 284 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 17:56:41.307545 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f60dd5d-4735-4e91-b3e4-d67fe35369ac admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:41.319435 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f60dd5d-4735-4e91-b3e4-d67fe35369ac admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:41.325118 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0d1773-33ff-4779-9b6c-a5477f148aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:41.325885 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d1773-33ff-4779-9b6c-a5477f148aa5 admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:41.326170 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d1773-33ff-4779-9b6c-a5477f148aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:41.326447 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d1773-33ff-4779-9b6c-a5477f148aa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:41.327192 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0d1773-33ff-4779-9b6c-a5477f148aa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:41.328794 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0d1773-33ff-4779-9b6c-a5477f148aa5 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:41.340101 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1054/2108] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:56:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 17:56:41.344529 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0d1773-33ff-4779-9b6c-a5477f148aa5 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:41.355768 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0d1773-33ff-4779-9b6c-a5477f148aa5 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:41.356076 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-912129fd-2021-402d-8223-357f1f150b2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b60277eeae141f5b04447f4ba869c10'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:41.361676 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e785bd3-ac83-4fd0-80b9-f0d77bc6bd9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:41.363485 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e785bd3-ac83-4fd0-80b9-f0d77bc6bd9a admin admin] REQUEST_METHOD: `PUT` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:41.363784 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e785bd3-ac83-4fd0-80b9-f0d77bc6bd9a admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:41.364128 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e785bd3-ac83-4fd0-80b9-f0d77bc6bd9a admin admin] PATH_INFO: `/v3/projects/82fb6b410bca4332907199b14d41d024/users/1f0176e509ca4754a9e9b0bc7f1c90e3/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:41.369396 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-912129fd-2021-402d-8223-357f1f150b2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b60277eeae141f5b04447f4ba869c10'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:41.383337 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-912129fd-2021-402d-8223-357f1f150b2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b60277eeae141f5b04447f4ba869c10'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:41.384435 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-912129fd-2021-402d-8223-357f1f150b2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b60277eeae141f5b04447f4ba869c10'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:41.384755 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e785bd3-ac83-4fd0-80b9-f0d77bc6bd9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=82fb6b410bca4332907199b14d41d024, user_id=1f0176e509ca4754a9e9b0bc7f1c90e3, role_id=4651a1cc7b4d4ab7a7a9ca1e77e58e71)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:41.387819 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e785bd3-ac83-4fd0-80b9-f0d77bc6bd9a admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:41.405891 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1055/2109] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 17:56:41 2022] PUT /identity/v3/projects/82fb6b410bca4332907199b14d41d024/users/1f0176e509ca4754a9e9b0bc7f1c90e3/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 17:56:41.409787 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e785bd3-ac83-4fd0-80b9-f0d77bc6bd9a admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:41.412901 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-912129fd-2021-402d-8223-357f1f150b2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b60277eeae141f5b04447f4ba869c10'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:41.415172 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-0e785bd3-ac83-4fd0-80b9-f0d77bc6bd9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:41.429775 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1055/2110] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 14 17:56:41 2022] DELETE /identity/v3/users/2b60277eeae141f5b04447f4ba869c10 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:56:41.437827 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e74f5-26c9-415c-a9e1-94fe61826780 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:41.438274 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e74f5-26c9-415c-a9e1-94fe61826780 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:41.438699 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e74f5-26c9-415c-a9e1-94fe61826780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:41.469581 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-227e74f5-26c9-415c-a9e1-94fe61826780 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:56:41.471587 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-227e74f5-26c9-415c-a9e1-94fe61826780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:41.474595 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:56:41.534800 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e785bd3-ac83-4fd0-80b9-f0d77bc6bd9a admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:41.555753 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:56:41.581198 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1056/2111] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:56:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:56:41.596020 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227e74f5-26c9-415c-a9e1-94fe61826780 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:41.598997 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-227e74f5-26c9-415c-a9e1-94fe61826780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:41.624045 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15efa67-5e73-4fb8-ada6-5d7e4c3b1b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:41.624845 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15efa67-5e73-4fb8-ada6-5d7e4c3b1b08 admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:41.625207 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15efa67-5e73-4fb8-ada6-5d7e4c3b1b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:41.625965 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15efa67-5e73-4fb8-ada6-5d7e4c3b1b08 admin admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:41.626736 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15efa67-5e73-4fb8-ada6-5d7e4c3b1b08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:41.628806 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15efa67-5e73-4fb8-ada6-5d7e4c3b1b08 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:41.648438 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1056/2112] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:56:41 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 17:56:41.655349 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15efa67-5e73-4fb8-ada6-5d7e4c3b1b08 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:41.675430 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15efa67-5e73-4fb8-ada6-5d7e4c3b1b08 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:41.687158 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063797fb-af48-4c3b-bbf0-eeff209c7d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:41.691387 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227e74f5-26c9-415c-a9e1-94fe61826780 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:41.694061 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063797fb-af48-4c3b-bbf0-eeff209c7d01 admin admin] REQUEST_METHOD: `PUT` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:41.698848 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f720f3b-73e3-4763-bc5b-285455eb969b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:41.698848 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f720f3b-73e3-4763-bc5b-285455eb969b service neutron] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:41.699327 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f720f3b-73e3-4763-bc5b-285455eb969b service neutron] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:41.699542 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f720f3b-73e3-4763-bc5b-285455eb969b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:41.702168 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063797fb-af48-4c3b-bbf0-eeff209c7d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:41.702798 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063797fb-af48-4c3b-bbf0-eeff209c7d01 admin admin] PATH_INFO: `/v3/projects/82fb6b410bca4332907199b14d41d024/users/1f0176e509ca4754a9e9b0bc7f1c90e3/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:41.706059 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063797fb-af48-4c3b-bbf0-eeff209c7d01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82fb6b410bca4332907199b14d41d024, user_id=1f0176e509ca4754a9e9b0bc7f1c90e3, role_id=4651a1cc7b4d4ab7a7a9ca1e77e58e71)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:41.709615 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063797fb-af48-4c3b-bbf0-eeff209c7d01 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:41.712639 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f720f3b-73e3-4763-bc5b-285455eb969b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:41.715320 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f720f3b-73e3-4763-bc5b-285455eb969b service neutron] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:41.726857 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1057/2113] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:56:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:56:41.737675 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1057/2114] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 17:56:41 2022] PUT /identity/v3/projects/82fb6b410bca4332907199b14d41d024/users/1f0176e509ca4754a9e9b0bc7f1c90e3/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 17:56:41.741215 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bfd7d5-f6b0-44a5-af6d-44a2bba265af None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:41.741558 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bfd7d5-f6b0-44a5-af6d-44a2bba265af None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:41.741882 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bfd7d5-f6b0-44a5-af6d-44a2bba265af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:41.777982 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-12bfd7d5-f6b0-44a5-af6d-44a2bba265af None None] MFA Rules not processed for user `1f0176e509ca4754a9e9b0bc7f1c90e3`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:56:41.779799 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-12bfd7d5-f6b0-44a5-af6d-44a2bba265af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:41.915895 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1058/2115] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:56:41 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:56:41.938196 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063797fb-af48-4c3b-bbf0-eeff209c7d01 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:41.943526 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-063797fb-af48-4c3b-bbf0-eeff209c7d01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:42.047736 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063797fb-af48-4c3b-bbf0-eeff209c7d01 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:42.051485 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24abc4c-7fb0-45c1-9d96-a4d77871bb25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de55cae1600841889668e36402861203', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:42.052457 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24abc4c-7fb0-45c1-9d96-a4d77871bb25 service cinder] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:42.052742 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24abc4c-7fb0-45c1-9d96-a4d77871bb25 service cinder] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:42.053018 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24abc4c-7fb0-45c1-9d96-a4d77871bb25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:42.082561 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24abc4c-7fb0-45c1-9d96-a4d77871bb25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:42.083988 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24abc4c-7fb0-45c1-9d96-a4d77871bb25 service cinder] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:42.100581 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1058/2116] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:56:41 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:56:42.125036 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bfd7d5-f6b0-44a5-af6d-44a2bba265af None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:42.128160 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-12bfd7d5-f6b0-44a5-af6d-44a2bba265af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:42.212747 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24abc4c-7fb0-45c1-9d96-a4d77871bb25 service cinder] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:42.225757 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24abc4c-7fb0-45c1-9d96-a4d77871bb25 service cinder] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:42.230163 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a31bb3-91d5-4c30-b8a9-20d908761595 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de55cae1600841889668e36402861203', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:42.230843 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a31bb3-91d5-4c30-b8a9-20d908761595 service cinder] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:42.231125 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a31bb3-91d5-4c30-b8a9-20d908761595 service cinder] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:42.231400 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a31bb3-91d5-4c30-b8a9-20d908761595 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:42.235302 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-d9a31bb3-91d5-4c30-b8a9-20d908761595 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:42.239611 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bfd7d5-f6b0-44a5-af6d-44a2bba265af None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:42.254056 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecd02c5-a6a0-4b74-b360-3b0a5f02e2e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:42.255430 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecd02c5-a6a0-4b74-b360-3b0a5f02e2e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:42.255718 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecd02c5-a6a0-4b74-b360-3b0a5f02e2e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:42.255995 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecd02c5-a6a0-4b74-b360-3b0a5f02e2e3 admin admin] PATH_INFO: `/v3/projects/34033a0528a9417c9615f8d8d9650f5d` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:42.257915 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecd02c5-a6a0-4b74-b360-3b0a5f02e2e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34033a0528a9417c9615f8d8d9650f5d)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:42.259914 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecd02c5-a6a0-4b74-b360-3b0a5f02e2e3 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:42.308962 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:56:42.322602 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a31bb3-91d5-4c30-b8a9-20d908761595 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:42.324194 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a31bb3-91d5-4c30-b8a9-20d908761595 service cinder] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:42.330598 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:56:42.331800 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-eecd02c5-a6a0-4b74-b360-3b0a5f02e2e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34033a0528a9417c9615f8d8d9650f5d', 'request_id': 'req-eecd02c5-a6a0-4b74-b360-3b0a5f02e2e3'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:42.338812 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-eecd02c5-a6a0-4b74-b360-3b0a5f02e2e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34033a0528a9417c9615f8d8d9650f5d', 'request_id': 'req-eecd02c5-a6a0-4b74-b360-3b0a5f02e2e3'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:42.339768 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1059/2117] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:56:42 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 17:56:42.350894 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-eecd02c5-a6a0-4b74-b360-3b0a5f02e2e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34033a0528a9417c9615f8d8d9650f5d', 'request_id': 'req-eecd02c5-a6a0-4b74-b360-3b0a5f02e2e3'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:42.368511 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-eecd02c5-a6a0-4b74-b360-3b0a5f02e2e3 admin admin] The token cache is being invalidate because project 34033a0528a9417c9615f8d8d9650f5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86772) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 17:56:42.368511 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-eecd02c5-a6a0-4b74-b360-3b0a5f02e2e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:42.370028 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-eecd02c5-a6a0-4b74-b360-3b0a5f02e2e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:42.371891 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1059/2118] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 14 17:56:42 2022] DELETE /identity/v3/projects/34033a0528a9417c9615f8d8d9650f5d => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:56:42.377301 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a31bb3-91d5-4c30-b8a9-20d908761595 service cinder] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:42.393830 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a31bb3-91d5-4c30-b8a9-20d908761595 service cinder] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:42.488361 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bfbfce-9cfd-41ce-a364-61424d3a05f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:42.490681 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bfbfce-9cfd-41ce-a364-61424d3a05f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:42.490681 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bfbfce-9cfd-41ce-a364-61424d3a05f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:42.490970 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bfbfce-9cfd-41ce-a364-61424d3a05f6 admin admin] PATH_INFO: `/v3/users/6988bac6e2024bdca5ba10fa3be5063c` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:42.493257 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bfbfce-9cfd-41ce-a364-61424d3a05f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6988bac6e2024bdca5ba10fa3be5063c)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:42.497821 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bfbfce-9cfd-41ce-a364-61424d3a05f6 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:42.560475 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-23bfbfce-9cfd-41ce-a364-61424d3a05f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6988bac6e2024bdca5ba10fa3be5063c'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:42.570533 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-23bfbfce-9cfd-41ce-a364-61424d3a05f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6988bac6e2024bdca5ba10fa3be5063c'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:42.584045 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-23bfbfce-9cfd-41ce-a364-61424d3a05f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6988bac6e2024bdca5ba10fa3be5063c'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:42.584810 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-23bfbfce-9cfd-41ce-a364-61424d3a05f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6988bac6e2024bdca5ba10fa3be5063c'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:42.585498 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-23bfbfce-9cfd-41ce-a364-61424d3a05f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6988bac6e2024bdca5ba10fa3be5063c'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:42.598706 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1060/2119] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 14 17:56:42 2022] DELETE /identity/v3/users/6988bac6e2024bdca5ba10fa3be5063c => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 17:56:42.897687 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecd02c5-a6a0-4b74-b360-3b0a5f02e2e3 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:42.899122 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-eecd02c5-a6a0-4b74-b360-3b0a5f02e2e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:42.913133 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecd02c5-a6a0-4b74-b360-3b0a5f02e2e3 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:42.979670 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeb9b51-09f9-4b3b-aa29-a2c89f1fc9a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:42.980542 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb9b51-09f9-4b3b-aa29-a2c89f1fc9a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:42.980826 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb9b51-09f9-4b3b-aa29-a2c89f1fc9a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:42.981108 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb9b51-09f9-4b3b-aa29-a2c89f1fc9a2 admin admin] PATH_INFO: `/v3/projects/6292219672934e1089463ef7b36fcea8` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:42.982382 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeb9b51-09f9-4b3b-aa29-a2c89f1fc9a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6292219672934e1089463ef7b36fcea8)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:42.984316 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeb9b51-09f9-4b3b-aa29-a2c89f1fc9a2 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:43.037915 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-eaeb9b51-09f9-4b3b-aa29-a2c89f1fc9a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6292219672934e1089463ef7b36fcea8', 'request_id': 'req-eaeb9b51-09f9-4b3b-aa29-a2c89f1fc9a2'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:43.044718 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-eaeb9b51-09f9-4b3b-aa29-a2c89f1fc9a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6292219672934e1089463ef7b36fcea8', 'request_id': 'req-eaeb9b51-09f9-4b3b-aa29-a2c89f1fc9a2'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:43.052357 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-eaeb9b51-09f9-4b3b-aa29-a2c89f1fc9a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6292219672934e1089463ef7b36fcea8', 'request_id': 'req-eaeb9b51-09f9-4b3b-aa29-a2c89f1fc9a2'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:43.064323 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-eaeb9b51-09f9-4b3b-aa29-a2c89f1fc9a2 admin admin] The token cache is being invalidate because project 6292219672934e1089463ef7b36fcea8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86772) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 17:56:43.064619 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-eaeb9b51-09f9-4b3b-aa29-a2c89f1fc9a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:43.065284 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-eaeb9b51-09f9-4b3b-aa29-a2c89f1fc9a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:43.067218 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1060/2120] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 14 17:56:42 2022] DELETE /identity/v3/projects/6292219672934e1089463ef7b36fcea8 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 17:56:43.071870 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8c64a4-3702-4088-8022-93a2e087108e None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:43.072171 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8c64a4-3702-4088-8022-93a2e087108e None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:43.072438 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8c64a4-3702-4088-8022-93a2e087108e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:43.090638 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-cd8c64a4-3702-4088-8022-93a2e087108e None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:56:43.091898 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-cd8c64a4-3702-4088-8022-93a2e087108e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:43.156942 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1061/2121] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:56:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:56:43.165688 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5412d9aa-1474-450d-9dce-388d573cfdf3 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:43.165978 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5412d9aa-1474-450d-9dce-388d573cfdf3 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:43.166256 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5412d9aa-1474-450d-9dce-388d573cfdf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:43.185393 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-5412d9aa-1474-450d-9dce-388d573cfdf3 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:56:43.186622 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-5412d9aa-1474-450d-9dce-388d573cfdf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:43.194523 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1061/2122] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:56:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:56:43.198728 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8c64a4-3702-4088-8022-93a2e087108e None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:43.208972 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8c64a4-3702-4088-8022-93a2e087108e None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:43.213495 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9f7dff-55d1-4404-83ce-ce7984f26c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:43.214172 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f7dff-55d1-4404-83ce-ce7984f26c5e admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:43.214454 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f7dff-55d1-4404-83ce-ce7984f26c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:43.214731 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f7dff-55d1-4404-83ce-ce7984f26c5e admin admin] PATH_INFO: `/v3/domains` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:43.215458 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9f7dff-55d1-4404-83ce-ce7984f26c5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:56:43.215788 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9f7dff-55d1-4404-83ce-ce7984f26c5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:43.217406 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9f7dff-55d1-4404-83ce-ce7984f26c5e admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:43.228665 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1062/2123] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 14 17:56:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:56:43.233173 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5412d9aa-1474-450d-9dce-388d573cfdf3 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:43.242543 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5412d9aa-1474-450d-9dce-388d573cfdf3 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:43.247781 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824a9441-14b6-4d52-abfd-9c32f4de58a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:43.248436 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824a9441-14b6-4d52-abfd-9c32f4de58a6 admin admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:43.248720 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824a9441-14b6-4d52-abfd-9c32f4de58a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:43.248997 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824a9441-14b6-4d52-abfd-9c32f4de58a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:43.249725 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824a9441-14b6-4d52-abfd-9c32f4de58a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:43.251632 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824a9441-14b6-4d52-abfd-9c32f4de58a6 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:43.281016 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1062/2124] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 14 17:56:43 2022] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:56:43.282164 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9f7dff-55d1-4404-83ce-ce7984f26c5e admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:43.292216 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9f7dff-55d1-4404-83ce-ce7984f26c5e admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:43.295872 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:56:43.354400 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c32d7d-cee0-44f1-a473-8ebba6ef1a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:43.355078 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c32d7d-cee0-44f1-a473-8ebba6ef1a75 admin admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:43.355360 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c32d7d-cee0-44f1-a473-8ebba6ef1a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:43.355639 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c32d7d-cee0-44f1-a473-8ebba6ef1a75 admin admin] PATH_INFO: `/v3/users` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:43.356330 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c32d7d-cee0-44f1-a473-8ebba6ef1a75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:43.358381 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c32d7d-cee0-44f1-a473-8ebba6ef1a75 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:43.379446 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1063/2125] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 14 17:56:43 2022] POST /identity/v3/users => generated 286 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:56:43.383121 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824a9441-14b6-4d52-abfd-9c32f4de58a6 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:43.394244 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824a9441-14b6-4d52-abfd-9c32f4de58a6 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:43.398880 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edf2c9a-f1c0-400e-9933-b9da35d95cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:43.399576 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edf2c9a-f1c0-400e-9933-b9da35d95cd5 admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:43.399859 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edf2c9a-f1c0-400e-9933-b9da35d95cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:43.400131 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edf2c9a-f1c0-400e-9933-b9da35d95cd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:43.400877 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edf2c9a-f1c0-400e-9933-b9da35d95cd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:43.402493 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edf2c9a-f1c0-400e-9933-b9da35d95cd5 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:43.414449 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1063/2126] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:56:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:56:43.418441 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c32d7d-cee0-44f1-a473-8ebba6ef1a75 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:43.429352 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c32d7d-cee0-44f1-a473-8ebba6ef1a75 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:43.433942 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16febc87-70f4-4502-91b0-bc30568bbd36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:43.434600 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16febc87-70f4-4502-91b0-bc30568bbd36 admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:43.435508 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16febc87-70f4-4502-91b0-bc30568bbd36 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:43.435789 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16febc87-70f4-4502-91b0-bc30568bbd36 admin admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:43.436518 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16febc87-70f4-4502-91b0-bc30568bbd36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:43.438136 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16febc87-70f4-4502-91b0-bc30568bbd36 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:43.448098 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1064/2127] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:56:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:56:43.451993 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edf2c9a-f1c0-400e-9933-b9da35d95cd5 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:43.462250 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edf2c9a-f1c0-400e-9933-b9da35d95cd5 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:43.466971 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c706561b-32c1-44e4-bd7d-131abdf03ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:43.467880 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706561b-32c1-44e4-bd7d-131abdf03ed0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:43.468161 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706561b-32c1-44e4-bd7d-131abdf03ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:43.468436 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706561b-32c1-44e4-bd7d-131abdf03ed0 admin admin] PATH_INFO: `/v3/projects/cd9db200b07342d3871fc6dfb4cfe2cd/users/d896b0aab6434a83ad159f4d9e891fa0/roles/95d753870f97426cb1ce32e078621a4c` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:43.470731 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:56:43.486693 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c706561b-32c1-44e4-bd7d-131abdf03ed0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd9db200b07342d3871fc6dfb4cfe2cd, user_id=d896b0aab6434a83ad159f4d9e891fa0, role_id=95d753870f97426cb1ce32e078621a4c)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:43.489421 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c706561b-32c1-44e4-bd7d-131abdf03ed0 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:43.503884 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1064/2128] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 17:56:43 2022] PUT /identity/v3/projects/cd9db200b07342d3871fc6dfb4cfe2cd/users/d896b0aab6434a83ad159f4d9e891fa0/roles/95d753870f97426cb1ce32e078621a4c => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:56:43.514879 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5440e043-de1f-4675-8539-7c53c5767b3e None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:43.515178 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5440e043-de1f-4675-8539-7c53c5767b3e None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:43.515458 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5440e043-de1f-4675-8539-7c53c5767b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:43.550044 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-5440e043-de1f-4675-8539-7c53c5767b3e None None] MFA Rules not processed for user `d896b0aab6434a83ad159f4d9e891fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:56:43.551266 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-5440e043-de1f-4675-8539-7c53c5767b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:43.622978 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1065/2129] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:56:43 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:56:43.625912 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c706561b-32c1-44e4-bd7d-131abdf03ed0 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:43.717513 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c706561b-32c1-44e4-bd7d-131abdf03ed0 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:43.722394 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be56aa4c-b9b5-463d-8ab4-dac69dfe26cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:43.723035 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56aa4c-b9b5-463d-8ab4-dac69dfe26cd admin admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:43.723321 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56aa4c-b9b5-463d-8ab4-dac69dfe26cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:43.723597 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56aa4c-b9b5-463d-8ab4-dac69dfe26cd admin admin] PATH_INFO: `/v3/projects` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:43.724311 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be56aa4c-b9b5-463d-8ab4-dac69dfe26cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:43.726289 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be56aa4c-b9b5-463d-8ab4-dac69dfe26cd admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:43.753339 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1065/2130] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 14 17:56:43 2022] POST /identity/v3/projects => generated 373 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 17:56:43.757493 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5440e043-de1f-4675-8539-7c53c5767b3e None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:43.769472 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5440e043-de1f-4675-8539-7c53c5767b3e None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:43.840738 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcbcfaa-4e2c-4117-b8df-c4b44f7298af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:43.840738 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcbcfaa-4e2c-4117-b8df-c4b44f7298af admin admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:43.840738 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcbcfaa-4e2c-4117-b8df-c4b44f7298af admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:43.840738 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcbcfaa-4e2c-4117-b8df-c4b44f7298af admin admin] PATH_INFO: `/v3/users` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:43.841121 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcbcfaa-4e2c-4117-b8df-c4b44f7298af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:43.842356 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcbcfaa-4e2c-4117-b8df-c4b44f7298af admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:43.872951 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1066/2131] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 14 17:56:43 2022] POST /identity/v3/users => generated 293 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:56:43.874440 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be56aa4c-b9b5-463d-8ab4-dac69dfe26cd admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:43.885827 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be56aa4c-b9b5-463d-8ab4-dac69dfe26cd admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:43.891130 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca958880-e041-49c9-9cbe-bee1823ff520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:43.891891 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca958880-e041-49c9-9cbe-bee1823ff520 admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:43.892290 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca958880-e041-49c9-9cbe-bee1823ff520 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:43.892887 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca958880-e041-49c9-9cbe-bee1823ff520 admin admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:43.894178 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca958880-e041-49c9-9cbe-bee1823ff520 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:43.895349 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca958880-e041-49c9-9cbe-bee1823ff520 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:43.906336 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1066/2132] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:56:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:56:43.910474 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcbcfaa-4e2c-4117-b8df-c4b44f7298af admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:43.917463 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:56:43.921422 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcbcfaa-4e2c-4117-b8df-c4b44f7298af admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:43.927367 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80a9464-b1d9-4153-978f-825e18dd2136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:43.928683 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80a9464-b1d9-4153-978f-825e18dd2136 admin admin] REQUEST_METHOD: `PUT` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:43.928951 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80a9464-b1d9-4153-978f-825e18dd2136 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:43.933655 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80a9464-b1d9-4153-978f-825e18dd2136 admin admin] PATH_INFO: `/v3/projects/d2c42f8812b7447fabcbe66fe06d55ad/users/030a1c2383bd432682eed87b3d9d80ac/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:43.955372 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80a9464-b1d9-4153-978f-825e18dd2136 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2c42f8812b7447fabcbe66fe06d55ad, user_id=030a1c2383bd432682eed87b3d9d80ac, role_id=4651a1cc7b4d4ab7a7a9ca1e77e58e71)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:43.958397 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80a9464-b1d9-4153-978f-825e18dd2136 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:43.974412 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1067/2133] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 17:56:43 2022] PUT /identity/v3/projects/d2c42f8812b7447fabcbe66fe06d55ad/users/030a1c2383bd432682eed87b3d9d80ac/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:56:43.978344 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca958880-e041-49c9-9cbe-bee1823ff520 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:43.989118 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca958880-e041-49c9-9cbe-bee1823ff520 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:44.061220 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6839001-8657-4c44-aed6-5d7649b99e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:44.061939 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6839001-8657-4c44-aed6-5d7649b99e26 admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:44.062220 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6839001-8657-4c44-aed6-5d7649b99e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:44.062490 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6839001-8657-4c44-aed6-5d7649b99e26 admin admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:44.063337 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6839001-8657-4c44-aed6-5d7649b99e26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:44.065121 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6839001-8657-4c44-aed6-5d7649b99e26 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:44.082742 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80a9464-b1d9-4153-978f-825e18dd2136 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:44.084110 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1067/2134] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:56:43 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:56:44.094688 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80a9464-b1d9-4153-978f-825e18dd2136 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:44.099932 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2db523-2547-4a72-b2e8-8d52b83523ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:44.100837 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2db523-2547-4a72-b2e8-8d52b83523ec admin admin] REQUEST_METHOD: `PUT` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:44.101121 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2db523-2547-4a72-b2e8-8d52b83523ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:44.101435 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2db523-2547-4a72-b2e8-8d52b83523ec admin admin] PATH_INFO: `/v3/projects/d2c42f8812b7447fabcbe66fe06d55ad/users/030a1c2383bd432682eed87b3d9d80ac/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:44.103498 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2db523-2547-4a72-b2e8-8d52b83523ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2c42f8812b7447fabcbe66fe06d55ad, user_id=030a1c2383bd432682eed87b3d9d80ac, role_id=4651a1cc7b4d4ab7a7a9ca1e77e58e71)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:44.106195 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2db523-2547-4a72-b2e8-8d52b83523ec admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:44.117688 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1068/2135] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 17:56:44 2022] PUT /identity/v3/projects/d2c42f8812b7447fabcbe66fe06d55ad/users/030a1c2383bd432682eed87b3d9d80ac/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 17:56:44.129432 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f112a-0c10-4f2b-af56-ff0fc9d86d50 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:44.129907 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f112a-0c10-4f2b-af56-ff0fc9d86d50 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:44.130105 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f112a-0c10-4f2b-af56-ff0fc9d86d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:44.162194 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-f26f112a-0c10-4f2b-af56-ff0fc9d86d50 None None] MFA Rules not processed for user `030a1c2383bd432682eed87b3d9d80ac`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:56:44.163322 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-f26f112a-0c10-4f2b-af56-ff0fc9d86d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:44.218312 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:56:44.261696 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1068/2136] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:56:44 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:56:44.270960 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2db523-2547-4a72-b2e8-8d52b83523ec admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:44.272665 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-6d2db523-2547-4a72-b2e8-8d52b83523ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:44.346618 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2db523-2547-4a72-b2e8-8d52b83523ec admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:44.351404 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662c9a39-c59a-4940-b01c-b9cfe1c0635a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de55cae1600841889668e36402861203', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:44.352380 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c9a39-c59a-4940-b01c-b9cfe1c0635a service cinder] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:44.352755 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c9a39-c59a-4940-b01c-b9cfe1c0635a service cinder] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:44.353154 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c9a39-c59a-4940-b01c-b9cfe1c0635a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:44.363297 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662c9a39-c59a-4940-b01c-b9cfe1c0635a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:44.364861 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662c9a39-c59a-4940-b01c-b9cfe1c0635a service cinder] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:44.375804 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1069/2137] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:56:44 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:56:44.798513 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26f112a-0c10-4f2b-af56-ff0fc9d86d50 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:44.871381 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26f112a-0c10-4f2b-af56-ff0fc9d86d50 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:44.876657 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce528dc-5142-4f5d-973a-3708e5308d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:44.877281 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce528dc-5142-4f5d-973a-3708e5308d8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:44.877596 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce528dc-5142-4f5d-973a-3708e5308d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:44.877889 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce528dc-5142-4f5d-973a-3708e5308d8e admin admin] PATH_INFO: `/v3/users/d896b0aab6434a83ad159f4d9e891fa0` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:44.880242 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce528dc-5142-4f5d-973a-3708e5308d8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d896b0aab6434a83ad159f4d9e891fa0)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:44.882680 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce528dc-5142-4f5d-973a-3708e5308d8e admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:44.942748 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-fce528dc-5142-4f5d-973a-3708e5308d8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd896b0aab6434a83ad159f4d9e891fa0'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:44.952103 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-fce528dc-5142-4f5d-973a-3708e5308d8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd896b0aab6434a83ad159f4d9e891fa0'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:44.961418 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-fce528dc-5142-4f5d-973a-3708e5308d8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd896b0aab6434a83ad159f4d9e891fa0'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:44.962891 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-fce528dc-5142-4f5d-973a-3708e5308d8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd896b0aab6434a83ad159f4d9e891fa0'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:44.978608 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-fce528dc-5142-4f5d-973a-3708e5308d8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd896b0aab6434a83ad159f4d9e891fa0'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:44.985885 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1069/2138] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 14 17:56:44 2022] DELETE /identity/v3/users/d896b0aab6434a83ad159f4d9e891fa0 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:56:44.991042 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa088dc8-e93b-490a-87f7-9f85ec2245a7 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:44.991218 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa088dc8-e93b-490a-87f7-9f85ec2245a7 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:44.991485 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa088dc8-e93b-490a-87f7-9f85ec2245a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:45.014480 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-aa088dc8-e93b-490a-87f7-9f85ec2245a7 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:56:45.015732 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-aa088dc8-e93b-490a-87f7-9f85ec2245a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:45.104103 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1070/2139] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:56:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:56:45.117518 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce528dc-5142-4f5d-973a-3708e5308d8e admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:45.119632 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-fce528dc-5142-4f5d-973a-3708e5308d8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:45.197255 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce528dc-5142-4f5d-973a-3708e5308d8e admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:45.201712 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a444c55b-3837-4bc1-a76a-ff8bf8e52dae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:45.202433 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a444c55b-3837-4bc1-a76a-ff8bf8e52dae service neutron] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:45.202725 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a444c55b-3837-4bc1-a76a-ff8bf8e52dae service neutron] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:45.202999 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a444c55b-3837-4bc1-a76a-ff8bf8e52dae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:45.212958 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a444c55b-3837-4bc1-a76a-ff8bf8e52dae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:45.214430 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a444c55b-3837-4bc1-a76a-ff8bf8e52dae service neutron] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:45.222448 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:56:45.237763 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1070/2140] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:56:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:56:45.585397 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa088dc8-e93b-490a-87f7-9f85ec2245a7 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:45.586917 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-aa088dc8-e93b-490a-87f7-9f85ec2245a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:45.615898 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa088dc8-e93b-490a-87f7-9f85ec2245a7 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:45.631314 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b971a66c-c3e7-4f7c-8211-4a97c3026a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:45.632985 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b971a66c-c3e7-4f7c-8211-4a97c3026a46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:45.633389 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b971a66c-c3e7-4f7c-8211-4a97c3026a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:45.633702 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b971a66c-c3e7-4f7c-8211-4a97c3026a46 admin admin] PATH_INFO: `/v3/projects/cd9db200b07342d3871fc6dfb4cfe2cd` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:45.635122 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b971a66c-c3e7-4f7c-8211-4a97c3026a46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd9db200b07342d3871fc6dfb4cfe2cd)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:45.637790 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b971a66c-c3e7-4f7c-8211-4a97c3026a46 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:45.704351 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-b971a66c-c3e7-4f7c-8211-4a97c3026a46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd9db200b07342d3871fc6dfb4cfe2cd', 'request_id': 'req-b971a66c-c3e7-4f7c-8211-4a97c3026a46'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:45.711238 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-b971a66c-c3e7-4f7c-8211-4a97c3026a46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd9db200b07342d3871fc6dfb4cfe2cd', 'request_id': 'req-b971a66c-c3e7-4f7c-8211-4a97c3026a46'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:45.717875 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-b971a66c-c3e7-4f7c-8211-4a97c3026a46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd9db200b07342d3871fc6dfb4cfe2cd', 'request_id': 'req-b971a66c-c3e7-4f7c-8211-4a97c3026a46'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:45.720748 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:56:45.739232 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-b971a66c-c3e7-4f7c-8211-4a97c3026a46 admin admin] The token cache is being invalidate because project cd9db200b07342d3871fc6dfb4cfe2cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86773) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 17:56:45.739527 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-b971a66c-c3e7-4f7c-8211-4a97c3026a46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:45.740183 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-b971a66c-c3e7-4f7c-8211-4a97c3026a46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:45.742964 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1071/2141] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 14 17:56:45 2022] DELETE /identity/v3/projects/cd9db200b07342d3871fc6dfb4cfe2cd => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:56:45.746459 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a444c55b-3837-4bc1-a76a-ff8bf8e52dae service neutron] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:45.759759 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a444c55b-3837-4bc1-a76a-ff8bf8e52dae service neutron] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:45.828060 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6676c4-2f7e-4fa2-b087-30b516938045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:45.828872 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6676c4-2f7e-4fa2-b087-30b516938045 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:45.829154 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6676c4-2f7e-4fa2-b087-30b516938045 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:45.829430 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6676c4-2f7e-4fa2-b087-30b516938045 admin admin] PATH_INFO: `/v3/users/030a1c2383bd432682eed87b3d9d80ac` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:45.830771 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6676c4-2f7e-4fa2-b087-30b516938045 admin admin] RBAC: Authorizing `identity:delete_user(user_id=030a1c2383bd432682eed87b3d9d80ac)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:45.832815 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6676c4-2f7e-4fa2-b087-30b516938045 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:45.902627 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-8c6676c4-2f7e-4fa2-b087-30b516938045 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '030a1c2383bd432682eed87b3d9d80ac'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:45.912597 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-8c6676c4-2f7e-4fa2-b087-30b516938045 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '030a1c2383bd432682eed87b3d9d80ac'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:45.921793 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-8c6676c4-2f7e-4fa2-b087-30b516938045 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '030a1c2383bd432682eed87b3d9d80ac'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:45.922948 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-8c6676c4-2f7e-4fa2-b087-30b516938045 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '030a1c2383bd432682eed87b3d9d80ac'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:45.943369 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-8c6676c4-2f7e-4fa2-b087-30b516938045 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '030a1c2383bd432682eed87b3d9d80ac'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:45.955229 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1071/2142] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 14 17:56:45 2022] DELETE /identity/v3/users/030a1c2383bd432682eed87b3d9d80ac => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 17:56:46.332325 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b971a66c-c3e7-4f7c-8211-4a97c3026a46 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:46.334400 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-b971a66c-c3e7-4f7c-8211-4a97c3026a46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:46.354612 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b971a66c-c3e7-4f7c-8211-4a97c3026a46 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:46.435923 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa6c225-5020-4618-8840-3f3ec88409d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:46.437834 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa6c225-5020-4618-8840-3f3ec88409d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:46.438288 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa6c225-5020-4618-8840-3f3ec88409d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:46.438712 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa6c225-5020-4618-8840-3f3ec88409d1 admin admin] PATH_INFO: `/v3/projects/d2c42f8812b7447fabcbe66fe06d55ad` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:46.440932 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa6c225-5020-4618-8840-3f3ec88409d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2c42f8812b7447fabcbe66fe06d55ad)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:46.443590 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa6c225-5020-4618-8840-3f3ec88409d1 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:46.508107 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-afa6c225-5020-4618-8840-3f3ec88409d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2c42f8812b7447fabcbe66fe06d55ad', 'request_id': 'req-afa6c225-5020-4618-8840-3f3ec88409d1'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:46.518579 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-afa6c225-5020-4618-8840-3f3ec88409d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2c42f8812b7447fabcbe66fe06d55ad', 'request_id': 'req-afa6c225-5020-4618-8840-3f3ec88409d1'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:46.532440 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-afa6c225-5020-4618-8840-3f3ec88409d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2c42f8812b7447fabcbe66fe06d55ad', 'request_id': 'req-afa6c225-5020-4618-8840-3f3ec88409d1'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:46.547441 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-afa6c225-5020-4618-8840-3f3ec88409d1 admin admin] The token cache is being invalidate because project d2c42f8812b7447fabcbe66fe06d55ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86773) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 17:56:46.547736 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-afa6c225-5020-4618-8840-3f3ec88409d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:46.548404 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-afa6c225-5020-4618-8840-3f3ec88409d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:46.553720 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1072/2143] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 14 17:56:46 2022] DELETE /identity/v3/projects/d2c42f8812b7447fabcbe66fe06d55ad => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:56:46.556604 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e34456-e64f-4ac4-873b-59616dfebd6f None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:46.557282 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e34456-e64f-4ac4-873b-59616dfebd6f None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:46.559440 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e34456-e64f-4ac4-873b-59616dfebd6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:46.594111 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-96e34456-e64f-4ac4-873b-59616dfebd6f None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:56:46.595477 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-96e34456-e64f-4ac4-873b-59616dfebd6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:46.673693 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1072/2144] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:56:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:56:46.685169 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69463dd5-f792-475f-9b40-afb8c28cec60 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:46.686084 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69463dd5-f792-475f-9b40-afb8c28cec60 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:46.686264 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69463dd5-f792-475f-9b40-afb8c28cec60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:46.709766 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-69463dd5-f792-475f-9b40-afb8c28cec60 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:56:46.709766 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-69463dd5-f792-475f-9b40-afb8c28cec60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:46.716321 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1073/2145] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:56:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:56:46.721849 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e34456-e64f-4ac4-873b-59616dfebd6f None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:46.735249 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e34456-e64f-4ac4-873b-59616dfebd6f None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:46.742076 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490f2cd0-26f1-4c8d-b7d7-3dffbe6e1146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:46.742779 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490f2cd0-26f1-4c8d-b7d7-3dffbe6e1146 admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:46.743066 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490f2cd0-26f1-4c8d-b7d7-3dffbe6e1146 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:46.743341 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490f2cd0-26f1-4c8d-b7d7-3dffbe6e1146 admin admin] PATH_INFO: `/v3/domains` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:46.744084 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490f2cd0-26f1-4c8d-b7d7-3dffbe6e1146 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:56:46.744386 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490f2cd0-26f1-4c8d-b7d7-3dffbe6e1146 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:46.746068 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490f2cd0-26f1-4c8d-b7d7-3dffbe6e1146 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:46.761605 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1073/2146] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 14 17:56:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:56:46.764522 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69463dd5-f792-475f-9b40-afb8c28cec60 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:46.774170 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69463dd5-f792-475f-9b40-afb8c28cec60 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:46.780128 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ea9d57-037f-41fc-895b-352e239b296f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:46.780825 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ea9d57-037f-41fc-895b-352e239b296f admin admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:46.781109 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ea9d57-037f-41fc-895b-352e239b296f admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:46.781389 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ea9d57-037f-41fc-895b-352e239b296f admin admin] PATH_INFO: `/v3/projects` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:46.782133 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ea9d57-037f-41fc-895b-352e239b296f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:46.784067 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ea9d57-037f-41fc-895b-352e239b296f admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:46.830750 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1074/2147] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 14 17:56:46 2022] POST /identity/v3/projects => generated 387 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:56:46.849784 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490f2cd0-26f1-4c8d-b7d7-3dffbe6e1146 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:46.866589 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490f2cd0-26f1-4c8d-b7d7-3dffbe6e1146 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:46.877964 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:56:46.955381 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeb2534-059d-4c1a-a600-443d8239b935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:46.956379 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb2534-059d-4c1a-a600-443d8239b935 admin admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:46.956379 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb2534-059d-4c1a-a600-443d8239b935 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:46.956660 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb2534-059d-4c1a-a600-443d8239b935 admin admin] PATH_INFO: `/v3/users` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:46.957365 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeb2534-059d-4c1a-a600-443d8239b935 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:46.960111 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeb2534-059d-4c1a-a600-443d8239b935 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:46.991818 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1074/2148] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 14 17:56:46 2022] POST /identity/v3/users => generated 294 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:56:46.998254 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ea9d57-037f-41fc-895b-352e239b296f admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:47.011754 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ea9d57-037f-41fc-895b-352e239b296f admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:47.018596 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9885824-1b0c-4fcc-9820-1123ab9a4704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:47.019286 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9885824-1b0c-4fcc-9820-1123ab9a4704 admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:47.019572 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9885824-1b0c-4fcc-9820-1123ab9a4704 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:47.019853 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9885824-1b0c-4fcc-9820-1123ab9a4704 admin admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:47.020600 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9885824-1b0c-4fcc-9820-1123ab9a4704 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:47.022290 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9885824-1b0c-4fcc-9820-1123ab9a4704 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:47.051954 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1075/2149] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:56:47.058015 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeb2534-059d-4c1a-a600-443d8239b935 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:47.075133 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeb2534-059d-4c1a-a600-443d8239b935 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:47.081028 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efe96ab-6b85-468b-be34-f25f5791b79c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:47.082119 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe96ab-6b85-468b-be34-f25f5791b79c admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:47.082405 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe96ab-6b85-468b-be34-f25f5791b79c admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:47.082693 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe96ab-6b85-468b-be34-f25f5791b79c admin admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:47.083443 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efe96ab-6b85-468b-be34-f25f5791b79c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:47.085200 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efe96ab-6b85-468b-be34-f25f5791b79c admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:47.097841 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1075/2150] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:56:47 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 17:56:47.104280 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9885824-1b0c-4fcc-9820-1123ab9a4704 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:47.122824 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9885824-1b0c-4fcc-9820-1123ab9a4704 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:47.130272 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25663e76-6697-411c-99bd-8716b2940a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:47.131309 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25663e76-6697-411c-99bd-8716b2940a46 admin admin] REQUEST_METHOD: `PUT` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:47.131597 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25663e76-6697-411c-99bd-8716b2940a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:47.131893 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25663e76-6697-411c-99bd-8716b2940a46 admin admin] PATH_INFO: `/v3/projects/7b038923cd4d434bb51711172e5074a5/users/c8acb39b6387417a84b366ce6d8cf8ef/roles/95d753870f97426cb1ce32e078621a4c` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:47.149489 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25663e76-6697-411c-99bd-8716b2940a46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b038923cd4d434bb51711172e5074a5, user_id=c8acb39b6387417a84b366ce6d8cf8ef, role_id=95d753870f97426cb1ce32e078621a4c)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:47.152234 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25663e76-6697-411c-99bd-8716b2940a46 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:47.167458 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1076/2151] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 17:56:47 2022] PUT /identity/v3/projects/7b038923cd4d434bb51711172e5074a5/users/c8acb39b6387417a84b366ce6d8cf8ef/roles/95d753870f97426cb1ce32e078621a4c => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 17:56:47.178700 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f060a1a-c3bf-420e-bc03-f0e8d0d788cc None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:47.178953 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f060a1a-c3bf-420e-bc03-f0e8d0d788cc None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:47.179515 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f060a1a-c3bf-420e-bc03-f0e8d0d788cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:47.209158 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-4f060a1a-c3bf-420e-bc03-f0e8d0d788cc None None] MFA Rules not processed for user `c8acb39b6387417a84b366ce6d8cf8ef`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:56:47.210577 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-4f060a1a-c3bf-420e-bc03-f0e8d0d788cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:47.289325 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1076/2152] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:56:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:56:47.294463 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25663e76-6697-411c-99bd-8716b2940a46 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:47.315895 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:56:47.368619 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25663e76-6697-411c-99bd-8716b2940a46 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:47.374267 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef44cc5f-cd29-4d2c-9ddc-f66ed5573de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:47.374957 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef44cc5f-cd29-4d2c-9ddc-f66ed5573de0 admin admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:47.375241 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef44cc5f-cd29-4d2c-9ddc-f66ed5573de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:47.375517 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef44cc5f-cd29-4d2c-9ddc-f66ed5573de0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:47.376241 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef44cc5f-cd29-4d2c-9ddc-f66ed5573de0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:47.378275 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef44cc5f-cd29-4d2c-9ddc-f66ed5573de0 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:47.409966 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1077/2153] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 14 17:56:47 2022] POST /identity/v3/projects => generated 387 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 17:56:47.415296 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f060a1a-c3bf-420e-bc03-f0e8d0d788cc None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:47.426516 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f060a1a-c3bf-420e-bc03-f0e8d0d788cc None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:47.488381 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213ced15-2879-482e-89cd-5c867893ecc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:47.489079 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ced15-2879-482e-89cd-5c867893ecc9 admin admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:47.489358 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ced15-2879-482e-89cd-5c867893ecc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:47.489662 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ced15-2879-482e-89cd-5c867893ecc9 admin admin] PATH_INFO: `/v3/users` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:47.490452 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213ced15-2879-482e-89cd-5c867893ecc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:47.492390 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213ced15-2879-482e-89cd-5c867893ecc9 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:47.516431 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1077/2154] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 14 17:56:47 2022] POST /identity/v3/users => generated 300 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 17:56:47.521190 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef44cc5f-cd29-4d2c-9ddc-f66ed5573de0 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:47.533834 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef44cc5f-cd29-4d2c-9ddc-f66ed5573de0 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:47.557891 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abda4845-d89b-4e71-ab0d-6b166c223db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:47.557891 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda4845-d89b-4e71-ab0d-6b166c223db1 admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:47.557891 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda4845-d89b-4e71-ab0d-6b166c223db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:47.557891 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda4845-d89b-4e71-ab0d-6b166c223db1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:47.558273 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abda4845-d89b-4e71-ab0d-6b166c223db1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:47.558273 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abda4845-d89b-4e71-ab0d-6b166c223db1 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:47.569606 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1078/2155] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:56:47 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 17:56:47.573731 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213ced15-2879-482e-89cd-5c867893ecc9 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:47.580770 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:56:47.585040 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213ced15-2879-482e-89cd-5c867893ecc9 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:47.591036 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89f1c72-2b30-41bf-bdb1-1649097b582d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:47.591963 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f1c72-2b30-41bf-bdb1-1649097b582d admin admin] REQUEST_METHOD: `PUT` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:47.592245 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f1c72-2b30-41bf-bdb1-1649097b582d admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:47.592517 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f1c72-2b30-41bf-bdb1-1649097b582d admin admin] PATH_INFO: `/v3/projects/903960507eb94f48aa327c74ffd4f740/users/6aad0ab30a1d47c1a39e81dc7b53fab7/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:47.608094 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89f1c72-2b30-41bf-bdb1-1649097b582d admin admin] RBAC: Authorizing `identity:create_grant(project_id=903960507eb94f48aa327c74ffd4f740, user_id=6aad0ab30a1d47c1a39e81dc7b53fab7, role_id=4651a1cc7b4d4ab7a7a9ca1e77e58e71)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:47.610819 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89f1c72-2b30-41bf-bdb1-1649097b582d admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:47.624791 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1078/2156] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 17:56:47 2022] PUT /identity/v3/projects/903960507eb94f48aa327c74ffd4f740/users/6aad0ab30a1d47c1a39e81dc7b53fab7/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:56:47.628863 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abda4845-d89b-4e71-ab0d-6b166c223db1 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:47.640086 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abda4845-d89b-4e71-ab0d-6b166c223db1 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:47.702269 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7902fb-f589-486a-924c-70adc8b021d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:47.703324 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7902fb-f589-486a-924c-70adc8b021d2 admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:47.703324 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7902fb-f589-486a-924c-70adc8b021d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:47.703648 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7902fb-f589-486a-924c-70adc8b021d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:47.704217 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7902fb-f589-486a-924c-70adc8b021d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:47.705870 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7902fb-f589-486a-924c-70adc8b021d2 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:47.716505 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1079/2157] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:56:47 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:56:47.720732 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89f1c72-2b30-41bf-bdb1-1649097b582d admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:47.731017 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89f1c72-2b30-41bf-bdb1-1649097b582d admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:47.735628 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bcdfde-6a90-4635-a1fd-d15bc79a3af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:47.736507 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bcdfde-6a90-4635-a1fd-d15bc79a3af9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:47.736786 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bcdfde-6a90-4635-a1fd-d15bc79a3af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:47.737059 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bcdfde-6a90-4635-a1fd-d15bc79a3af9 admin admin] PATH_INFO: `/v3/projects/903960507eb94f48aa327c74ffd4f740/users/6aad0ab30a1d47c1a39e81dc7b53fab7/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:47.739065 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bcdfde-6a90-4635-a1fd-d15bc79a3af9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=903960507eb94f48aa327c74ffd4f740, user_id=6aad0ab30a1d47c1a39e81dc7b53fab7, role_id=4651a1cc7b4d4ab7a7a9ca1e77e58e71)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:47.741736 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bcdfde-6a90-4635-a1fd-d15bc79a3af9 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:47.760105 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1079/2158] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 17:56:47 2022] PUT /identity/v3/projects/903960507eb94f48aa327c74ffd4f740/users/6aad0ab30a1d47c1a39e81dc7b53fab7/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:56:47.773581 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35815f5-a34b-4e55-9f68-eb5f024723c3 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:47.773933 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35815f5-a34b-4e55-9f68-eb5f024723c3 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:47.774340 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35815f5-a34b-4e55-9f68-eb5f024723c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:47.801889 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-b35815f5-a34b-4e55-9f68-eb5f024723c3 None None] MFA Rules not processed for user `6aad0ab30a1d47c1a39e81dc7b53fab7`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:56:47.803140 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-b35815f5-a34b-4e55-9f68-eb5f024723c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:47.883851 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1080/2159] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:56:47 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:56:47.900958 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bcdfde-6a90-4635-a1fd-d15bc79a3af9 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:47.902758 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-35bcdfde-6a90-4635-a1fd-d15bc79a3af9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:47.965850 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bcdfde-6a90-4635-a1fd-d15bc79a3af9 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:47.970516 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1754bc18-220d-4da3-ba24-94894d49169d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de55cae1600841889668e36402861203', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:47.971234 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1754bc18-220d-4da3-ba24-94894d49169d service cinder] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:47.971483 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1754bc18-220d-4da3-ba24-94894d49169d service cinder] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:47.971761 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1754bc18-220d-4da3-ba24-94894d49169d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:47.982514 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1754bc18-220d-4da3-ba24-94894d49169d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:47.984103 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1754bc18-220d-4da3-ba24-94894d49169d service cinder] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:47.999502 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1080/2160] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:56:47 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:56:48.146963 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35815f5-a34b-4e55-9f68-eb5f024723c3 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:48.182489 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:56:48.237091 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35815f5-a34b-4e55-9f68-eb5f024723c3 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:48.242123 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a64fab-7a24-4bef-bbce-8d10cf18bca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:48.243050 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a64fab-7a24-4bef-bbce-8d10cf18bca8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:48.243337 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a64fab-7a24-4bef-bbce-8d10cf18bca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:48.243617 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a64fab-7a24-4bef-bbce-8d10cf18bca8 admin admin] PATH_INFO: `/v3/users/c8acb39b6387417a84b366ce6d8cf8ef` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:48.244875 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a64fab-7a24-4bef-bbce-8d10cf18bca8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8acb39b6387417a84b366ce6d8cf8ef)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:48.246855 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a64fab-7a24-4bef-bbce-8d10cf18bca8 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:48.303090 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-f1a64fab-7a24-4bef-bbce-8d10cf18bca8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8acb39b6387417a84b366ce6d8cf8ef'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:48.315323 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-f1a64fab-7a24-4bef-bbce-8d10cf18bca8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8acb39b6387417a84b366ce6d8cf8ef'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:48.337234 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-f1a64fab-7a24-4bef-bbce-8d10cf18bca8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8acb39b6387417a84b366ce6d8cf8ef'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:48.338254 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-f1a64fab-7a24-4bef-bbce-8d10cf18bca8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8acb39b6387417a84b366ce6d8cf8ef'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:48.339045 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-f1a64fab-7a24-4bef-bbce-8d10cf18bca8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8acb39b6387417a84b366ce6d8cf8ef'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:48.359585 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1081/2161] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 14 17:56:48 2022] DELETE /identity/v3/users/c8acb39b6387417a84b366ce6d8cf8ef => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:56:48.364584 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1090a7e9-c721-4e1a-9c9d-3959130e7411 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:48.364881 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1090a7e9-c721-4e1a-9c9d-3959130e7411 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:48.365163 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1090a7e9-c721-4e1a-9c9d-3959130e7411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:48.382958 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-1090a7e9-c721-4e1a-9c9d-3959130e7411 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:56:48.384183 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-1090a7e9-c721-4e1a-9c9d-3959130e7411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:48.448668 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1081/2162] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:56:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 17:56:48.462621 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a64fab-7a24-4bef-bbce-8d10cf18bca8 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:48.464852 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-f1a64fab-7a24-4bef-bbce-8d10cf18bca8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:48.541881 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a64fab-7a24-4bef-bbce-8d10cf18bca8 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:48.545877 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec067ad-d225-432e-9377-4e36ca8a90b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:48.546581 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec067ad-d225-432e-9377-4e36ca8a90b8 service neutron] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:48.546864 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec067ad-d225-432e-9377-4e36ca8a90b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:48.547141 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec067ad-d225-432e-9377-4e36ca8a90b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:48.558805 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec067ad-d225-432e-9377-4e36ca8a90b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:48.560862 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec067ad-d225-432e-9377-4e36ca8a90b8 service neutron] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:48.572283 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1082/2163] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:56:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:56:48.898463 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1090a7e9-c721-4e1a-9c9d-3959130e7411 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:48.899897 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-1090a7e9-c721-4e1a-9c9d-3959130e7411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:48.913441 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1090a7e9-c721-4e1a-9c9d-3959130e7411 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:48.918421 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e29b0f2-bb66-4066-99ee-eb39fbca2edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:48.919297 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e29b0f2-bb66-4066-99ee-eb39fbca2edf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:48.920079 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e29b0f2-bb66-4066-99ee-eb39fbca2edf admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:48.920381 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e29b0f2-bb66-4066-99ee-eb39fbca2edf admin admin] PATH_INFO: `/v3/projects/7b038923cd4d434bb51711172e5074a5` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:48.922232 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e29b0f2-bb66-4066-99ee-eb39fbca2edf admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b038923cd4d434bb51711172e5074a5)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:48.923576 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e29b0f2-bb66-4066-99ee-eb39fbca2edf admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:48.991405 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-2e29b0f2-bb66-4066-99ee-eb39fbca2edf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b038923cd4d434bb51711172e5074a5', 'request_id': 'req-2e29b0f2-bb66-4066-99ee-eb39fbca2edf'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:48.996978 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-2e29b0f2-bb66-4066-99ee-eb39fbca2edf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b038923cd4d434bb51711172e5074a5', 'request_id': 'req-2e29b0f2-bb66-4066-99ee-eb39fbca2edf'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:49.008161 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-2e29b0f2-bb66-4066-99ee-eb39fbca2edf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b038923cd4d434bb51711172e5074a5', 'request_id': 'req-2e29b0f2-bb66-4066-99ee-eb39fbca2edf'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:49.009586 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:56:49.023281 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-2e29b0f2-bb66-4066-99ee-eb39fbca2edf admin admin] The token cache is being invalidate because project 7b038923cd4d434bb51711172e5074a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86772) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 17:56:49.023579 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-2e29b0f2-bb66-4066-99ee-eb39fbca2edf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:49.024237 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-2e29b0f2-bb66-4066-99ee-eb39fbca2edf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:49.025864 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1082/2164] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 14 17:56:48 2022] DELETE /identity/v3/projects/7b038923cd4d434bb51711172e5074a5 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:56:49.029966 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec067ad-d225-432e-9377-4e36ca8a90b8 service neutron] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:49.040542 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec067ad-d225-432e-9377-4e36ca8a90b8 service neutron] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:49.088667 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:56:49.115545 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821a0848-11be-4a97-9fe1-ff1018ec9360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:49.116443 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a0848-11be-4a97-9fe1-ff1018ec9360 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:49.116725 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a0848-11be-4a97-9fe1-ff1018ec9360 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:49.117094 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a0848-11be-4a97-9fe1-ff1018ec9360 admin admin] PATH_INFO: `/v3/users/6aad0ab30a1d47c1a39e81dc7b53fab7` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:49.118255 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821a0848-11be-4a97-9fe1-ff1018ec9360 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6aad0ab30a1d47c1a39e81dc7b53fab7)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:49.120206 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821a0848-11be-4a97-9fe1-ff1018ec9360 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:49.169310 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-821a0848-11be-4a97-9fe1-ff1018ec9360 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6aad0ab30a1d47c1a39e81dc7b53fab7'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:49.177285 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-821a0848-11be-4a97-9fe1-ff1018ec9360 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6aad0ab30a1d47c1a39e81dc7b53fab7'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:49.191666 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-821a0848-11be-4a97-9fe1-ff1018ec9360 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6aad0ab30a1d47c1a39e81dc7b53fab7'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:49.192379 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-821a0848-11be-4a97-9fe1-ff1018ec9360 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6aad0ab30a1d47c1a39e81dc7b53fab7'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:49.193012 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-821a0848-11be-4a97-9fe1-ff1018ec9360 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6aad0ab30a1d47c1a39e81dc7b53fab7'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:49.206671 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1083/2165] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 14 17:56:49 2022] DELETE /identity/v3/users/6aad0ab30a1d47c1a39e81dc7b53fab7 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:56:49.594384 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e29b0f2-bb66-4066-99ee-eb39fbca2edf admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:49.596057 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-2e29b0f2-bb66-4066-99ee-eb39fbca2edf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:49.611333 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e29b0f2-bb66-4066-99ee-eb39fbca2edf admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:49.701796 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a2cc89-1fff-4fd1-bfc4-16f0faa789af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:49.702920 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a2cc89-1fff-4fd1-bfc4-16f0faa789af admin admin] REQUEST_METHOD: `DELETE` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:49.703307 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a2cc89-1fff-4fd1-bfc4-16f0faa789af admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:49.703719 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a2cc89-1fff-4fd1-bfc4-16f0faa789af admin admin] PATH_INFO: `/v3/projects/903960507eb94f48aa327c74ffd4f740` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:49.705145 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a2cc89-1fff-4fd1-bfc4-16f0faa789af admin admin] RBAC: Authorizing `identity:delete_project(project_id=903960507eb94f48aa327c74ffd4f740)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:49.707594 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a2cc89-1fff-4fd1-bfc4-16f0faa789af admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:49.786320 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-b8a2cc89-1fff-4fd1-bfc4-16f0faa789af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '903960507eb94f48aa327c74ffd4f740', 'request_id': 'req-b8a2cc89-1fff-4fd1-bfc4-16f0faa789af'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:49.792106 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-b8a2cc89-1fff-4fd1-bfc4-16f0faa789af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '903960507eb94f48aa327c74ffd4f740', 'request_id': 'req-b8a2cc89-1fff-4fd1-bfc4-16f0faa789af'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:49.801197 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-b8a2cc89-1fff-4fd1-bfc4-16f0faa789af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '903960507eb94f48aa327c74ffd4f740', 'request_id': 'req-b8a2cc89-1fff-4fd1-bfc4-16f0faa789af'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:49.815290 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-b8a2cc89-1fff-4fd1-bfc4-16f0faa789af admin admin] The token cache is being invalidate because project 903960507eb94f48aa327c74ffd4f740 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86772) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 17:56:49.815579 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-b8a2cc89-1fff-4fd1-bfc4-16f0faa789af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:49.816270 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-b8a2cc89-1fff-4fd1-bfc4-16f0faa789af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:49.817978 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1083/2166] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 14 17:56:49 2022] DELETE /identity/v3/projects/903960507eb94f48aa327c74ffd4f740 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:56:49.823336 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcffe20e-329e-4416-ae6f-5fa1f36a6eaa None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:49.823562 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcffe20e-329e-4416-ae6f-5fa1f36a6eaa None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:49.823811 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcffe20e-329e-4416-ae6f-5fa1f36a6eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:49.843974 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-dcffe20e-329e-4416-ae6f-5fa1f36a6eaa None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:56:49.845270 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-dcffe20e-329e-4416-ae6f-5fa1f36a6eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:49.913085 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1084/2167] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:56:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 17:56:49.921583 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3dd6d5-f828-49f4-bd37-cbb48f598e9a None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:49.921880 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3dd6d5-f828-49f4-bd37-cbb48f598e9a None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:49.922201 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3dd6d5-f828-49f4-bd37-cbb48f598e9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:49.943159 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-fa3dd6d5-f828-49f4-bd37-cbb48f598e9a None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:56:49.944440 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-fa3dd6d5-f828-49f4-bd37-cbb48f598e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:49.953346 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1084/2168] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:56:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:56:49.957645 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcffe20e-329e-4416-ae6f-5fa1f36a6eaa None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:49.967288 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcffe20e-329e-4416-ae6f-5fa1f36a6eaa None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:49.971766 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c058b9ad-ea45-4654-9233-d7ef1c78045e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:49.972414 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c058b9ad-ea45-4654-9233-d7ef1c78045e admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:49.972693 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c058b9ad-ea45-4654-9233-d7ef1c78045e admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:49.972966 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c058b9ad-ea45-4654-9233-d7ef1c78045e admin admin] PATH_INFO: `/v3/domains` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:49.973722 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c058b9ad-ea45-4654-9233-d7ef1c78045e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:56:49.974028 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c058b9ad-ea45-4654-9233-d7ef1c78045e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:49.975608 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c058b9ad-ea45-4654-9233-d7ef1c78045e admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:49.987145 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1085/2169] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 14 17:56:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:56:49.991339 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3dd6d5-f828-49f4-bd37-cbb48f598e9a None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:50.001049 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3dd6d5-f828-49f4-bd37-cbb48f598e9a None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:50.005735 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166d46dc-25cb-46f3-9d8d-9f00c9404640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:50.006365 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d46dc-25cb-46f3-9d8d-9f00c9404640 admin admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:50.006643 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d46dc-25cb-46f3-9d8d-9f00c9404640 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:50.006917 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d46dc-25cb-46f3-9d8d-9f00c9404640 admin admin] PATH_INFO: `/v3/projects` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:50.007596 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166d46dc-25cb-46f3-9d8d-9f00c9404640 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:50.009465 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166d46dc-25cb-46f3-9d8d-9f00c9404640 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:50.036183 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1085/2170] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 14 17:56:49 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:56:50.040403 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c058b9ad-ea45-4654-9233-d7ef1c78045e admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:50.050681 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c058b9ad-ea45-4654-9233-d7ef1c78045e admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:50.092491 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:56:50.109510 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba305ce3-1d03-4744-a2ad-d8d53bc0fe02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:50.110235 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba305ce3-1d03-4744-a2ad-d8d53bc0fe02 admin admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:50.110517 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba305ce3-1d03-4744-a2ad-d8d53bc0fe02 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:50.110788 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba305ce3-1d03-4744-a2ad-d8d53bc0fe02 admin admin] PATH_INFO: `/v3/users` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:50.111528 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba305ce3-1d03-4744-a2ad-d8d53bc0fe02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:50.113484 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba305ce3-1d03-4744-a2ad-d8d53bc0fe02 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:50.134306 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1086/2171] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 14 17:56:50 2022] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:56:50.138653 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166d46dc-25cb-46f3-9d8d-9f00c9404640 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:50.152121 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166d46dc-25cb-46f3-9d8d-9f00c9404640 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:50.157321 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6309d6a-c94d-4fcc-a4e0-f53a54e6f866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:50.158061 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6309d6a-c94d-4fcc-a4e0-f53a54e6f866 admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:50.158374 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6309d6a-c94d-4fcc-a4e0-f53a54e6f866 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:50.158647 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6309d6a-c94d-4fcc-a4e0-f53a54e6f866 admin admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:50.159407 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6309d6a-c94d-4fcc-a4e0-f53a54e6f866 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:50.161060 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6309d6a-c94d-4fcc-a4e0-f53a54e6f866 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:50.173827 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1086/2172] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:56:50 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:56:50.178234 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba305ce3-1d03-4744-a2ad-d8d53bc0fe02 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:50.189969 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba305ce3-1d03-4744-a2ad-d8d53bc0fe02 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:50.194679 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00293d8f-4085-41b0-8d99-a983f166539e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:50.195377 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00293d8f-4085-41b0-8d99-a983f166539e admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:50.195657 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00293d8f-4085-41b0-8d99-a983f166539e admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:50.195930 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00293d8f-4085-41b0-8d99-a983f166539e admin admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:50.196675 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00293d8f-4085-41b0-8d99-a983f166539e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:50.198330 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00293d8f-4085-41b0-8d99-a983f166539e admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:50.209778 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1087/2173] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:56:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:56:50.214187 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6309d6a-c94d-4fcc-a4e0-f53a54e6f866 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:50.224389 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6309d6a-c94d-4fcc-a4e0-f53a54e6f866 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:50.229079 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e23f114-df7c-4138-95f7-44542cf69b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:50.230013 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e23f114-df7c-4138-95f7-44542cf69b85 admin admin] REQUEST_METHOD: `PUT` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:50.230290 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e23f114-df7c-4138-95f7-44542cf69b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:50.230565 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e23f114-df7c-4138-95f7-44542cf69b85 admin admin] PATH_INFO: `/v3/projects/0942757697434cebbaa2d3cf70503f6e/users/b57196dca1d74c529a8d4e15e96f0237/roles/95d753870f97426cb1ce32e078621a4c` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:50.246589 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e23f114-df7c-4138-95f7-44542cf69b85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0942757697434cebbaa2d3cf70503f6e, user_id=b57196dca1d74c529a8d4e15e96f0237, role_id=95d753870f97426cb1ce32e078621a4c)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:50.249986 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e23f114-df7c-4138-95f7-44542cf69b85 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:50.266320 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1087/2174] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 17:56:50 2022] PUT /identity/v3/projects/0942757697434cebbaa2d3cf70503f6e/users/b57196dca1d74c529a8d4e15e96f0237/roles/95d753870f97426cb1ce32e078621a4c => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:56:50.276693 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de36345-217d-4c7f-a316-35bbf57386f0 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:50.276989 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de36345-217d-4c7f-a316-35bbf57386f0 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:50.277431 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de36345-217d-4c7f-a316-35bbf57386f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:50.308143 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-6de36345-217d-4c7f-a316-35bbf57386f0 None None] MFA Rules not processed for user `b57196dca1d74c529a8d4e15e96f0237`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:56:50.309357 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-6de36345-217d-4c7f-a316-35bbf57386f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:50.389294 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1088/2175] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:56:50 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 17:56:50.400721 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e23f114-df7c-4138-95f7-44542cf69b85 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:50.402813 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-0e23f114-df7c-4138-95f7-44542cf69b85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:50.425300 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:56:50.463430 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e23f114-df7c-4138-95f7-44542cf69b85 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:50.467087 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b86983-0062-4a20-b624-24caadd81af1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de55cae1600841889668e36402861203', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:50.467727 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b86983-0062-4a20-b624-24caadd81af1 service cinder] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:50.468008 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b86983-0062-4a20-b624-24caadd81af1 service cinder] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:50.468281 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b86983-0062-4a20-b624-24caadd81af1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:50.476713 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b86983-0062-4a20-b624-24caadd81af1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:50.478295 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b86983-0062-4a20-b624-24caadd81af1 service cinder] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:50.487993 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1088/2176] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:56:50 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:56:50.508008 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de36345-217d-4c7f-a316-35bbf57386f0 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:50.573480 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de36345-217d-4c7f-a316-35bbf57386f0 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:50.578087 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4470be0-ad70-496b-ae90-fc8925e73257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:50.578968 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4470be0-ad70-496b-ae90-fc8925e73257 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:50.579250 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4470be0-ad70-496b-ae90-fc8925e73257 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:50.579526 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4470be0-ad70-496b-ae90-fc8925e73257 admin admin] PATH_INFO: `/v3/users/b57196dca1d74c529a8d4e15e96f0237` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:50.580732 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4470be0-ad70-496b-ae90-fc8925e73257 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b57196dca1d74c529a8d4e15e96f0237)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:50.582720 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4470be0-ad70-496b-ae90-fc8925e73257 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:50.644055 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-d4470be0-ad70-496b-ae90-fc8925e73257 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b57196dca1d74c529a8d4e15e96f0237'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:50.652405 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-d4470be0-ad70-496b-ae90-fc8925e73257 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b57196dca1d74c529a8d4e15e96f0237'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:50.654370 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:56:50.672619 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-d4470be0-ad70-496b-ae90-fc8925e73257 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b57196dca1d74c529a8d4e15e96f0237'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:50.673353 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-d4470be0-ad70-496b-ae90-fc8925e73257 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b57196dca1d74c529a8d4e15e96f0237'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:50.674006 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-d4470be0-ad70-496b-ae90-fc8925e73257 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b57196dca1d74c529a8d4e15e96f0237'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:50.687073 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1089/2177] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 14 17:56:50 2022] DELETE /identity/v3/users/b57196dca1d74c529a8d4e15e96f0237 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:56:50.691878 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cce62ac-b659-4651-afed-13dbfeea7768 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:50.692273 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cce62ac-b659-4651-afed-13dbfeea7768 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:50.692604 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cce62ac-b659-4651-afed-13dbfeea7768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:50.719766 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-3cce62ac-b659-4651-afed-13dbfeea7768 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:56:50.721725 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-3cce62ac-b659-4651-afed-13dbfeea7768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:50.786620 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1089/2178] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:56:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:56:50.796866 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4470be0-ad70-496b-ae90-fc8925e73257 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:50.798418 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-d4470be0-ad70-496b-ae90-fc8925e73257 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:50.866328 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4470be0-ad70-496b-ae90-fc8925e73257 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:50.870731 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe58bcf-a83e-432b-b3b2-1c57bafbceee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:50.871489 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe58bcf-a83e-432b-b3b2-1c57bafbceee service neutron] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:50.871841 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe58bcf-a83e-432b-b3b2-1c57bafbceee service neutron] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:50.872121 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe58bcf-a83e-432b-b3b2-1c57bafbceee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:50.882722 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe58bcf-a83e-432b-b3b2-1c57bafbceee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:50.884176 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe58bcf-a83e-432b-b3b2-1c57bafbceee service neutron] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:50.894750 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1090/2179] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:56:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:56:51.230820 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cce62ac-b659-4651-afed-13dbfeea7768 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:51.232452 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-3cce62ac-b659-4651-afed-13dbfeea7768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:51.245462 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cce62ac-b659-4651-afed-13dbfeea7768 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:51.250362 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aec5ae-6c30-4a33-a63f-a0292a47da1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:51.251340 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aec5ae-6c30-4a33-a63f-a0292a47da1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:51.251684 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aec5ae-6c30-4a33-a63f-a0292a47da1d admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:51.252033 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aec5ae-6c30-4a33-a63f-a0292a47da1d admin admin] PATH_INFO: `/v3/projects/0942757697434cebbaa2d3cf70503f6e` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:51.253316 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aec5ae-6c30-4a33-a63f-a0292a47da1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0942757697434cebbaa2d3cf70503f6e)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:51.255329 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aec5ae-6c30-4a33-a63f-a0292a47da1d admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:51.305260 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-56aec5ae-6c30-4a33-a63f-a0292a47da1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0942757697434cebbaa2d3cf70503f6e', 'request_id': 'req-56aec5ae-6c30-4a33-a63f-a0292a47da1d'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:51.311736 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-56aec5ae-6c30-4a33-a63f-a0292a47da1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0942757697434cebbaa2d3cf70503f6e', 'request_id': 'req-56aec5ae-6c30-4a33-a63f-a0292a47da1d'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:51.320389 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-56aec5ae-6c30-4a33-a63f-a0292a47da1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0942757697434cebbaa2d3cf70503f6e', 'request_id': 'req-56aec5ae-6c30-4a33-a63f-a0292a47da1d'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:51.332352 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-56aec5ae-6c30-4a33-a63f-a0292a47da1d admin admin] The token cache is being invalidate because project 0942757697434cebbaa2d3cf70503f6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86772) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 17:56:51.332663 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-56aec5ae-6c30-4a33-a63f-a0292a47da1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:51.333319 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-56aec5ae-6c30-4a33-a63f-a0292a47da1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:51.335131 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1090/2180] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 14 17:56:51 2022] DELETE /identity/v3/projects/0942757697434cebbaa2d3cf70503f6e => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:56:51.342056 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9228320c-a4a6-4c70-9622-ae08cd170364 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:51.342889 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9228320c-a4a6-4c70-9622-ae08cd170364 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:51.342889 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9228320c-a4a6-4c70-9622-ae08cd170364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:51.360051 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-9228320c-a4a6-4c70-9622-ae08cd170364 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:56:51.361281 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-9228320c-a4a6-4c70-9622-ae08cd170364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:51.422359 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1091/2181] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:56:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:56:51.431870 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f67e9b-943b-4481-b16e-6244c79d4dc3 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:51.432267 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f67e9b-943b-4481-b16e-6244c79d4dc3 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:51.432523 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f67e9b-943b-4481-b16e-6244c79d4dc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:51.453247 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-a8f67e9b-943b-4481-b16e-6244c79d4dc3 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:56:51.454873 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-a8f67e9b-943b-4481-b16e-6244c79d4dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:51.463668 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1091/2182] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:56:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:56:51.470163 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9228320c-a4a6-4c70-9622-ae08cd170364 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:51.480467 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9228320c-a4a6-4c70-9622-ae08cd170364 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:51.485190 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb584ff3-55e0-45b6-afae-2e23d1e913d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:51.485903 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb584ff3-55e0-45b6-afae-2e23d1e913d6 admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:51.486186 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb584ff3-55e0-45b6-afae-2e23d1e913d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:51.486463 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb584ff3-55e0-45b6-afae-2e23d1e913d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:51.487245 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb584ff3-55e0-45b6-afae-2e23d1e913d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:56:51.487552 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb584ff3-55e0-45b6-afae-2e23d1e913d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:51.489185 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb584ff3-55e0-45b6-afae-2e23d1e913d6 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:51.502260 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1092/2183] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 14 17:56:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:56:51.508218 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f67e9b-943b-4481-b16e-6244c79d4dc3 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:51.520669 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f67e9b-943b-4481-b16e-6244c79d4dc3 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:51.526562 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e488ee17-be0a-474b-8f38-391c23022192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:51.527234 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e488ee17-be0a-474b-8f38-391c23022192 admin admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:51.527516 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e488ee17-be0a-474b-8f38-391c23022192 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:51.527820 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e488ee17-be0a-474b-8f38-391c23022192 admin admin] PATH_INFO: `/v3/projects` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:51.528521 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e488ee17-be0a-474b-8f38-391c23022192 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:51.530775 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e488ee17-be0a-474b-8f38-391c23022192 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:51.558465 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1092/2184] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 14 17:56:51 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:56:51.563935 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb584ff3-55e0-45b6-afae-2e23d1e913d6 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:51.574863 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb584ff3-55e0-45b6-afae-2e23d1e913d6 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:51.652142 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba507cda-430c-4d1c-8a3b-98266d9af9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:51.652868 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba507cda-430c-4d1c-8a3b-98266d9af9c9 admin admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:51.653238 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba507cda-430c-4d1c-8a3b-98266d9af9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:51.653562 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba507cda-430c-4d1c-8a3b-98266d9af9c9 admin admin] PATH_INFO: `/v3/users` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:51.654423 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba507cda-430c-4d1c-8a3b-98266d9af9c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:51.656745 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba507cda-430c-4d1c-8a3b-98266d9af9c9 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:51.665799 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:56:51.680223 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1093/2185] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 14 17:56:51 2022] POST /identity/v3/users => generated 289 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 17:56:51.686472 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e488ee17-be0a-474b-8f38-391c23022192 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:51.697639 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e488ee17-be0a-474b-8f38-391c23022192 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:51.703078 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a0420e-4689-47cc-80eb-7940afd47ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:51.703754 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a0420e-4689-47cc-80eb-7940afd47ba1 admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:51.704037 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a0420e-4689-47cc-80eb-7940afd47ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:51.704311 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a0420e-4689-47cc-80eb-7940afd47ba1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:51.705055 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a0420e-4689-47cc-80eb-7940afd47ba1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:51.706701 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a0420e-4689-47cc-80eb-7940afd47ba1 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:51.719738 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1093/2186] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:56:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:56:51.729408 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba507cda-430c-4d1c-8a3b-98266d9af9c9 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:51.741046 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba507cda-430c-4d1c-8a3b-98266d9af9c9 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:51.746233 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdff5ab-612b-47e6-9442-b61e9808e744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:51.746990 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdff5ab-612b-47e6-9442-b61e9808e744 admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:51.747345 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdff5ab-612b-47e6-9442-b61e9808e744 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:51.747718 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdff5ab-612b-47e6-9442-b61e9808e744 admin admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:51.748558 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdff5ab-612b-47e6-9442-b61e9808e744 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:51.750263 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdff5ab-612b-47e6-9442-b61e9808e744 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:51.766915 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1094/2187] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:56:51 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:56:51.771641 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a0420e-4689-47cc-80eb-7940afd47ba1 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:51.785301 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a0420e-4689-47cc-80eb-7940afd47ba1 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:51.794528 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81204caa-bd3a-4331-b79b-d83f3662ae40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:51.795610 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81204caa-bd3a-4331-b79b-d83f3662ae40 admin admin] REQUEST_METHOD: `PUT` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:51.795941 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81204caa-bd3a-4331-b79b-d83f3662ae40 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:51.796285 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81204caa-bd3a-4331-b79b-d83f3662ae40 admin admin] PATH_INFO: `/v3/projects/988a8b34db124fa2a3e57ace8048b4ab/users/777bd98166b74354981a7cc6a2a51511/roles/95d753870f97426cb1ce32e078621a4c` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:51.801978 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:56:51.821758 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81204caa-bd3a-4331-b79b-d83f3662ae40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=988a8b34db124fa2a3e57ace8048b4ab, user_id=777bd98166b74354981a7cc6a2a51511, role_id=95d753870f97426cb1ce32e078621a4c)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:51.824893 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81204caa-bd3a-4331-b79b-d83f3662ae40 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:51.840301 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1094/2188] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 17:56:51 2022] PUT /identity/v3/projects/988a8b34db124fa2a3e57ace8048b4ab/users/777bd98166b74354981a7cc6a2a51511/roles/95d753870f97426cb1ce32e078621a4c => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 17:56:51.852934 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ccb48-5736-4a6b-bd09-0e3ed37f41e9 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:51.853622 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ccb48-5736-4a6b-bd09-0e3ed37f41e9 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:51.853993 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ccb48-5736-4a6b-bd09-0e3ed37f41e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:51.886025 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-4d2ccb48-5736-4a6b-bd09-0e3ed37f41e9 None None] MFA Rules not processed for user `777bd98166b74354981a7cc6a2a51511`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:56:51.887430 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-4d2ccb48-5736-4a6b-bd09-0e3ed37f41e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:51.959264 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1095/2189] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:56:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 17:56:58.934684 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81204caa-bd3a-4331-b79b-d83f3662ae40 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:58.936763 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-81204caa-bd3a-4331-b79b-d83f3662ae40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:59.041387 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81204caa-bd3a-4331-b79b-d83f3662ae40 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:59.046816 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba66b8c-e446-4f7f-ab14-a0d7023deb31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:59.047963 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba66b8c-e446-4f7f-ab14-a0d7023deb31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:59.048243 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba66b8c-e446-4f7f-ab14-a0d7023deb31 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:59.048591 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba66b8c-e446-4f7f-ab14-a0d7023deb31 admin admin] PATH_INFO: `/v3/users/df425f920c05492fbd35e71b1d8d9a30` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:59.050288 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba66b8c-e446-4f7f-ab14-a0d7023deb31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df425f920c05492fbd35e71b1d8d9a30)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:59.059312 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba66b8c-e446-4f7f-ab14-a0d7023deb31 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:59.138625 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-7ba66b8c-e446-4f7f-ab14-a0d7023deb31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df425f920c05492fbd35e71b1d8d9a30'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:59.147825 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-7ba66b8c-e446-4f7f-ab14-a0d7023deb31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df425f920c05492fbd35e71b1d8d9a30'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:59.157189 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-7ba66b8c-e446-4f7f-ab14-a0d7023deb31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df425f920c05492fbd35e71b1d8d9a30'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:59.158052 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-7ba66b8c-e446-4f7f-ab14-a0d7023deb31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df425f920c05492fbd35e71b1d8d9a30'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:59.174130 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-7ba66b8c-e446-4f7f-ab14-a0d7023deb31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df425f920c05492fbd35e71b1d8d9a30'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:59.185934 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1095/2190] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 14 17:56:58 2022] DELETE /identity/v3/users/df425f920c05492fbd35e71b1d8d9a30 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:56:59.190666 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f2f6b-76be-460c-868d-54d891d571e4 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:59.191307 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f2f6b-76be-460c-868d-54d891d571e4 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:59.191307 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f2f6b-76be-460c-868d-54d891d571e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:59.217521 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-956f2f6b-76be-460c-868d-54d891d571e4 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:56:59.223231 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-956f2f6b-76be-460c-868d-54d891d571e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:59.289731 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1096/2191] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:56:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:56:59.299910 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba66b8c-e446-4f7f-ab14-a0d7023deb31 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:59.301760 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-7ba66b8c-e446-4f7f-ab14-a0d7023deb31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:59.360346 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba66b8c-e446-4f7f-ab14-a0d7023deb31 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:59.364092 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143abb8a-a164-4c54-b487-22de07680348 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:59.364739 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143abb8a-a164-4c54-b487-22de07680348 service neutron] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:59.365029 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143abb8a-a164-4c54-b487-22de07680348 service neutron] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:59.365308 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143abb8a-a164-4c54-b487-22de07680348 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:59.374463 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143abb8a-a164-4c54-b487-22de07680348 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:59.375888 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143abb8a-a164-4c54-b487-22de07680348 service neutron] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:59.385407 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1096/2192] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:56:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:56:59.666955 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956f2f6b-76be-460c-868d-54d891d571e4 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:59.668410 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-956f2f6b-76be-460c-868d-54d891d571e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:56:59.688143 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956f2f6b-76be-460c-868d-54d891d571e4 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:59.693474 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470b70c9-06c2-4eff-bf9c-09f8c78ec979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:59.694562 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b70c9-06c2-4eff-bf9c-09f8c78ec979 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:59.694907 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b70c9-06c2-4eff-bf9c-09f8c78ec979 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:59.695297 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b70c9-06c2-4eff-bf9c-09f8c78ec979 admin admin] PATH_INFO: `/v3/projects/718aa28c01c646bea346388fcce3775c` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:59.696657 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470b70c9-06c2-4eff-bf9c-09f8c78ec979 admin admin] RBAC: Authorizing `identity:delete_project(project_id=718aa28c01c646bea346388fcce3775c)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:59.698631 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470b70c9-06c2-4eff-bf9c-09f8c78ec979 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:59.747670 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-470b70c9-06c2-4eff-bf9c-09f8c78ec979 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '718aa28c01c646bea346388fcce3775c', 'request_id': 'req-470b70c9-06c2-4eff-bf9c-09f8c78ec979'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:59.756531 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-470b70c9-06c2-4eff-bf9c-09f8c78ec979 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '718aa28c01c646bea346388fcce3775c', 'request_id': 'req-470b70c9-06c2-4eff-bf9c-09f8c78ec979'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:59.762652 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-470b70c9-06c2-4eff-bf9c-09f8c78ec979 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '718aa28c01c646bea346388fcce3775c', 'request_id': 'req-470b70c9-06c2-4eff-bf9c-09f8c78ec979'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:59.766036 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:INSERT=3,keystone:SELECT=91,keystone:DELETE=6 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:56:59.778143 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-470b70c9-06c2-4eff-bf9c-09f8c78ec979 admin admin] The token cache is being invalidate because project 718aa28c01c646bea346388fcce3775c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86773) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 17:56:59.778436 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-470b70c9-06c2-4eff-bf9c-09f8c78ec979 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:59.779079 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-470b70c9-06c2-4eff-bf9c-09f8c78ec979 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:59.780664 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1097/2193] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 14 17:56:59 2022] DELETE /identity/v3/projects/718aa28c01c646bea346388fcce3775c => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:56:59.785286 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143abb8a-a164-4c54-b487-22de07680348 service neutron] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:56:59.791560 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:56:59.795519 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143abb8a-a164-4c54-b487-22de07680348 service neutron] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:56:59.860304 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac896bf-1cd4-4d0b-8654-186a34fed740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:56:59.861178 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac896bf-1cd4-4d0b-8654-186a34fed740 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:56:59.861458 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac896bf-1cd4-4d0b-8654-186a34fed740 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:56:59.861774 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac896bf-1cd4-4d0b-8654-186a34fed740 admin admin] PATH_INFO: `/v3/users/1f0176e509ca4754a9e9b0bc7f1c90e3` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:56:59.863003 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac896bf-1cd4-4d0b-8654-186a34fed740 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f0176e509ca4754a9e9b0bc7f1c90e3)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:56:59.864936 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac896bf-1cd4-4d0b-8654-186a34fed740 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:56:59.916030 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-2ac896bf-1cd4-4d0b-8654-186a34fed740 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f0176e509ca4754a9e9b0bc7f1c90e3'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:59.923641 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-2ac896bf-1cd4-4d0b-8654-186a34fed740 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f0176e509ca4754a9e9b0bc7f1c90e3'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:59.931293 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-2ac896bf-1cd4-4d0b-8654-186a34fed740 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f0176e509ca4754a9e9b0bc7f1c90e3'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:59.931916 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-2ac896bf-1cd4-4d0b-8654-186a34fed740 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f0176e509ca4754a9e9b0bc7f1c90e3'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:59.943938 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-2ac896bf-1cd4-4d0b-8654-186a34fed740 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f0176e509ca4754a9e9b0bc7f1c90e3'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:56:59.950486 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1097/2194] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 14 17:56:59 2022] DELETE /identity/v3/users/1f0176e509ca4754a9e9b0bc7f1c90e3 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:57:00.238782 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470b70c9-06c2-4eff-bf9c-09f8c78ec979 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:00.240923 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-470b70c9-06c2-4eff-bf9c-09f8c78ec979 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:57:00.261108 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470b70c9-06c2-4eff-bf9c-09f8c78ec979 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:00.353651 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8032dbb9-4e27-4629-9a16-a2aa3b015509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:00.354453 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8032dbb9-4e27-4629-9a16-a2aa3b015509 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:00.354737 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8032dbb9-4e27-4629-9a16-a2aa3b015509 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:00.355017 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8032dbb9-4e27-4629-9a16-a2aa3b015509 admin admin] PATH_INFO: `/v3/projects/82fb6b410bca4332907199b14d41d024` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:00.356234 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8032dbb9-4e27-4629-9a16-a2aa3b015509 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82fb6b410bca4332907199b14d41d024)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:00.358268 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8032dbb9-4e27-4629-9a16-a2aa3b015509 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:00.428199 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-8032dbb9-4e27-4629-9a16-a2aa3b015509 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82fb6b410bca4332907199b14d41d024', 'request_id': 'req-8032dbb9-4e27-4629-9a16-a2aa3b015509'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:00.436770 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-8032dbb9-4e27-4629-9a16-a2aa3b015509 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82fb6b410bca4332907199b14d41d024', 'request_id': 'req-8032dbb9-4e27-4629-9a16-a2aa3b015509'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:00.442977 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-8032dbb9-4e27-4629-9a16-a2aa3b015509 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82fb6b410bca4332907199b14d41d024', 'request_id': 'req-8032dbb9-4e27-4629-9a16-a2aa3b015509'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:00.468853 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-8032dbb9-4e27-4629-9a16-a2aa3b015509 admin admin] The token cache is being invalidate because project 82fb6b410bca4332907199b14d41d024 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86773) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 17:57:00.469152 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-8032dbb9-4e27-4629-9a16-a2aa3b015509 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:00.469866 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-8032dbb9-4e27-4629-9a16-a2aa3b015509 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:00.471465 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1098/2195] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 14 17:57:00 2022] DELETE /identity/v3/projects/82fb6b410bca4332907199b14d41d024 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:57:00.476224 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87709c77-6fba-461d-a669-b3fbcee2b523 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:00.476515 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87709c77-6fba-461d-a669-b3fbcee2b523 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:00.476828 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87709c77-6fba-461d-a669-b3fbcee2b523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:00.495706 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-87709c77-6fba-461d-a669-b3fbcee2b523 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:57:00.496990 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-87709c77-6fba-461d-a669-b3fbcee2b523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:57:00.561593 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1098/2196] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:57:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:57:00.569413 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c59b79a-2760-40a0-ab40-9ab662c9d8c0 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:00.569735 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c59b79a-2760-40a0-ab40-9ab662c9d8c0 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:00.570244 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c59b79a-2760-40a0-ab40-9ab662c9d8c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:00.588696 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-0c59b79a-2760-40a0-ab40-9ab662c9d8c0 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:57:00.589921 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-0c59b79a-2760-40a0-ab40-9ab662c9d8c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:57:00.597730 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1099/2197] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:57:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:57:00.602016 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87709c77-6fba-461d-a669-b3fbcee2b523 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:00.612687 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87709c77-6fba-461d-a669-b3fbcee2b523 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:00.617408 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4903538-801c-4b6e-afcf-a85d9b2d40d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:00.618107 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4903538-801c-4b6e-afcf-a85d9b2d40d9 admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:00.618391 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4903538-801c-4b6e-afcf-a85d9b2d40d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:00.618796 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4903538-801c-4b6e-afcf-a85d9b2d40d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:00.619530 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4903538-801c-4b6e-afcf-a85d9b2d40d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:57:00.619835 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4903538-801c-4b6e-afcf-a85d9b2d40d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:00.621516 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4903538-801c-4b6e-afcf-a85d9b2d40d9 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:00.634555 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1099/2198] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 14 17:57:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:57:00.640953 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c59b79a-2760-40a0-ab40-9ab662c9d8c0 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:00.650785 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c59b79a-2760-40a0-ab40-9ab662c9d8c0 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:00.655562 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1439a7c-a527-4202-80af-62f0470bb966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:00.656230 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1439a7c-a527-4202-80af-62f0470bb966 admin admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:00.656515 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1439a7c-a527-4202-80af-62f0470bb966 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:00.656792 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1439a7c-a527-4202-80af-62f0470bb966 admin admin] PATH_INFO: `/v3/projects` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:00.657495 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1439a7c-a527-4202-80af-62f0470bb966 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:00.659424 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1439a7c-a527-4202-80af-62f0470bb966 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:00.687283 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1100/2199] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 14 17:57:00 2022] POST /identity/v3/projects => generated 365 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 17:57:00.691449 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4903538-801c-4b6e-afcf-a85d9b2d40d9 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:00.702091 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4903538-801c-4b6e-afcf-a85d9b2d40d9 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:00.710056 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:57:00.762175 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f53b4f-cd4b-4a4a-8dcd-cc717219123d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:00.762857 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f53b4f-cd4b-4a4a-8dcd-cc717219123d admin admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:00.763142 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f53b4f-cd4b-4a4a-8dcd-cc717219123d admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:00.763423 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f53b4f-cd4b-4a4a-8dcd-cc717219123d admin admin] PATH_INFO: `/v3/users` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:00.764625 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f53b4f-cd4b-4a4a-8dcd-cc717219123d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:00.766608 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f53b4f-cd4b-4a4a-8dcd-cc717219123d admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:00.789967 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1100/2200] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 14 17:57:00 2022] POST /identity/v3/users => generated 283 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:57:00.793956 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1439a7c-a527-4202-80af-62f0470bb966 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:00.804551 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1439a7c-a527-4202-80af-62f0470bb966 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:00.813363 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe67a073-23bb-472e-b5cc-7c5d50d0cd64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:00.814667 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe67a073-23bb-472e-b5cc-7c5d50d0cd64 admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:00.816864 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe67a073-23bb-472e-b5cc-7c5d50d0cd64 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:00.816864 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe67a073-23bb-472e-b5cc-7c5d50d0cd64 admin admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:00.817363 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe67a073-23bb-472e-b5cc-7c5d50d0cd64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:00.820771 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe67a073-23bb-472e-b5cc-7c5d50d0cd64 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:00.840748 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1101/2201] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:57:00 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:57:00.846695 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f53b4f-cd4b-4a4a-8dcd-cc717219123d admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:00.865257 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f53b4f-cd4b-4a4a-8dcd-cc717219123d admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:00.870009 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aefbde-e946-4bbf-82c4-a0db6ab2de61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:00.870689 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aefbde-e946-4bbf-82c4-a0db6ab2de61 admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:00.870977 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aefbde-e946-4bbf-82c4-a0db6ab2de61 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:00.871292 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aefbde-e946-4bbf-82c4-a0db6ab2de61 admin admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:00.872064 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aefbde-e946-4bbf-82c4-a0db6ab2de61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:00.874244 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aefbde-e946-4bbf-82c4-a0db6ab2de61 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:00.887346 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1101/2202] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:57:00 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:57:00.889488 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe67a073-23bb-472e-b5cc-7c5d50d0cd64 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:00.900463 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe67a073-23bb-472e-b5cc-7c5d50d0cd64 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:00.905588 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69484bc0-a4fd-4e08-97b0-137fca04bbcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:00.906504 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69484bc0-a4fd-4e08-97b0-137fca04bbcd admin admin] REQUEST_METHOD: `PUT` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:00.906786 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69484bc0-a4fd-4e08-97b0-137fca04bbcd admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:00.907060 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69484bc0-a4fd-4e08-97b0-137fca04bbcd admin admin] PATH_INFO: `/v3/projects/5bda0ba37e814073b3687e391e9bcef8/users/e6e44d42d25a48058477311258767542/roles/95d753870f97426cb1ce32e078621a4c` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:00.923831 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69484bc0-a4fd-4e08-97b0-137fca04bbcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bda0ba37e814073b3687e391e9bcef8, user_id=e6e44d42d25a48058477311258767542, role_id=95d753870f97426cb1ce32e078621a4c)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:00.926732 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69484bc0-a4fd-4e08-97b0-137fca04bbcd admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:00.941309 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1102/2203] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 17:57:00 2022] PUT /identity/v3/projects/5bda0ba37e814073b3687e391e9bcef8/users/e6e44d42d25a48058477311258767542/roles/95d753870f97426cb1ce32e078621a4c => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:57:00.952183 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58f0c0c-426f-499d-aa70-4798e47180d4 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:00.952750 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58f0c0c-426f-499d-aa70-4798e47180d4 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:00.952750 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58f0c0c-426f-499d-aa70-4798e47180d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:00.979166 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-b58f0c0c-426f-499d-aa70-4798e47180d4 None None] MFA Rules not processed for user `e6e44d42d25a48058477311258767542`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:57:00.980432 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-b58f0c0c-426f-499d-aa70-4798e47180d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:57:01.049964 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1102/2204] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:57:00 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:57:01.054466 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69484bc0-a4fd-4e08-97b0-137fca04bbcd admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:01.078531 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:57:01.123218 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69484bc0-a4fd-4e08-97b0-137fca04bbcd admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:01.128364 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b42c657-9a3c-4803-aac5-5ce76fb25331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:01.129226 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b42c657-9a3c-4803-aac5-5ce76fb25331 admin admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:01.129515 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b42c657-9a3c-4803-aac5-5ce76fb25331 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:01.129816 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b42c657-9a3c-4803-aac5-5ce76fb25331 admin admin] PATH_INFO: `/v3/projects` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:01.130615 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b42c657-9a3c-4803-aac5-5ce76fb25331 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:01.132796 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b42c657-9a3c-4803-aac5-5ce76fb25331 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:01.160417 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1103/2205] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 14 17:57:01 2022] POST /identity/v3/projects => generated 359 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:57:01.164316 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58f0c0c-426f-499d-aa70-4798e47180d4 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:01.175373 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58f0c0c-426f-499d-aa70-4798e47180d4 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:01.232269 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fae6f6-68e7-4ae9-a1d2-2d3ba3c39bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:01.233573 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fae6f6-68e7-4ae9-a1d2-2d3ba3c39bd1 admin admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:01.233861 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fae6f6-68e7-4ae9-a1d2-2d3ba3c39bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:01.234140 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fae6f6-68e7-4ae9-a1d2-2d3ba3c39bd1 admin admin] PATH_INFO: `/v3/users` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:01.234840 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fae6f6-68e7-4ae9-a1d2-2d3ba3c39bd1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:01.236759 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fae6f6-68e7-4ae9-a1d2-2d3ba3c39bd1 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:01.255671 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1103/2206] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 14 17:57:01 2022] POST /identity/v3/users => generated 286 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:57:01.259840 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b42c657-9a3c-4803-aac5-5ce76fb25331 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:01.270125 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b42c657-9a3c-4803-aac5-5ce76fb25331 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:01.274717 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eb9e8e-63d6-4802-a7d1-ed812cd1d583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:01.275367 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb9e8e-63d6-4802-a7d1-ed812cd1d583 admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:01.275647 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb9e8e-63d6-4802-a7d1-ed812cd1d583 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:01.275922 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb9e8e-63d6-4802-a7d1-ed812cd1d583 admin admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:01.276647 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eb9e8e-63d6-4802-a7d1-ed812cd1d583 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:01.278285 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eb9e8e-63d6-4802-a7d1-ed812cd1d583 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:01.292914 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1104/2207] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:57:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:57:01.297073 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fae6f6-68e7-4ae9-a1d2-2d3ba3c39bd1 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:01.307601 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fae6f6-68e7-4ae9-a1d2-2d3ba3c39bd1 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:01.312679 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25e9fe8-c2cf-47b1-ac3c-dbe463d80a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:01.313618 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e9fe8-c2cf-47b1-ac3c-dbe463d80a3c admin admin] REQUEST_METHOD: `PUT` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:01.313912 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e9fe8-c2cf-47b1-ac3c-dbe463d80a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:01.314205 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e9fe8-c2cf-47b1-ac3c-dbe463d80a3c admin admin] PATH_INFO: `/v3/projects/08238351451247adaa3d7397fa7aab59/users/2ddaaa41e0a14b79a964806c5ea8e4fc/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:01.317781 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:57:01.331797 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25e9fe8-c2cf-47b1-ac3c-dbe463d80a3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=08238351451247adaa3d7397fa7aab59, user_id=2ddaaa41e0a14b79a964806c5ea8e4fc, role_id=4651a1cc7b4d4ab7a7a9ca1e77e58e71)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:01.334329 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25e9fe8-c2cf-47b1-ac3c-dbe463d80a3c admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:01.353556 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1104/2208] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 17:57:01 2022] PUT /identity/v3/projects/08238351451247adaa3d7397fa7aab59/users/2ddaaa41e0a14b79a964806c5ea8e4fc/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:57:01.353806 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eb9e8e-63d6-4802-a7d1-ed812cd1d583 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:01.366768 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eb9e8e-63d6-4802-a7d1-ed812cd1d583 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:01.424102 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc877782-7c6f-44f7-8d43-00a7b95a073f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:01.424693 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc877782-7c6f-44f7-8d43-00a7b95a073f admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:01.424977 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc877782-7c6f-44f7-8d43-00a7b95a073f admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:01.425259 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc877782-7c6f-44f7-8d43-00a7b95a073f admin admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:01.426020 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc877782-7c6f-44f7-8d43-00a7b95a073f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:01.427624 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc877782-7c6f-44f7-8d43-00a7b95a073f admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:01.437691 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1105/2209] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:57:01 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:57:01.441886 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25e9fe8-c2cf-47b1-ac3c-dbe463d80a3c admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:01.452704 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25e9fe8-c2cf-47b1-ac3c-dbe463d80a3c admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:01.457332 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1316720b-30ce-4707-9cbc-baad1a1a797d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:01.458257 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1316720b-30ce-4707-9cbc-baad1a1a797d admin admin] REQUEST_METHOD: `PUT` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:01.458545 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1316720b-30ce-4707-9cbc-baad1a1a797d admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:01.458824 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1316720b-30ce-4707-9cbc-baad1a1a797d admin admin] PATH_INFO: `/v3/projects/08238351451247adaa3d7397fa7aab59/users/2ddaaa41e0a14b79a964806c5ea8e4fc/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:01.460796 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1316720b-30ce-4707-9cbc-baad1a1a797d admin admin] RBAC: Authorizing `identity:create_grant(project_id=08238351451247adaa3d7397fa7aab59, user_id=2ddaaa41e0a14b79a964806c5ea8e4fc, role_id=4651a1cc7b4d4ab7a7a9ca1e77e58e71)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:01.463455 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1316720b-30ce-4707-9cbc-baad1a1a797d admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:01.475044 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1105/2210] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 17:57:01 2022] PUT /identity/v3/projects/08238351451247adaa3d7397fa7aab59/users/2ddaaa41e0a14b79a964806c5ea8e4fc/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:57:01.485622 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa70b7d-13ca-4b10-ba49-4700ba0b8aca None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:01.485896 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa70b7d-13ca-4b10-ba49-4700ba0b8aca None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:01.486177 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa70b7d-13ca-4b10-ba49-4700ba0b8aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:01.520573 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-2aa70b7d-13ca-4b10-ba49-4700ba0b8aca None None] MFA Rules not processed for user `2ddaaa41e0a14b79a964806c5ea8e4fc`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:57:01.521831 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-2aa70b7d-13ca-4b10-ba49-4700ba0b8aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:57:01.611728 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1106/2211] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:57:01 2022] POST /identity/v3/auth/tokens => generated 3293 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:57:01.628305 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1316720b-30ce-4707-9cbc-baad1a1a797d admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:01.630220 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-1316720b-30ce-4707-9cbc-baad1a1a797d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:57:01.697624 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1316720b-30ce-4707-9cbc-baad1a1a797d admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:01.701295 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c569fd5-5c11-4868-82a5-a6d7396e2ad0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de55cae1600841889668e36402861203', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:01.701982 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c569fd5-5c11-4868-82a5-a6d7396e2ad0 service cinder] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:01.702269 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c569fd5-5c11-4868-82a5-a6d7396e2ad0 service cinder] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:01.702546 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c569fd5-5c11-4868-82a5-a6d7396e2ad0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:01.713034 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c569fd5-5c11-4868-82a5-a6d7396e2ad0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:01.714528 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c569fd5-5c11-4868-82a5-a6d7396e2ad0 service cinder] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:01.724883 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1106/2212] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:57:01 2022] GET /identity/v3/auth/tokens => generated 3293 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:57:01.819023 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa70b7d-13ca-4b10-ba49-4700ba0b8aca None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:01.829065 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa70b7d-13ca-4b10-ba49-4700ba0b8aca None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:01.832892 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5d2348-7d77-4e11-b2ec-02f4cbef12fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de55cae1600841889668e36402861203', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:01.833583 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d2348-7d77-4e11-b2ec-02f4cbef12fc service cinder] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:01.833871 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d2348-7d77-4e11-b2ec-02f4cbef12fc service cinder] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:01.834150 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d2348-7d77-4e11-b2ec-02f4cbef12fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:01.853594 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:57:01.907580 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5d2348-7d77-4e11-b2ec-02f4cbef12fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:01.909066 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5d2348-7d77-4e11-b2ec-02f4cbef12fc service cinder] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:01.919297 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1107/2213] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:57:01 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:57:04.740736 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c569fd5-5c11-4868-82a5-a6d7396e2ad0 service cinder] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:04.809990 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c569fd5-5c11-4868-82a5-a6d7396e2ad0 service cinder] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:04.811900 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5d2348-7d77-4e11-b2ec-02f4cbef12fc service cinder] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:04.817821 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-0f5d2348-7d77-4e11-b2ec-02f4cbef12fc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:57:04.830121 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9136b68d-05c1-4fb8-a860-8bbfbd7012d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:04.831797 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9136b68d-05c1-4fb8-a860-8bbfbd7012d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:04.832346 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9136b68d-05c1-4fb8-a860-8bbfbd7012d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:04.833035 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9136b68d-05c1-4fb8-a860-8bbfbd7012d3 admin admin] PATH_INFO: `/v3/users/e6e44d42d25a48058477311258767542` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:04.834664 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9136b68d-05c1-4fb8-a860-8bbfbd7012d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6e44d42d25a48058477311258767542)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:04.836846 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9136b68d-05c1-4fb8-a860-8bbfbd7012d3 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:04.902872 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-9136b68d-05c1-4fb8-a860-8bbfbd7012d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6e44d42d25a48058477311258767542'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:04.912834 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-9136b68d-05c1-4fb8-a860-8bbfbd7012d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6e44d42d25a48058477311258767542'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:04.925128 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-9136b68d-05c1-4fb8-a860-8bbfbd7012d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6e44d42d25a48058477311258767542'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:04.926122 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-9136b68d-05c1-4fb8-a860-8bbfbd7012d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6e44d42d25a48058477311258767542'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:04.931648 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5d2348-7d77-4e11-b2ec-02f4cbef12fc service cinder] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:04.935673 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8a7a11-1975-4f30-802c-b28f33a93303 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eb7180aab4541b4aab6cf8648eac1f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:04.936327 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a7a11-1975-4f30-802c-b28f33a93303 service glance] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:04.936610 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a7a11-1975-4f30-802c-b28f33a93303 service glance] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:04.936909 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a7a11-1975-4f30-802c-b28f33a93303 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:04.938133 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:57:04.939041 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-bf8a7a11-1975-4f30-802c-b28f33a93303 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:57:04.940673 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-9136b68d-05c1-4fb8-a860-8bbfbd7012d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6e44d42d25a48058477311258767542'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:04.950067 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1107/2214] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 14 17:57:04 2022] DELETE /identity/v3/users/e6e44d42d25a48058477311258767542 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:57:04.954577 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4094d0bf-0224-4706-b0d9-57bfa5af87f6 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:04.954863 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4094d0bf-0224-4706-b0d9-57bfa5af87f6 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:04.955142 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4094d0bf-0224-4706-b0d9-57bfa5af87f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:04.980957 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-4094d0bf-0224-4706-b0d9-57bfa5af87f6 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:57:04.983349 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-4094d0bf-0224-4706-b0d9-57bfa5af87f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:57:05.018519 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8a7a11-1975-4f30-802c-b28f33a93303 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:05.019983 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8a7a11-1975-4f30-802c-b28f33a93303 service glance] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:05.036232 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1108/2215] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:57:04 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 17:57:05.085298 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1108/2216] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:57:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 17:57:05.094323 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8a7a11-1975-4f30-802c-b28f33a93303 service glance] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:05.096350 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-bf8a7a11-1975-4f30-802c-b28f33a93303 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:57:05.185672 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:57:05.193182 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8a7a11-1975-4f30-802c-b28f33a93303 service glance] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:05.272898 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366d7818-79e8-4b12-b723-aac791a6c182 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:05.274051 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d7818-79e8-4b12-b723-aac791a6c182 service neutron] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:05.274936 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d7818-79e8-4b12-b723-aac791a6c182 service neutron] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:05.275069 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d7818-79e8-4b12-b723-aac791a6c182 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:05.300333 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366d7818-79e8-4b12-b723-aac791a6c182 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:05.302005 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366d7818-79e8-4b12-b723-aac791a6c182 service neutron] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:05.314077 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1109/2217] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:57:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:57:05.691045 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4094d0bf-0224-4706-b0d9-57bfa5af87f6 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:05.692881 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-4094d0bf-0224-4706-b0d9-57bfa5af87f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:57:05.709220 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4094d0bf-0224-4706-b0d9-57bfa5af87f6 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:05.714467 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e68fc7-72d4-4f98-b5c2-bf654d028409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:05.715348 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e68fc7-72d4-4f98-b5c2-bf654d028409 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:05.715623 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e68fc7-72d4-4f98-b5c2-bf654d028409 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:05.715898 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e68fc7-72d4-4f98-b5c2-bf654d028409 admin admin] PATH_INFO: `/v3/projects/5bda0ba37e814073b3687e391e9bcef8` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:05.717134 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e68fc7-72d4-4f98-b5c2-bf654d028409 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bda0ba37e814073b3687e391e9bcef8)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:05.724623 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e68fc7-72d4-4f98-b5c2-bf654d028409 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:05.777474 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-42e68fc7-72d4-4f98-b5c2-bf654d028409 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bda0ba37e814073b3687e391e9bcef8', 'request_id': 'req-42e68fc7-72d4-4f98-b5c2-bf654d028409'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:05.783817 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-42e68fc7-72d4-4f98-b5c2-bf654d028409 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bda0ba37e814073b3687e391e9bcef8', 'request_id': 'req-42e68fc7-72d4-4f98-b5c2-bf654d028409'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:05.791626 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-42e68fc7-72d4-4f98-b5c2-bf654d028409 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bda0ba37e814073b3687e391e9bcef8', 'request_id': 'req-42e68fc7-72d4-4f98-b5c2-bf654d028409'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:05.803430 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-42e68fc7-72d4-4f98-b5c2-bf654d028409 admin admin] The token cache is being invalidate because project 5bda0ba37e814073b3687e391e9bcef8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86772) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 17:57:05.803715 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-42e68fc7-72d4-4f98-b5c2-bf654d028409 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:05.804387 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-42e68fc7-72d4-4f98-b5c2-bf654d028409 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:05.806214 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1109/2218] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 14 17:57:05 2022] DELETE /identity/v3/projects/5bda0ba37e814073b3687e391e9bcef8 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:57:05.810302 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366d7818-79e8-4b12-b723-aac791a6c182 service neutron] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:05.820950 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366d7818-79e8-4b12-b723-aac791a6c182 service neutron] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:05.881196 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a8e5d0-4c14-4056-860c-577155d3a7df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:05.882130 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8e5d0-4c14-4056-860c-577155d3a7df admin admin] REQUEST_METHOD: `DELETE` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:05.882413 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8e5d0-4c14-4056-860c-577155d3a7df admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:05.882694 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8e5d0-4c14-4056-860c-577155d3a7df admin admin] PATH_INFO: `/v3/users/2ddaaa41e0a14b79a964806c5ea8e4fc` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:05.883941 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a8e5d0-4c14-4056-860c-577155d3a7df admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ddaaa41e0a14b79a964806c5ea8e4fc)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:05.885955 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a8e5d0-4c14-4056-860c-577155d3a7df admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:05.955926 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-43a8e5d0-4c14-4056-860c-577155d3a7df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ddaaa41e0a14b79a964806c5ea8e4fc'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:05.963800 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-43a8e5d0-4c14-4056-860c-577155d3a7df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ddaaa41e0a14b79a964806c5ea8e4fc'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:05.978672 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-43a8e5d0-4c14-4056-860c-577155d3a7df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ddaaa41e0a14b79a964806c5ea8e4fc'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:05.980024 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-43a8e5d0-4c14-4056-860c-577155d3a7df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ddaaa41e0a14b79a964806c5ea8e4fc'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:05.980707 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-43a8e5d0-4c14-4056-860c-577155d3a7df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ddaaa41e0a14b79a964806c5ea8e4fc'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:05.994139 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1110/2219] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 14 17:57:05 2022] DELETE /identity/v3/users/2ddaaa41e0a14b79a964806c5ea8e4fc => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:57:06.315767 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e68fc7-72d4-4f98-b5c2-bf654d028409 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:06.317359 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-42e68fc7-72d4-4f98-b5c2-bf654d028409 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:57:06.336787 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e68fc7-72d4-4f98-b5c2-bf654d028409 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:06.407012 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad6a213-cf01-4733-8437-f0ce8ba646f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:06.407894 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad6a213-cf01-4733-8437-f0ce8ba646f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:06.408175 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad6a213-cf01-4733-8437-f0ce8ba646f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:06.408451 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad6a213-cf01-4733-8437-f0ce8ba646f7 admin admin] PATH_INFO: `/v3/projects/08238351451247adaa3d7397fa7aab59` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:06.409721 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad6a213-cf01-4733-8437-f0ce8ba646f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08238351451247adaa3d7397fa7aab59)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:06.411676 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad6a213-cf01-4733-8437-f0ce8ba646f7 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:06.438107 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:57:06.466776 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-6ad6a213-cf01-4733-8437-f0ce8ba646f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08238351451247adaa3d7397fa7aab59', 'request_id': 'req-6ad6a213-cf01-4733-8437-f0ce8ba646f7'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:06.474120 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-6ad6a213-cf01-4733-8437-f0ce8ba646f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08238351451247adaa3d7397fa7aab59', 'request_id': 'req-6ad6a213-cf01-4733-8437-f0ce8ba646f7'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:06.489552 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-6ad6a213-cf01-4733-8437-f0ce8ba646f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08238351451247adaa3d7397fa7aab59', 'request_id': 'req-6ad6a213-cf01-4733-8437-f0ce8ba646f7'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:06.501347 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-6ad6a213-cf01-4733-8437-f0ce8ba646f7 admin admin] The token cache is being invalidate because project 08238351451247adaa3d7397fa7aab59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86772) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 17:57:06.501665 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-6ad6a213-cf01-4733-8437-f0ce8ba646f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:06.502386 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-6ad6a213-cf01-4733-8437-f0ce8ba646f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:06.503908 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1110/2220] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 14 17:57:06 2022] DELETE /identity/v3/projects/08238351451247adaa3d7397fa7aab59 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:57:06.508844 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef28e671-1cfd-4cdd-a8f6-0f20407f5e38 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:06.509130 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef28e671-1cfd-4cdd-a8f6-0f20407f5e38 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:06.509434 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef28e671-1cfd-4cdd-a8f6-0f20407f5e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:06.526679 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-ef28e671-1cfd-4cdd-a8f6-0f20407f5e38 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:57:06.527876 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-ef28e671-1cfd-4cdd-a8f6-0f20407f5e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:57:06.550854 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:57:06.592252 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1111/2221] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:57:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:57:06.602039 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55357c52-2479-4f30-83c3-35281881642a None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:06.602354 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55357c52-2479-4f30-83c3-35281881642a None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:06.602634 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55357c52-2479-4f30-83c3-35281881642a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:06.622773 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-55357c52-2479-4f30-83c3-35281881642a None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:57:06.624020 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-55357c52-2479-4f30-83c3-35281881642a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:57:06.633346 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1111/2222] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:57:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:57:06.639141 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef28e671-1cfd-4cdd-a8f6-0f20407f5e38 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:06.649251 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef28e671-1cfd-4cdd-a8f6-0f20407f5e38 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:06.654640 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd44a65-6f0b-4fcf-9b5b-ac358d24291b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:06.655321 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd44a65-6f0b-4fcf-9b5b-ac358d24291b admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:06.655605 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd44a65-6f0b-4fcf-9b5b-ac358d24291b admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:06.656011 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd44a65-6f0b-4fcf-9b5b-ac358d24291b admin admin] PATH_INFO: `/v3/domains` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:06.657216 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd44a65-6f0b-4fcf-9b5b-ac358d24291b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:57:06.657560 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd44a65-6f0b-4fcf-9b5b-ac358d24291b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:06.659366 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd44a65-6f0b-4fcf-9b5b-ac358d24291b admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:06.672247 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1112/2223] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 14 17:57:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:57:06.679439 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55357c52-2479-4f30-83c3-35281881642a None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:06.689796 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55357c52-2479-4f30-83c3-35281881642a None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:06.695444 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c69823-d7f5-41fd-8694-6298fda376cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:06.696136 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c69823-d7f5-41fd-8694-6298fda376cf admin admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:06.696420 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c69823-d7f5-41fd-8694-6298fda376cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:06.696697 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c69823-d7f5-41fd-8694-6298fda376cf admin admin] PATH_INFO: `/v3/projects` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:06.697398 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c69823-d7f5-41fd-8694-6298fda376cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:06.699332 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c69823-d7f5-41fd-8694-6298fda376cf admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:06.734432 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1112/2224] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 14 17:57:06 2022] POST /identity/v3/projects => generated 387 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:57:06.738566 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd44a65-6f0b-4fcf-9b5b-ac358d24291b admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:06.749054 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd44a65-6f0b-4fcf-9b5b-ac358d24291b admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:06.811812 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6273130-37cb-46d2-909a-15f0d851f464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:06.812429 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6273130-37cb-46d2-909a-15f0d851f464 admin admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:06.812710 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6273130-37cb-46d2-909a-15f0d851f464 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:06.812983 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6273130-37cb-46d2-909a-15f0d851f464 admin admin] PATH_INFO: `/v3/users` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:06.813712 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6273130-37cb-46d2-909a-15f0d851f464 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:06.815939 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6273130-37cb-46d2-909a-15f0d851f464 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:06.840778 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1113/2225] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 14 17:57:06 2022] POST /identity/v3/users => generated 294 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 17:57:06.845993 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c69823-d7f5-41fd-8694-6298fda376cf admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:06.861551 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c69823-d7f5-41fd-8694-6298fda376cf admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:06.866319 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f308974-df3a-4e6a-a887-62162564db79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:06.866987 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f308974-df3a-4e6a-a887-62162564db79 admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:06.867267 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f308974-df3a-4e6a-a887-62162564db79 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:06.867540 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f308974-df3a-4e6a-a887-62162564db79 admin admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:06.868274 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f308974-df3a-4e6a-a887-62162564db79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:06.869901 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f308974-df3a-4e6a-a887-62162564db79 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:06.881368 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1113/2226] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:57:06 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:57:06.888013 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6273130-37cb-46d2-909a-15f0d851f464 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:06.906868 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6273130-37cb-46d2-909a-15f0d851f464 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:06.914569 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb589d4-2723-4628-8ed2-ca1897aeecd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:06.915743 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb589d4-2723-4628-8ed2-ca1897aeecd9 admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:06.916267 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb589d4-2723-4628-8ed2-ca1897aeecd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:06.916774 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb589d4-2723-4628-8ed2-ca1897aeecd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:06.917919 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb589d4-2723-4628-8ed2-ca1897aeecd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:06.920980 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb589d4-2723-4628-8ed2-ca1897aeecd9 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:06.938171 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1114/2227] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:57:06 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:57:06.942171 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f308974-df3a-4e6a-a887-62162564db79 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:06.952468 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f308974-df3a-4e6a-a887-62162564db79 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:06.957695 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc24173-773e-4de6-b6a6-ea5ca2189f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:06.958621 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc24173-773e-4de6-b6a6-ea5ca2189f09 admin admin] REQUEST_METHOD: `PUT` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:06.958903 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc24173-773e-4de6-b6a6-ea5ca2189f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:06.959181 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc24173-773e-4de6-b6a6-ea5ca2189f09 admin admin] PATH_INFO: `/v3/projects/02c13b4007394b1799112c588871da4a/users/acc45bf86ea34aa9ba966024ad757b87/roles/95d753870f97426cb1ce32e078621a4c` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:06.974928 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc24173-773e-4de6-b6a6-ea5ca2189f09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02c13b4007394b1799112c588871da4a, user_id=acc45bf86ea34aa9ba966024ad757b87, role_id=95d753870f97426cb1ce32e078621a4c)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:06.977613 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc24173-773e-4de6-b6a6-ea5ca2189f09 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:06.991815 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1114/2228] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 17:57:06 2022] PUT /identity/v3/projects/02c13b4007394b1799112c588871da4a/users/acc45bf86ea34aa9ba966024ad757b87/roles/95d753870f97426cb1ce32e078621a4c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:57:07.003154 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c601c8a-1f36-49de-9693-12baa8481bc6 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:07.003448 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c601c8a-1f36-49de-9693-12baa8481bc6 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:07.003732 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c601c8a-1f36-49de-9693-12baa8481bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:07.030583 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-7c601c8a-1f36-49de-9693-12baa8481bc6 None None] MFA Rules not processed for user `acc45bf86ea34aa9ba966024ad757b87`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:57:07.032372 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-7c601c8a-1f36-49de-9693-12baa8481bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:57:07.096961 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1115/2229] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:57:07 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:57:07.101604 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc24173-773e-4de6-b6a6-ea5ca2189f09 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:07.172767 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc24173-773e-4de6-b6a6-ea5ca2189f09 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:07.179332 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6265c34-9848-4a66-b30a-6a00cf328107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:07.180364 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6265c34-9848-4a66-b30a-6a00cf328107 admin admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:07.181075 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6265c34-9848-4a66-b30a-6a00cf328107 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:07.181565 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6265c34-9848-4a66-b30a-6a00cf328107 admin admin] PATH_INFO: `/v3/projects` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:07.182740 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6265c34-9848-4a66-b30a-6a00cf328107 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:07.186118 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6265c34-9848-4a66-b30a-6a00cf328107 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:07.221601 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1115/2230] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 14 17:57:07 2022] POST /identity/v3/projects => generated 387 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:57:07.228550 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c601c8a-1f36-49de-9693-12baa8481bc6 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:07.239219 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c601c8a-1f36-49de-9693-12baa8481bc6 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:07.257111 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:57:07.295829 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8844a31-c618-49ce-b26c-f96692190761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:07.296523 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8844a31-c618-49ce-b26c-f96692190761 admin admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:07.296810 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8844a31-c618-49ce-b26c-f96692190761 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:07.297084 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8844a31-c618-49ce-b26c-f96692190761 admin admin] PATH_INFO: `/v3/users` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:07.297797 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8844a31-c618-49ce-b26c-f96692190761 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:07.299696 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8844a31-c618-49ce-b26c-f96692190761 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:07.321240 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1116/2231] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 14 17:57:07 2022] POST /identity/v3/users => generated 294 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:57:07.325638 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6265c34-9848-4a66-b30a-6a00cf328107 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:07.336927 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6265c34-9848-4a66-b30a-6a00cf328107 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:07.341792 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ee8948-f1b2-4d64-bc15-0592a638324f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:07.342516 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee8948-f1b2-4d64-bc15-0592a638324f admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:07.342821 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee8948-f1b2-4d64-bc15-0592a638324f admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:07.343107 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee8948-f1b2-4d64-bc15-0592a638324f admin admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:07.343838 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ee8948-f1b2-4d64-bc15-0592a638324f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:07.345456 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ee8948-f1b2-4d64-bc15-0592a638324f admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:07.357562 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1116/2232] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:57:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:57:07.361648 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8844a31-c618-49ce-b26c-f96692190761 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:07.371846 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8844a31-c618-49ce-b26c-f96692190761 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:07.377042 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b684a3a1-d9f3-427d-bb90-71e68eed0a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:07.377730 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b684a3a1-d9f3-427d-bb90-71e68eed0a63 admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:07.378010 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b684a3a1-d9f3-427d-bb90-71e68eed0a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:07.378284 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b684a3a1-d9f3-427d-bb90-71e68eed0a63 admin admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:07.379028 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b684a3a1-d9f3-427d-bb90-71e68eed0a63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:07.380611 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b684a3a1-d9f3-427d-bb90-71e68eed0a63 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:07.391723 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1117/2233] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:57:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:57:07.396168 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ee8948-f1b2-4d64-bc15-0592a638324f admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:07.406943 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ee8948-f1b2-4d64-bc15-0592a638324f admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:07.411579 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d66a0a0-0328-41d3-8f5d-eb8a4b06ab3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:07.412463 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d66a0a0-0328-41d3-8f5d-eb8a4b06ab3e admin admin] REQUEST_METHOD: `PUT` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:07.412751 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d66a0a0-0328-41d3-8f5d-eb8a4b06ab3e admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:07.413127 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d66a0a0-0328-41d3-8f5d-eb8a4b06ab3e admin admin] PATH_INFO: `/v3/projects/f52f308eacd54ff1a029ec51c666aad4/users/d2d55a4133f64545a2e029a689a82d73/roles/95d753870f97426cb1ce32e078621a4c` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:07.428548 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d66a0a0-0328-41d3-8f5d-eb8a4b06ab3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f52f308eacd54ff1a029ec51c666aad4, user_id=d2d55a4133f64545a2e029a689a82d73, role_id=95d753870f97426cb1ce32e078621a4c)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:07.431536 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d66a0a0-0328-41d3-8f5d-eb8a4b06ab3e admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:07.433879 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:57:07.450576 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1117/2234] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 17:57:07 2022] PUT /identity/v3/projects/f52f308eacd54ff1a029ec51c666aad4/users/d2d55a4133f64545a2e029a689a82d73/roles/95d753870f97426cb1ce32e078621a4c => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:57:07.461558 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399e9c3e-9c7c-472b-bfc4-2197f2a6d8b9 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:07.461879 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399e9c3e-9c7c-472b-bfc4-2197f2a6d8b9 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:07.462222 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399e9c3e-9c7c-472b-bfc4-2197f2a6d8b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:07.498534 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-399e9c3e-9c7c-472b-bfc4-2197f2a6d8b9 None None] MFA Rules not processed for user `d2d55a4133f64545a2e029a689a82d73`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:57:07.500465 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-399e9c3e-9c7c-472b-bfc4-2197f2a6d8b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:57:07.576522 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1118/2235] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:57:07 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:57:07.581254 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d66a0a0-0328-41d3-8f5d-eb8a4b06ab3e admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:07.652020 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d66a0a0-0328-41d3-8f5d-eb8a4b06ab3e admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:07.657993 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed4360f-f03a-43bc-b19f-426fa02d13ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:07.658663 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed4360f-f03a-43bc-b19f-426fa02d13ef admin admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:07.658969 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed4360f-f03a-43bc-b19f-426fa02d13ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:07.659302 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed4360f-f03a-43bc-b19f-426fa02d13ef admin admin] PATH_INFO: `/v3/projects` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:07.660354 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed4360f-f03a-43bc-b19f-426fa02d13ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:07.662522 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed4360f-f03a-43bc-b19f-426fa02d13ef admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:07.691434 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1118/2236] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 14 17:57:07 2022] POST /identity/v3/projects => generated 387 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 17:57:07.695640 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399e9c3e-9c7c-472b-bfc4-2197f2a6d8b9 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:07.707566 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399e9c3e-9c7c-472b-bfc4-2197f2a6d8b9 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:07.772255 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc80de6-275a-433f-b835-caffd5bbc322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:07.772601 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc80de6-275a-433f-b835-caffd5bbc322 admin admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:07.772881 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc80de6-275a-433f-b835-caffd5bbc322 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:07.773155 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc80de6-275a-433f-b835-caffd5bbc322 admin admin] PATH_INFO: `/v3/users` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:07.773895 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc80de6-275a-433f-b835-caffd5bbc322 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:07.775812 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc80de6-275a-433f-b835-caffd5bbc322 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:07.802085 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1119/2237] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 14 17:57:07 2022] POST /identity/v3/users => generated 300 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:57:07.803540 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed4360f-f03a-43bc-b19f-426fa02d13ef admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:07.814366 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed4360f-f03a-43bc-b19f-426fa02d13ef admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:07.819018 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3649b9d7-ba7f-4372-b936-30060892c613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:07.819688 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3649b9d7-ba7f-4372-b936-30060892c613 admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:07.819966 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3649b9d7-ba7f-4372-b936-30060892c613 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:07.820248 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3649b9d7-ba7f-4372-b936-30060892c613 admin admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:07.821007 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3649b9d7-ba7f-4372-b936-30060892c613 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:07.822632 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3649b9d7-ba7f-4372-b936-30060892c613 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:07.833713 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1119/2238] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:57:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:57:07.839013 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc80de6-275a-433f-b835-caffd5bbc322 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:07.850966 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc80de6-275a-433f-b835-caffd5bbc322 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:07.855966 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317cdb81-572e-4c6c-8550-b378a65e0dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:07.856860 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317cdb81-572e-4c6c-8550-b378a65e0dd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:07.857144 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317cdb81-572e-4c6c-8550-b378a65e0dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:07.857429 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317cdb81-572e-4c6c-8550-b378a65e0dd3 admin admin] PATH_INFO: `/v3/projects/e95f2844e2144930a7c489172b0cd83f/users/4180b6f9172b4f4b8f030a32f57f4268/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:07.873955 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317cdb81-572e-4c6c-8550-b378a65e0dd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e95f2844e2144930a7c489172b0cd83f, user_id=4180b6f9172b4f4b8f030a32f57f4268, role_id=4651a1cc7b4d4ab7a7a9ca1e77e58e71)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:07.876663 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317cdb81-572e-4c6c-8550-b378a65e0dd3 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:07.879810 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:57:07.893678 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1120/2239] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 17:57:07 2022] PUT /identity/v3/projects/e95f2844e2144930a7c489172b0cd83f/users/4180b6f9172b4f4b8f030a32f57f4268/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:57:07.898395 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3649b9d7-ba7f-4372-b936-30060892c613 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:07.910722 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3649b9d7-ba7f-4372-b936-30060892c613 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:07.973279 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec3e32d-f745-46b5-9ff8-e0401a87d097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:07.973984 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec3e32d-f745-46b5-9ff8-e0401a87d097 admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:07.974271 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec3e32d-f745-46b5-9ff8-e0401a87d097 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:07.974551 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec3e32d-f745-46b5-9ff8-e0401a87d097 admin admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:07.975293 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec3e32d-f745-46b5-9ff8-e0401a87d097 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:07.976894 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec3e32d-f745-46b5-9ff8-e0401a87d097 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:07.992183 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1120/2240] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:57:07 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:57:07.996365 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317cdb81-572e-4c6c-8550-b378a65e0dd3 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:08.006903 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317cdb81-572e-4c6c-8550-b378a65e0dd3 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:08.012566 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cd0a01-c5e7-4080-a04a-84177d00f30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:08.013485 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd0a01-c5e7-4080-a04a-84177d00f30f admin admin] REQUEST_METHOD: `PUT` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:08.013795 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd0a01-c5e7-4080-a04a-84177d00f30f admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:08.014071 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd0a01-c5e7-4080-a04a-84177d00f30f admin admin] PATH_INFO: `/v3/projects/e95f2844e2144930a7c489172b0cd83f/users/4180b6f9172b4f4b8f030a32f57f4268/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:08.016169 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cd0a01-c5e7-4080-a04a-84177d00f30f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e95f2844e2144930a7c489172b0cd83f, user_id=4180b6f9172b4f4b8f030a32f57f4268, role_id=4651a1cc7b4d4ab7a7a9ca1e77e58e71)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:08.018933 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cd0a01-c5e7-4080-a04a-84177d00f30f admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:08.031771 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1121/2241] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 17:57:07 2022] PUT /identity/v3/projects/e95f2844e2144930a7c489172b0cd83f/users/4180b6f9172b4f4b8f030a32f57f4268/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:57:08.043733 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe7befa-9464-439f-bbbe-0e941b81cee6 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:08.044024 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe7befa-9464-439f-bbbe-0e941b81cee6 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:08.044308 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe7befa-9464-439f-bbbe-0e941b81cee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:08.077019 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-2fe7befa-9464-439f-bbbe-0e941b81cee6 None None] MFA Rules not processed for user `4180b6f9172b4f4b8f030a32f57f4268`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:57:08.078281 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-2fe7befa-9464-439f-bbbe-0e941b81cee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:57:08.138973 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:57:08.163204 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1121/2242] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:57:08 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:57:08.177559 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cd0a01-c5e7-4080-a04a-84177d00f30f admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:08.179364 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-66cd0a01-c5e7-4080-a04a-84177d00f30f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:57:08.243072 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cd0a01-c5e7-4080-a04a-84177d00f30f admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:08.246679 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e5fb9c-fe02-4909-ade6-6072fed0e74f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de55cae1600841889668e36402861203', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:08.247333 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e5fb9c-fe02-4909-ade6-6072fed0e74f service cinder] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:08.247610 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e5fb9c-fe02-4909-ade6-6072fed0e74f service cinder] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:08.247890 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e5fb9c-fe02-4909-ade6-6072fed0e74f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:08.257552 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e5fb9c-fe02-4909-ade6-6072fed0e74f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:08.258960 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e5fb9c-fe02-4909-ade6-6072fed0e74f service cinder] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:08.269002 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1122/2243] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:57:08 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:57:08.796330 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe7befa-9464-439f-bbbe-0e941b81cee6 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:08.808025 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe7befa-9464-439f-bbbe-0e941b81cee6 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:08.825878 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3a80e6-d216-42a8-b818-7091411381ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de55cae1600841889668e36402861203', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:08.826606 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a80e6-d216-42a8-b818-7091411381ff service cinder] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:08.827031 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a80e6-d216-42a8-b818-7091411381ff service cinder] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:08.827204 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a80e6-d216-42a8-b818-7091411381ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:08.903606 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3a80e6-d216-42a8-b818-7091411381ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:08.905195 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3a80e6-d216-42a8-b818-7091411381ff service cinder] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:08.918590 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1122/2244] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:57:08 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:57:16.210263 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e5fb9c-fe02-4909-ade6-6072fed0e74f service cinder] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:16.221713 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e5fb9c-fe02-4909-ade6-6072fed0e74f service cinder] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:16.231888 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a43e571-c805-4fb7-ad9e-acfcc3e9e40a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de55cae1600841889668e36402861203', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:16.232727 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a43e571-c805-4fb7-ad9e-acfcc3e9e40a service cinder] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:16.232938 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a43e571-c805-4fb7-ad9e-acfcc3e9e40a service cinder] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:16.233216 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a43e571-c805-4fb7-ad9e-acfcc3e9e40a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:16.311382 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a43e571-c805-4fb7-ad9e-acfcc3e9e40a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:16.313642 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a43e571-c805-4fb7-ad9e-acfcc3e9e40a service cinder] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:16.324873 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1123/2245] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:57:16 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 17:57:18.705035 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3a80e6-d216-42a8-b818-7091411381ff service cinder] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:18.768476 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3a80e6-d216-42a8-b818-7091411381ff service cinder] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:18.773907 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48e7523-5493-4dac-8160-e3c5e56beb4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:18.774795 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e7523-5493-4dac-8160-e3c5e56beb4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:18.775082 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e7523-5493-4dac-8160-e3c5e56beb4f admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:18.775454 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e7523-5493-4dac-8160-e3c5e56beb4f admin admin] PATH_INFO: `/v3/users/acc45bf86ea34aa9ba966024ad757b87` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:18.776812 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48e7523-5493-4dac-8160-e3c5e56beb4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=acc45bf86ea34aa9ba966024ad757b87)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:18.778853 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48e7523-5493-4dac-8160-e3c5e56beb4f admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:18.839116 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-d48e7523-5493-4dac-8160-e3c5e56beb4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acc45bf86ea34aa9ba966024ad757b87'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:18.849028 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-d48e7523-5493-4dac-8160-e3c5e56beb4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acc45bf86ea34aa9ba966024ad757b87'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:18.857273 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-d48e7523-5493-4dac-8160-e3c5e56beb4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acc45bf86ea34aa9ba966024ad757b87'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:18.858041 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-d48e7523-5493-4dac-8160-e3c5e56beb4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acc45bf86ea34aa9ba966024ad757b87'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:18.872224 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-d48e7523-5493-4dac-8160-e3c5e56beb4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acc45bf86ea34aa9ba966024ad757b87'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:18.878348 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1123/2246] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 14 17:57:18 2022] DELETE /identity/v3/users/acc45bf86ea34aa9ba966024ad757b87 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:57:18.883560 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f4dbd-6b86-4243-ad18-062659ffa0e5 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:18.884262 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f4dbd-6b86-4243-ad18-062659ffa0e5 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:18.884262 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f4dbd-6b86-4243-ad18-062659ffa0e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:18.904359 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-c87f4dbd-6b86-4243-ad18-062659ffa0e5 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:57:18.905478 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-c87f4dbd-6b86-4243-ad18-062659ffa0e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:57:18.965628 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1124/2247] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:57:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:57:18.976001 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48e7523-5493-4dac-8160-e3c5e56beb4f admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:18.977427 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-d48e7523-5493-4dac-8160-e3c5e56beb4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:57:18.988955 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:57:19.049210 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48e7523-5493-4dac-8160-e3c5e56beb4f admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:19.053015 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78907153-42c1-400f-b6f2-2bca72b31ed1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:19.053699 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78907153-42c1-400f-b6f2-2bca72b31ed1 service neutron] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:19.053983 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78907153-42c1-400f-b6f2-2bca72b31ed1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:19.054262 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78907153-42c1-400f-b6f2-2bca72b31ed1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:19.064634 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78907153-42c1-400f-b6f2-2bca72b31ed1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:19.066116 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78907153-42c1-400f-b6f2-2bca72b31ed1 service neutron] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:19.075894 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1124/2248] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:57:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:57:19.448756 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87f4dbd-6b86-4243-ad18-062659ffa0e5 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:19.451042 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-c87f4dbd-6b86-4243-ad18-062659ffa0e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:57:19.479172 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87f4dbd-6b86-4243-ad18-062659ffa0e5 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:19.488782 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95592cd-a27b-4fd5-a9cc-b232bff12ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:19.492206 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95592cd-a27b-4fd5-a9cc-b232bff12ade admin admin] REQUEST_METHOD: `DELETE` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:19.492206 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95592cd-a27b-4fd5-a9cc-b232bff12ade admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:19.492206 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95592cd-a27b-4fd5-a9cc-b232bff12ade admin admin] PATH_INFO: `/v3/projects/02c13b4007394b1799112c588871da4a` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:19.493946 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95592cd-a27b-4fd5-a9cc-b232bff12ade admin admin] RBAC: Authorizing `identity:delete_project(project_id=02c13b4007394b1799112c588871da4a)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:19.496020 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95592cd-a27b-4fd5-a9cc-b232bff12ade admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:19.524313 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:57:19.553804 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-e95592cd-a27b-4fd5-a9cc-b232bff12ade admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02c13b4007394b1799112c588871da4a', 'request_id': 'req-e95592cd-a27b-4fd5-a9cc-b232bff12ade'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:19.561050 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-e95592cd-a27b-4fd5-a9cc-b232bff12ade admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02c13b4007394b1799112c588871da4a', 'request_id': 'req-e95592cd-a27b-4fd5-a9cc-b232bff12ade'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:19.568110 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-e95592cd-a27b-4fd5-a9cc-b232bff12ade admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02c13b4007394b1799112c588871da4a', 'request_id': 'req-e95592cd-a27b-4fd5-a9cc-b232bff12ade'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:19.581800 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-e95592cd-a27b-4fd5-a9cc-b232bff12ade admin admin] The token cache is being invalidate because project 02c13b4007394b1799112c588871da4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86773) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 17:57:19.582092 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-e95592cd-a27b-4fd5-a9cc-b232bff12ade admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:19.582754 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-e95592cd-a27b-4fd5-a9cc-b232bff12ade admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:19.584333 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1125/2249] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 14 17:57:19 2022] DELETE /identity/v3/projects/02c13b4007394b1799112c588871da4a => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 17:57:19.588532 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78907153-42c1-400f-b6f2-2bca72b31ed1 service neutron] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:19.598716 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78907153-42c1-400f-b6f2-2bca72b31ed1 service neutron] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:19.683310 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d42b52-c470-4406-816b-388dfb0829a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:19.684729 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d42b52-c470-4406-816b-388dfb0829a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:19.685223 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d42b52-c470-4406-816b-388dfb0829a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:19.685669 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d42b52-c470-4406-816b-388dfb0829a5 admin admin] PATH_INFO: `/v3/users/d2d55a4133f64545a2e029a689a82d73` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:19.688423 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d42b52-c470-4406-816b-388dfb0829a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2d55a4133f64545a2e029a689a82d73)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:19.691436 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d42b52-c470-4406-816b-388dfb0829a5 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:19.763464 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-55d42b52-c470-4406-816b-388dfb0829a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2d55a4133f64545a2e029a689a82d73'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:19.772679 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-55d42b52-c470-4406-816b-388dfb0829a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2d55a4133f64545a2e029a689a82d73'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:19.780404 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-55d42b52-c470-4406-816b-388dfb0829a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2d55a4133f64545a2e029a689a82d73'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:19.781122 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-55d42b52-c470-4406-816b-388dfb0829a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2d55a4133f64545a2e029a689a82d73'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:19.796712 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-55d42b52-c470-4406-816b-388dfb0829a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2d55a4133f64545a2e029a689a82d73'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:19.804340 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1125/2250] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 14 17:57:19 2022] DELETE /identity/v3/users/d2d55a4133f64545a2e029a689a82d73 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:57:20.136508 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95592cd-a27b-4fd5-a9cc-b232bff12ade admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:20.137965 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-e95592cd-a27b-4fd5-a9cc-b232bff12ade admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:57:20.153977 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95592cd-a27b-4fd5-a9cc-b232bff12ade admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:20.215140 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cdb765-e1f6-4eef-80d4-9256e4bfdba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:20.216009 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cdb765-e1f6-4eef-80d4-9256e4bfdba3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:20.216298 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cdb765-e1f6-4eef-80d4-9256e4bfdba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:20.216570 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cdb765-e1f6-4eef-80d4-9256e4bfdba3 admin admin] PATH_INFO: `/v3/projects/f52f308eacd54ff1a029ec51c666aad4` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:20.217802 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cdb765-e1f6-4eef-80d4-9256e4bfdba3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f52f308eacd54ff1a029ec51c666aad4)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:20.219780 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cdb765-e1f6-4eef-80d4-9256e4bfdba3 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:20.272847 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-f4cdb765-e1f6-4eef-80d4-9256e4bfdba3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f52f308eacd54ff1a029ec51c666aad4', 'request_id': 'req-f4cdb765-e1f6-4eef-80d4-9256e4bfdba3'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:20.279065 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-f4cdb765-e1f6-4eef-80d4-9256e4bfdba3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f52f308eacd54ff1a029ec51c666aad4', 'request_id': 'req-f4cdb765-e1f6-4eef-80d4-9256e4bfdba3'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:20.284787 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-f4cdb765-e1f6-4eef-80d4-9256e4bfdba3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f52f308eacd54ff1a029ec51c666aad4', 'request_id': 'req-f4cdb765-e1f6-4eef-80d4-9256e4bfdba3'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:20.300555 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-f4cdb765-e1f6-4eef-80d4-9256e4bfdba3 admin admin] The token cache is being invalidate because project f52f308eacd54ff1a029ec51c666aad4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86773) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 17:57:20.301067 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-f4cdb765-e1f6-4eef-80d4-9256e4bfdba3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:20.302104 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-f4cdb765-e1f6-4eef-80d4-9256e4bfdba3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:20.304098 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1126/2251] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 14 17:57:20 2022] DELETE /identity/v3/projects/f52f308eacd54ff1a029ec51c666aad4 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 17:57:20.308495 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d42b52-c470-4406-816b-388dfb0829a5 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:20.309948 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-55d42b52-c470-4406-816b-388dfb0829a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:57:20.323796 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d42b52-c470-4406-816b-388dfb0829a5 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:20.351286 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:57:20.398502 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edba0e9-cd42-44b5-ac6e-421c8c2c1766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:20.399392 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edba0e9-cd42-44b5-ac6e-421c8c2c1766 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:20.399673 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edba0e9-cd42-44b5-ac6e-421c8c2c1766 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:20.399977 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edba0e9-cd42-44b5-ac6e-421c8c2c1766 admin admin] PATH_INFO: `/v3/users/4180b6f9172b4f4b8f030a32f57f4268` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:20.401193 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edba0e9-cd42-44b5-ac6e-421c8c2c1766 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4180b6f9172b4f4b8f030a32f57f4268)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:20.403504 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edba0e9-cd42-44b5-ac6e-421c8c2c1766 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:20.479165 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-7edba0e9-cd42-44b5-ac6e-421c8c2c1766 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4180b6f9172b4f4b8f030a32f57f4268'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:20.488948 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-7edba0e9-cd42-44b5-ac6e-421c8c2c1766 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4180b6f9172b4f4b8f030a32f57f4268'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:20.500000 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-7edba0e9-cd42-44b5-ac6e-421c8c2c1766 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4180b6f9172b4f4b8f030a32f57f4268'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:20.501347 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-7edba0e9-cd42-44b5-ac6e-421c8c2c1766 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4180b6f9172b4f4b8f030a32f57f4268'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:20.526474 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-7edba0e9-cd42-44b5-ac6e-421c8c2c1766 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4180b6f9172b4f4b8f030a32f57f4268'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:20.534651 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1126/2252] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 14 17:57:20 2022] DELETE /identity/v3/users/4180b6f9172b4f4b8f030a32f57f4268 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:57:20.840907 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cdb765-e1f6-4eef-80d4-9256e4bfdba3 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:20.844198 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-f4cdb765-e1f6-4eef-80d4-9256e4bfdba3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:57:20.860668 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cdb765-e1f6-4eef-80d4-9256e4bfdba3 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:20.912193 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:57:20.941891 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecbd606-2501-4627-9a60-18abe5341b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:20.942906 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecbd606-2501-4627-9a60-18abe5341b78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:20.943271 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecbd606-2501-4627-9a60-18abe5341b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:20.943606 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecbd606-2501-4627-9a60-18abe5341b78 admin admin] PATH_INFO: `/v3/projects/e95f2844e2144930a7c489172b0cd83f` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:20.944987 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecbd606-2501-4627-9a60-18abe5341b78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e95f2844e2144930a7c489172b0cd83f)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:20.946943 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecbd606-2501-4627-9a60-18abe5341b78 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:20.998567 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-7ecbd606-2501-4627-9a60-18abe5341b78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e95f2844e2144930a7c489172b0cd83f', 'request_id': 'req-7ecbd606-2501-4627-9a60-18abe5341b78'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:21.006168 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-7ecbd606-2501-4627-9a60-18abe5341b78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e95f2844e2144930a7c489172b0cd83f', 'request_id': 'req-7ecbd606-2501-4627-9a60-18abe5341b78'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:21.011990 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-7ecbd606-2501-4627-9a60-18abe5341b78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e95f2844e2144930a7c489172b0cd83f', 'request_id': 'req-7ecbd606-2501-4627-9a60-18abe5341b78'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:21.028830 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-7ecbd606-2501-4627-9a60-18abe5341b78 admin admin] The token cache is being invalidate because project e95f2844e2144930a7c489172b0cd83f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86773) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 17:57:21.029120 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-7ecbd606-2501-4627-9a60-18abe5341b78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:21.029878 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-7ecbd606-2501-4627-9a60-18abe5341b78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:21.031493 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1127/2253] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 14 17:57:20 2022] DELETE /identity/v3/projects/e95f2844e2144930a7c489172b0cd83f => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:57:21.037565 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b29dc0-eaa6-4baf-89b1-b21cfed5080f None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:21.038320 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b29dc0-eaa6-4baf-89b1-b21cfed5080f None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:21.038462 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b29dc0-eaa6-4baf-89b1-b21cfed5080f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:21.058643 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-15b29dc0-eaa6-4baf-89b1-b21cfed5080f None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:57:21.059911 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-15b29dc0-eaa6-4baf-89b1-b21cfed5080f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:57:21.124868 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1127/2254] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:57:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:57:21.133962 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf59bf-d2e1-4925-b4aa-b2f68b8f6529 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:21.134246 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf59bf-d2e1-4925-b4aa-b2f68b8f6529 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:21.134527 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf59bf-d2e1-4925-b4aa-b2f68b8f6529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:21.153244 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-eedf59bf-d2e1-4925-b4aa-b2f68b8f6529 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:57:21.154503 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-eedf59bf-d2e1-4925-b4aa-b2f68b8f6529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:57:21.162696 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1128/2255] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:57:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:57:21.166869 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b29dc0-eaa6-4baf-89b1-b21cfed5080f None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:21.179319 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b29dc0-eaa6-4baf-89b1-b21cfed5080f None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:21.184227 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b86e97e-41f5-42ec-9280-920be411aaa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:21.184920 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b86e97e-41f5-42ec-9280-920be411aaa8 admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:21.185199 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b86e97e-41f5-42ec-9280-920be411aaa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:21.185471 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b86e97e-41f5-42ec-9280-920be411aaa8 admin admin] PATH_INFO: `/v3/domains` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:21.186273 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b86e97e-41f5-42ec-9280-920be411aaa8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:57:21.186580 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b86e97e-41f5-42ec-9280-920be411aaa8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:21.188778 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b86e97e-41f5-42ec-9280-920be411aaa8 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:21.201257 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1128/2256] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 14 17:57:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:57:21.205941 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedf59bf-d2e1-4925-b4aa-b2f68b8f6529 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:21.215405 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedf59bf-d2e1-4925-b4aa-b2f68b8f6529 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:21.221339 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6b0b9c-55f0-4eb1-a9c2-16a4b60d4da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:21.222029 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6b0b9c-55f0-4eb1-a9c2-16a4b60d4da6 admin admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:21.222314 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6b0b9c-55f0-4eb1-a9c2-16a4b60d4da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:21.222589 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6b0b9c-55f0-4eb1-a9c2-16a4b60d4da6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:21.223287 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6b0b9c-55f0-4eb1-a9c2-16a4b60d4da6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:21.225188 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6b0b9c-55f0-4eb1-a9c2-16a4b60d4da6 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:21.251879 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1129/2257] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 14 17:57:21 2022] POST /identity/v3/projects => generated 381 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 17:57:21.256093 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b86e97e-41f5-42ec-9280-920be411aaa8 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:21.266415 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b86e97e-41f5-42ec-9280-920be411aaa8 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:21.299241 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:57:21.329365 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960b57c4-4357-43c6-84b5-8d76540906b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:21.330102 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b57c4-4357-43c6-84b5-8d76540906b0 admin admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:21.330102 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b57c4-4357-43c6-84b5-8d76540906b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:21.330102 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b57c4-4357-43c6-84b5-8d76540906b0 admin admin] PATH_INFO: `/v3/users` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:21.330102 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960b57c4-4357-43c6-84b5-8d76540906b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:21.333254 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960b57c4-4357-43c6-84b5-8d76540906b0 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:21.354050 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1129/2258] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 14 17:57:21 2022] POST /identity/v3/users => generated 291 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:57:21.358397 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6b0b9c-55f0-4eb1-a9c2-16a4b60d4da6 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:21.369280 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6b0b9c-55f0-4eb1-a9c2-16a4b60d4da6 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:21.374024 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e609e1e5-c4d1-48b8-8dc1-e56e8de154e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:21.374693 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e609e1e5-c4d1-48b8-8dc1-e56e8de154e6 admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:21.374977 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e609e1e5-c4d1-48b8-8dc1-e56e8de154e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:21.375251 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e609e1e5-c4d1-48b8-8dc1-e56e8de154e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:21.375989 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e609e1e5-c4d1-48b8-8dc1-e56e8de154e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:21.377664 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e609e1e5-c4d1-48b8-8dc1-e56e8de154e6 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:21.389196 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1130/2259] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:57:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:57:21.393342 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960b57c4-4357-43c6-84b5-8d76540906b0 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:21.403750 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960b57c4-4357-43c6-84b5-8d76540906b0 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:21.408941 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e815874a-ff6d-4cca-976f-2405c91993b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:21.409659 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e815874a-ff6d-4cca-976f-2405c91993b9 admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:21.409945 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e815874a-ff6d-4cca-976f-2405c91993b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:21.410218 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e815874a-ff6d-4cca-976f-2405c91993b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:21.410949 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e815874a-ff6d-4cca-976f-2405c91993b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:21.412545 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e815874a-ff6d-4cca-976f-2405c91993b9 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:21.423712 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1130/2260] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:57:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:57:21.427916 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e609e1e5-c4d1-48b8-8dc1-e56e8de154e6 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:21.438850 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e609e1e5-c4d1-48b8-8dc1-e56e8de154e6 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:21.444068 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed5f07f-0a99-4837-8687-d7e3105d100a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:21.444975 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed5f07f-0a99-4837-8687-d7e3105d100a admin admin] REQUEST_METHOD: `PUT` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:21.445260 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed5f07f-0a99-4837-8687-d7e3105d100a admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:21.445623 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed5f07f-0a99-4837-8687-d7e3105d100a admin admin] PATH_INFO: `/v3/projects/68537808167b4cf0ada81bf3ddbd0e9d/users/4264c971d17a41739de4924d4708a3b1/roles/95d753870f97426cb1ce32e078621a4c` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:21.462304 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed5f07f-0a99-4837-8687-d7e3105d100a admin admin] RBAC: Authorizing `identity:create_grant(project_id=68537808167b4cf0ada81bf3ddbd0e9d, user_id=4264c971d17a41739de4924d4708a3b1, role_id=95d753870f97426cb1ce32e078621a4c)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:21.465047 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed5f07f-0a99-4837-8687-d7e3105d100a admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:21.483628 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1131/2261] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 17:57:21 2022] PUT /identity/v3/projects/68537808167b4cf0ada81bf3ddbd0e9d/users/4264c971d17a41739de4924d4708a3b1/roles/95d753870f97426cb1ce32e078621a4c => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 17:57:21.496512 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d49e8c0-6fd0-4d5c-a96e-1e2a90041a98 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:21.496800 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d49e8c0-6fd0-4d5c-a96e-1e2a90041a98 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:21.497077 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d49e8c0-6fd0-4d5c-a96e-1e2a90041a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:21.528242 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-0d49e8c0-6fd0-4d5c-a96e-1e2a90041a98 None None] MFA Rules not processed for user `4264c971d17a41739de4924d4708a3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:57:21.529463 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-0d49e8c0-6fd0-4d5c-a96e-1e2a90041a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:57:21.605857 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1131/2262] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:57:21 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:57:21.610953 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed5f07f-0a99-4837-8687-d7e3105d100a admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:21.678072 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed5f07f-0a99-4837-8687-d7e3105d100a admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:21.683421 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a63e11-fbe4-495e-a7e8-1e5233901fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:21.684215 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a63e11-fbe4-495e-a7e8-1e5233901fa1 admin admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:21.684654 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a63e11-fbe4-495e-a7e8-1e5233901fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:21.684940 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a63e11-fbe4-495e-a7e8-1e5233901fa1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:21.685816 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a63e11-fbe4-495e-a7e8-1e5233901fa1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:21.687791 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a63e11-fbe4-495e-a7e8-1e5233901fa1 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:21.697239 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:57:21.722513 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1132/2263] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 14 17:57:21 2022] POST /identity/v3/projects => generated 383 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 17:57:21.726791 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d49e8c0-6fd0-4d5c-a96e-1e2a90041a98 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:21.737699 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d49e8c0-6fd0-4d5c-a96e-1e2a90041a98 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:21.801356 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f04631-fbcc-4021-ada8-f6b87e3b3624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:21.802077 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f04631-fbcc-4021-ada8-f6b87e3b3624 admin admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:21.802357 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f04631-fbcc-4021-ada8-f6b87e3b3624 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:21.802631 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f04631-fbcc-4021-ada8-f6b87e3b3624 admin admin] PATH_INFO: `/v3/users` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:21.803338 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f04631-fbcc-4021-ada8-f6b87e3b3624 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:21.805242 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f04631-fbcc-4021-ada8-f6b87e3b3624 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:21.830164 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1132/2264] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 14 17:57:21 2022] POST /identity/v3/users => generated 298 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:57:21.831538 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a63e11-fbe4-495e-a7e8-1e5233901fa1 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:21.844948 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a63e11-fbe4-495e-a7e8-1e5233901fa1 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:21.849989 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8040f8-89fa-40e5-9454-93061204f6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:21.850691 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8040f8-89fa-40e5-9454-93061204f6d7 admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:21.850981 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8040f8-89fa-40e5-9454-93061204f6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:21.851275 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8040f8-89fa-40e5-9454-93061204f6d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:21.852032 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8040f8-89fa-40e5-9454-93061204f6d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:21.853852 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8040f8-89fa-40e5-9454-93061204f6d7 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:21.867228 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1133/2265] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:57:21 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 17:57:21.872895 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f04631-fbcc-4021-ada8-f6b87e3b3624 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:21.886915 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f04631-fbcc-4021-ada8-f6b87e3b3624 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:21.895119 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc79131-f71a-4a6b-82ea-c4aa6ee5e801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:21.896791 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc79131-f71a-4a6b-82ea-c4aa6ee5e801 admin admin] REQUEST_METHOD: `PUT` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:21.897251 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc79131-f71a-4a6b-82ea-c4aa6ee5e801 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:21.897752 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc79131-f71a-4a6b-82ea-c4aa6ee5e801 admin admin] PATH_INFO: `/v3/projects/1d2384c1e89b45c097d2548fc937f06f/users/6da85bfc226b4770b97c1e9c53328a55/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:21.923208 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc79131-f71a-4a6b-82ea-c4aa6ee5e801 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d2384c1e89b45c097d2548fc937f06f, user_id=6da85bfc226b4770b97c1e9c53328a55, role_id=4651a1cc7b4d4ab7a7a9ca1e77e58e71)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:21.925939 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc79131-f71a-4a6b-82ea-c4aa6ee5e801 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:21.940393 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1133/2266] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 17:57:21 2022] PUT /identity/v3/projects/1d2384c1e89b45c097d2548fc937f06f/users/6da85bfc226b4770b97c1e9c53328a55/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 17:57:21.944910 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8040f8-89fa-40e5-9454-93061204f6d7 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:21.956846 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8040f8-89fa-40e5-9454-93061204f6d7 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:22.025629 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5c01da-88b6-46ed-a748-990e4e1acf3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:22.026464 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c01da-88b6-46ed-a748-990e4e1acf3f admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:22.026926 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c01da-88b6-46ed-a748-990e4e1acf3f admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:22.027299 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c01da-88b6-46ed-a748-990e4e1acf3f admin admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:22.028409 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5c01da-88b6-46ed-a748-990e4e1acf3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:22.030702 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5c01da-88b6-46ed-a748-990e4e1acf3f admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:22.048619 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1134/2267] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:57:21 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 17:57:22.052983 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc79131-f71a-4a6b-82ea-c4aa6ee5e801 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:22.070157 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc79131-f71a-4a6b-82ea-c4aa6ee5e801 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:22.075422 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a05ad17-a022-467d-940c-ecd8feca0050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:22.076370 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a05ad17-a022-467d-940c-ecd8feca0050 admin admin] REQUEST_METHOD: `PUT` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:22.076650 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a05ad17-a022-467d-940c-ecd8feca0050 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:22.076923 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a05ad17-a022-467d-940c-ecd8feca0050 admin admin] PATH_INFO: `/v3/projects/1d2384c1e89b45c097d2548fc937f06f/users/6da85bfc226b4770b97c1e9c53328a55/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:22.079726 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a05ad17-a022-467d-940c-ecd8feca0050 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d2384c1e89b45c097d2548fc937f06f, user_id=6da85bfc226b4770b97c1e9c53328a55, role_id=4651a1cc7b4d4ab7a7a9ca1e77e58e71)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:22.082504 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a05ad17-a022-467d-940c-ecd8feca0050 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:22.086365 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:57:22.096531 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1134/2268] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 17:57:22 2022] PUT /identity/v3/projects/1d2384c1e89b45c097d2548fc937f06f/users/6da85bfc226b4770b97c1e9c53328a55/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:57:22.110302 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d8441-fb47-4837-8063-6916de6b315a None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:22.110590 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d8441-fb47-4837-8063-6916de6b315a None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:22.110868 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d8441-fb47-4837-8063-6916de6b315a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:22.143087 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-889d8441-fb47-4837-8063-6916de6b315a None None] MFA Rules not processed for user `6da85bfc226b4770b97c1e9c53328a55`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:57:22.144375 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-889d8441-fb47-4837-8063-6916de6b315a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:57:22.237159 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1135/2269] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:57:22 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:57:22.249415 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a05ad17-a022-467d-940c-ecd8feca0050 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:22.253049 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-9a05ad17-a022-467d-940c-ecd8feca0050 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:57:22.325160 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a05ad17-a022-467d-940c-ecd8feca0050 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:22.333479 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0690a2-2fb9-4f53-ae13-f23d783d2232 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de55cae1600841889668e36402861203', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:22.334196 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0690a2-2fb9-4f53-ae13-f23d783d2232 service cinder] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:22.334483 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0690a2-2fb9-4f53-ae13-f23d783d2232 service cinder] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:22.334790 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0690a2-2fb9-4f53-ae13-f23d783d2232 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:22.349923 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0690a2-2fb9-4f53-ae13-f23d783d2232 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:22.352563 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0690a2-2fb9-4f53-ae13-f23d783d2232 service cinder] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:22.370412 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1135/2270] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:57:22 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:57:22.480599 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889d8441-fb47-4837-8063-6916de6b315a None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:22.490983 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889d8441-fb47-4837-8063-6916de6b315a None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:22.496460 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6afa0b-42d6-4128-9215-eec77bff9e1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de55cae1600841889668e36402861203', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:22.497278 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6afa0b-42d6-4128-9215-eec77bff9e1c service cinder] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:22.497732 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6afa0b-42d6-4128-9215-eec77bff9e1c service cinder] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:22.498104 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6afa0b-42d6-4128-9215-eec77bff9e1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:22.572669 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6afa0b-42d6-4128-9215-eec77bff9e1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:22.574546 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6afa0b-42d6-4128-9215-eec77bff9e1c service cinder] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:22.581603 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:57:22.591445 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1136/2271] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:57:22 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:57:22.879311 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0690a2-2fb9-4f53-ae13-f23d783d2232 service cinder] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:22.947215 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0690a2-2fb9-4f53-ae13-f23d783d2232 service cinder] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:22.951731 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a7d9fc-1f13-466d-95ef-9b3d5c766cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:22.952716 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a7d9fc-1f13-466d-95ef-9b3d5c766cf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:22.954139 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a7d9fc-1f13-466d-95ef-9b3d5c766cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:22.954139 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a7d9fc-1f13-466d-95ef-9b3d5c766cf7 admin admin] PATH_INFO: `/v3/users/4264c971d17a41739de4924d4708a3b1` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:22.954426 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a7d9fc-1f13-466d-95ef-9b3d5c766cf7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4264c971d17a41739de4924d4708a3b1)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:22.956336 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a7d9fc-1f13-466d-95ef-9b3d5c766cf7 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:23.009208 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-b6a7d9fc-1f13-466d-95ef-9b3d5c766cf7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4264c971d17a41739de4924d4708a3b1'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:23.019327 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-b6a7d9fc-1f13-466d-95ef-9b3d5c766cf7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4264c971d17a41739de4924d4708a3b1'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:23.027472 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-b6a7d9fc-1f13-466d-95ef-9b3d5c766cf7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4264c971d17a41739de4924d4708a3b1'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:23.028376 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-b6a7d9fc-1f13-466d-95ef-9b3d5c766cf7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4264c971d17a41739de4924d4708a3b1'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:23.042256 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-b6a7d9fc-1f13-466d-95ef-9b3d5c766cf7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4264c971d17a41739de4924d4708a3b1'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:23.050823 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1136/2272] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 14 17:57:22 2022] DELETE /identity/v3/users/4264c971d17a41739de4924d4708a3b1 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:57:23.055425 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f98ea-380a-4d5a-bd1b-2d59ef1cb6d4 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:23.055869 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f98ea-380a-4d5a-bd1b-2d59ef1cb6d4 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:23.056209 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f98ea-380a-4d5a-bd1b-2d59ef1cb6d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:23.074702 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-c15f98ea-380a-4d5a-bd1b-2d59ef1cb6d4 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:57:23.076062 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-c15f98ea-380a-4d5a-bd1b-2d59ef1cb6d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:57:23.151911 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1137/2273] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:57:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 17:57:23.163086 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a7d9fc-1f13-466d-95ef-9b3d5c766cf7 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:23.164666 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-b6a7d9fc-1f13-466d-95ef-9b3d5c766cf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:57:23.193378 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:57:23.242753 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a7d9fc-1f13-466d-95ef-9b3d5c766cf7 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:23.246474 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2bd664-6d93-436e-99e3-b4c080d12ffd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:23.247125 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2bd664-6d93-436e-99e3-b4c080d12ffd service neutron] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:23.247407 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2bd664-6d93-436e-99e3-b4c080d12ffd service neutron] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:23.247685 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2bd664-6d93-436e-99e3-b4c080d12ffd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:23.258233 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2bd664-6d93-436e-99e3-b4c080d12ffd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:23.259783 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2bd664-6d93-436e-99e3-b4c080d12ffd service neutron] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:23.270764 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1137/2274] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:57:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:57:23.561521 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15f98ea-380a-4d5a-bd1b-2d59ef1cb6d4 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:23.563560 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-c15f98ea-380a-4d5a-bd1b-2d59ef1cb6d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:57:23.576118 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15f98ea-380a-4d5a-bd1b-2d59ef1cb6d4 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:23.582107 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f1a36a-1eea-49d4-9f6d-a6cb19c4ec2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:23.582997 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f1a36a-1eea-49d4-9f6d-a6cb19c4ec2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:23.583278 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f1a36a-1eea-49d4-9f6d-a6cb19c4ec2c admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:23.583589 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f1a36a-1eea-49d4-9f6d-a6cb19c4ec2c admin admin] PATH_INFO: `/v3/projects/68537808167b4cf0ada81bf3ddbd0e9d` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:23.584898 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f1a36a-1eea-49d4-9f6d-a6cb19c4ec2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=68537808167b4cf0ada81bf3ddbd0e9d)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:23.586878 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f1a36a-1eea-49d4-9f6d-a6cb19c4ec2c admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:23.643950 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-f2f1a36a-1eea-49d4-9f6d-a6cb19c4ec2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68537808167b4cf0ada81bf3ddbd0e9d', 'request_id': 'req-f2f1a36a-1eea-49d4-9f6d-a6cb19c4ec2c'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:23.651574 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-f2f1a36a-1eea-49d4-9f6d-a6cb19c4ec2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68537808167b4cf0ada81bf3ddbd0e9d', 'request_id': 'req-f2f1a36a-1eea-49d4-9f6d-a6cb19c4ec2c'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:23.658761 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-f2f1a36a-1eea-49d4-9f6d-a6cb19c4ec2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68537808167b4cf0ada81bf3ddbd0e9d', 'request_id': 'req-f2f1a36a-1eea-49d4-9f6d-a6cb19c4ec2c'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:23.673464 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-f2f1a36a-1eea-49d4-9f6d-a6cb19c4ec2c admin admin] The token cache is being invalidate because project 68537808167b4cf0ada81bf3ddbd0e9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86773) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 17:57:23.674684 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-f2f1a36a-1eea-49d4-9f6d-a6cb19c4ec2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:23.674684 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-f2f1a36a-1eea-49d4-9f6d-a6cb19c4ec2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:23.675972 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1138/2275] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 14 17:57:23 2022] DELETE /identity/v3/projects/68537808167b4cf0ada81bf3ddbd0e9d => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:57:23.679937 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2bd664-6d93-436e-99e3-b4c080d12ffd service neutron] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:23.691007 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2bd664-6d93-436e-99e3-b4c080d12ffd service neutron] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:23.755326 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3224d8dc-ebdb-49ac-8eb5-34430b5b4e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:23.756218 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224d8dc-ebdb-49ac-8eb5-34430b5b4e93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:23.756497 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224d8dc-ebdb-49ac-8eb5-34430b5b4e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:23.756766 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224d8dc-ebdb-49ac-8eb5-34430b5b4e93 admin admin] PATH_INFO: `/v3/users/6da85bfc226b4770b97c1e9c53328a55` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:23.758058 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3224d8dc-ebdb-49ac-8eb5-34430b5b4e93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6da85bfc226b4770b97c1e9c53328a55)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:23.759971 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3224d8dc-ebdb-49ac-8eb5-34430b5b4e93 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:23.810121 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-3224d8dc-ebdb-49ac-8eb5-34430b5b4e93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6da85bfc226b4770b97c1e9c53328a55'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:23.819373 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-3224d8dc-ebdb-49ac-8eb5-34430b5b4e93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6da85bfc226b4770b97c1e9c53328a55'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:23.827332 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-3224d8dc-ebdb-49ac-8eb5-34430b5b4e93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6da85bfc226b4770b97c1e9c53328a55'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:23.828016 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-3224d8dc-ebdb-49ac-8eb5-34430b5b4e93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6da85bfc226b4770b97c1e9c53328a55'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:23.843470 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-3224d8dc-ebdb-49ac-8eb5-34430b5b4e93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6da85bfc226b4770b97c1e9c53328a55'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:23.852080 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1138/2276] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 14 17:57:23 2022] DELETE /identity/v3/users/6da85bfc226b4770b97c1e9c53328a55 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:57:24.215655 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f1a36a-1eea-49d4-9f6d-a6cb19c4ec2c admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:24.217158 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-f2f1a36a-1eea-49d4-9f6d-a6cb19c4ec2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:57:24.231330 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f1a36a-1eea-49d4-9f6d-a6cb19c4ec2c admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:24.294387 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f0a1ed-2c76-41d7-82f9-98bfcedf2f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:24.295281 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f0a1ed-2c76-41d7-82f9-98bfcedf2f3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:24.295854 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f0a1ed-2c76-41d7-82f9-98bfcedf2f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:24.296134 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f0a1ed-2c76-41d7-82f9-98bfcedf2f3c admin admin] PATH_INFO: `/v3/projects/1d2384c1e89b45c097d2548fc937f06f` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:24.297631 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f0a1ed-2c76-41d7-82f9-98bfcedf2f3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d2384c1e89b45c097d2548fc937f06f)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:24.299850 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f0a1ed-2c76-41d7-82f9-98bfcedf2f3c admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:24.334407 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:57:24.363797 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-c6f0a1ed-2c76-41d7-82f9-98bfcedf2f3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d2384c1e89b45c097d2548fc937f06f', 'request_id': 'req-c6f0a1ed-2c76-41d7-82f9-98bfcedf2f3c'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:24.370370 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-c6f0a1ed-2c76-41d7-82f9-98bfcedf2f3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d2384c1e89b45c097d2548fc937f06f', 'request_id': 'req-c6f0a1ed-2c76-41d7-82f9-98bfcedf2f3c'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:24.376990 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-c6f0a1ed-2c76-41d7-82f9-98bfcedf2f3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d2384c1e89b45c097d2548fc937f06f', 'request_id': 'req-c6f0a1ed-2c76-41d7-82f9-98bfcedf2f3c'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:24.393216 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-c6f0a1ed-2c76-41d7-82f9-98bfcedf2f3c admin admin] The token cache is being invalidate because project 1d2384c1e89b45c097d2548fc937f06f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86773) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 17:57:24.393664 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-c6f0a1ed-2c76-41d7-82f9-98bfcedf2f3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:24.394350 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-c6f0a1ed-2c76-41d7-82f9-98bfcedf2f3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:24.395989 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1139/2277] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 14 17:57:24 2022] DELETE /identity/v3/projects/1d2384c1e89b45c097d2548fc937f06f => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:57:24.401313 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002429e2-f9d4-450d-a8b0-9774785b7b64 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:24.401897 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002429e2-f9d4-450d-a8b0-9774785b7b64 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:24.402058 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002429e2-f9d4-450d-a8b0-9774785b7b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:24.422998 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-002429e2-f9d4-450d-a8b0-9774785b7b64 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:57:24.424284 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-002429e2-f9d4-450d-a8b0-9774785b7b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:57:24.474530 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:57:24.512924 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1139/2278] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:57:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:57:24.524630 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e1aaa-467d-4224-8bbc-b376910f0238 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:24.524928 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e1aaa-467d-4224-8bbc-b376910f0238 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:24.525215 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e1aaa-467d-4224-8bbc-b376910f0238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:24.543615 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-aa6e1aaa-467d-4224-8bbc-b376910f0238 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:57:24.544829 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-aa6e1aaa-467d-4224-8bbc-b376910f0238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:57:24.553072 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1140/2279] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:57:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:57:24.557940 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002429e2-f9d4-450d-a8b0-9774785b7b64 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:24.568312 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002429e2-f9d4-450d-a8b0-9774785b7b64 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:24.573870 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f2d86d-f18d-48bd-b517-edff747ff7a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:24.574535 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f2d86d-f18d-48bd-b517-edff747ff7a2 admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:24.574821 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f2d86d-f18d-48bd-b517-edff747ff7a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:24.575097 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f2d86d-f18d-48bd-b517-edff747ff7a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:24.575830 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f2d86d-f18d-48bd-b517-edff747ff7a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:57:24.576130 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f2d86d-f18d-48bd-b517-edff747ff7a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:24.577763 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f2d86d-f18d-48bd-b517-edff747ff7a2 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:24.591080 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1140/2280] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 14 17:57:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:57:24.595559 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6e1aaa-467d-4224-8bbc-b376910f0238 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:24.605009 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6e1aaa-467d-4224-8bbc-b376910f0238 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:24.610007 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f8aa43-7e1b-4466-990f-1bc06c5fdccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:24.610771 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f8aa43-7e1b-4466-990f-1bc06c5fdccf admin admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:24.611158 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f8aa43-7e1b-4466-990f-1bc06c5fdccf admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:24.611535 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f8aa43-7e1b-4466-990f-1bc06c5fdccf admin admin] PATH_INFO: `/v3/projects` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:24.612321 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f8aa43-7e1b-4466-990f-1bc06c5fdccf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:24.614548 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f8aa43-7e1b-4466-990f-1bc06c5fdccf admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:24.640738 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1141/2281] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 14 17:57:24 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:57:24.646892 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f2d86d-f18d-48bd-b517-edff747ff7a2 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:24.656844 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f2d86d-f18d-48bd-b517-edff747ff7a2 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:24.723320 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd5bebb-2f12-4a84-8594-a4203b0925b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:24.723994 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd5bebb-2f12-4a84-8594-a4203b0925b6 admin admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:24.724274 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd5bebb-2f12-4a84-8594-a4203b0925b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:24.724544 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd5bebb-2f12-4a84-8594-a4203b0925b6 admin admin] PATH_INFO: `/v3/users` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:24.727141 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd5bebb-2f12-4a84-8594-a4203b0925b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:24.727141 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd5bebb-2f12-4a84-8594-a4203b0925b6 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:24.757002 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1141/2282] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 14 17:57:24 2022] POST /identity/v3/users => generated 288 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 17:57:24.758415 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f8aa43-7e1b-4466-990f-1bc06c5fdccf admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:24.771205 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f8aa43-7e1b-4466-990f-1bc06c5fdccf admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:24.777071 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8df8168-838e-4941-a0ee-d7ca34a7b43f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:24.777963 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8df8168-838e-4941-a0ee-d7ca34a7b43f admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:24.778349 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8df8168-838e-4941-a0ee-d7ca34a7b43f admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:24.778634 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8df8168-838e-4941-a0ee-d7ca34a7b43f admin admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:24.779387 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8df8168-838e-4941-a0ee-d7ca34a7b43f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:24.781051 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8df8168-838e-4941-a0ee-d7ca34a7b43f admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:24.792667 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1142/2283] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:57:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:57:24.797222 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd5bebb-2f12-4a84-8594-a4203b0925b6 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:24.808910 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd5bebb-2f12-4a84-8594-a4203b0925b6 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:24.814352 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0fed7b-404d-4004-885e-226460be08c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:24.815008 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0fed7b-404d-4004-885e-226460be08c7 admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:24.815348 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0fed7b-404d-4004-885e-226460be08c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:24.815619 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0fed7b-404d-4004-885e-226460be08c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:24.816350 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0fed7b-404d-4004-885e-226460be08c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:24.818007 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0fed7b-404d-4004-885e-226460be08c7 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:24.828333 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1142/2284] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:57:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:57:24.834388 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8df8168-838e-4941-a0ee-d7ca34a7b43f admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:24.848419 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8df8168-838e-4941-a0ee-d7ca34a7b43f admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:24.853184 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640377e5-b6ce-4c4c-aa2a-4f7c3ebac49a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:24.854499 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640377e5-b6ce-4c4c-aa2a-4f7c3ebac49a admin admin] REQUEST_METHOD: `PUT` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:24.854782 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640377e5-b6ce-4c4c-aa2a-4f7c3ebac49a admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:24.855305 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640377e5-b6ce-4c4c-aa2a-4f7c3ebac49a admin admin] PATH_INFO: `/v3/projects/9fd3c3ba96ba4b62b901c884c95213fb/users/451139fd8db24adc904af5989ed9d522/roles/95d753870f97426cb1ce32e078621a4c` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:24.873122 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640377e5-b6ce-4c4c-aa2a-4f7c3ebac49a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fd3c3ba96ba4b62b901c884c95213fb, user_id=451139fd8db24adc904af5989ed9d522, role_id=95d753870f97426cb1ce32e078621a4c)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:24.875905 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640377e5-b6ce-4c4c-aa2a-4f7c3ebac49a admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:24.890485 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1143/2285] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 17:57:24 2022] PUT /identity/v3/projects/9fd3c3ba96ba4b62b901c884c95213fb/users/451139fd8db24adc904af5989ed9d522/roles/95d753870f97426cb1ce32e078621a4c => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:57:24.968523 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e2495-cbbb-4fb7-9724-c55078ba994d None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:24.968895 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e2495-cbbb-4fb7-9724-c55078ba994d None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:24.969180 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e2495-cbbb-4fb7-9724-c55078ba994d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:24.997559 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-7c3e2495-cbbb-4fb7-9724-c55078ba994d None None] MFA Rules not processed for user `451139fd8db24adc904af5989ed9d522`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:57:24.998803 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-7c3e2495-cbbb-4fb7-9724-c55078ba994d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:57:25.070697 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1143/2286] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:57:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 17:57:25.082434 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640377e5-b6ce-4c4c-aa2a-4f7c3ebac49a admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:25.084126 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-640377e5-b6ce-4c4c-aa2a-4f7c3ebac49a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:57:25.146552 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640377e5-b6ce-4c4c-aa2a-4f7c3ebac49a admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:25.150228 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e9b8b6-297a-4450-983e-6098bac47e25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de55cae1600841889668e36402861203', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:25.151090 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e9b8b6-297a-4450-983e-6098bac47e25 service cinder] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:25.151371 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e9b8b6-297a-4450-983e-6098bac47e25 service cinder] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:25.151645 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e9b8b6-297a-4450-983e-6098bac47e25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:25.161907 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e9b8b6-297a-4450-983e-6098bac47e25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:25.163641 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e9b8b6-297a-4450-983e-6098bac47e25 service cinder] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:25.173948 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1144/2287] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:57:25 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:57:32.481397 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3e2495-cbbb-4fb7-9724-c55078ba994d None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:32.527013 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:57:32.560959 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3e2495-cbbb-4fb7-9724-c55078ba994d None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:32.566892 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da121df-b3c0-43d1-927b-b032fd6fafad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:32.568031 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da121df-b3c0-43d1-927b-b032fd6fafad admin admin] REQUEST_METHOD: `DELETE` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:32.568487 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da121df-b3c0-43d1-927b-b032fd6fafad admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:32.568939 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da121df-b3c0-43d1-927b-b032fd6fafad admin admin] PATH_INFO: `/v3/users/451139fd8db24adc904af5989ed9d522` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:32.570434 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da121df-b3c0-43d1-927b-b032fd6fafad admin admin] RBAC: Authorizing `identity:delete_user(user_id=451139fd8db24adc904af5989ed9d522)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:32.572707 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da121df-b3c0-43d1-927b-b032fd6fafad admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:32.661378 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-1da121df-b3c0-43d1-927b-b032fd6fafad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '451139fd8db24adc904af5989ed9d522'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:32.671372 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-1da121df-b3c0-43d1-927b-b032fd6fafad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '451139fd8db24adc904af5989ed9d522'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:32.680268 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-1da121df-b3c0-43d1-927b-b032fd6fafad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '451139fd8db24adc904af5989ed9d522'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:32.681009 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-1da121df-b3c0-43d1-927b-b032fd6fafad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '451139fd8db24adc904af5989ed9d522'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:32.697066 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-1da121df-b3c0-43d1-927b-b032fd6fafad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '451139fd8db24adc904af5989ed9d522'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:32.703588 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1144/2288] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 14 17:57:32 2022] DELETE /identity/v3/users/451139fd8db24adc904af5989ed9d522 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:57:32.708500 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4820671-75e4-4cf9-b138-83a939caa62c None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:32.709176 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4820671-75e4-4cf9-b138-83a939caa62c None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:32.709176 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4820671-75e4-4cf9-b138-83a939caa62c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:32.729709 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-b4820671-75e4-4cf9-b138-83a939caa62c None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:57:32.731299 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-b4820671-75e4-4cf9-b138-83a939caa62c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:57:32.780681 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:57:32.803904 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1145/2289] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:57:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:57:32.810839 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da121df-b3c0-43d1-927b-b032fd6fafad admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:32.812304 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-1da121df-b3c0-43d1-927b-b032fd6fafad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:57:32.896622 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da121df-b3c0-43d1-927b-b032fd6fafad admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:32.902978 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3604d586-9891-4b28-8fc9-671b3123bf1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:32.903816 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3604d586-9891-4b28-8fc9-671b3123bf1c service neutron] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:32.904111 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3604d586-9891-4b28-8fc9-671b3123bf1c service neutron] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:32.904470 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3604d586-9891-4b28-8fc9-671b3123bf1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:32.916971 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3604d586-9891-4b28-8fc9-671b3123bf1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:32.918445 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3604d586-9891-4b28-8fc9-671b3123bf1c service neutron] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:32.929834 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1145/2290] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:57:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:57:33.246136 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4820671-75e4-4cf9-b138-83a939caa62c None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:33.248342 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-b4820671-75e4-4cf9-b138-83a939caa62c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:57:33.261722 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4820671-75e4-4cf9-b138-83a939caa62c None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:33.266769 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f83ca42-bcec-4976-90cc-6e9359361193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:33.267669 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f83ca42-bcec-4976-90cc-6e9359361193 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:33.267948 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f83ca42-bcec-4976-90cc-6e9359361193 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:33.268294 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f83ca42-bcec-4976-90cc-6e9359361193 admin admin] PATH_INFO: `/v3/projects/9fd3c3ba96ba4b62b901c884c95213fb` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:33.270067 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f83ca42-bcec-4976-90cc-6e9359361193 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fd3c3ba96ba4b62b901c884c95213fb)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:33.271991 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f83ca42-bcec-4976-90cc-6e9359361193 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:33.323522 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-3f83ca42-bcec-4976-90cc-6e9359361193 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fd3c3ba96ba4b62b901c884c95213fb', 'request_id': 'req-3f83ca42-bcec-4976-90cc-6e9359361193'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:33.330730 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-3f83ca42-bcec-4976-90cc-6e9359361193 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fd3c3ba96ba4b62b901c884c95213fb', 'request_id': 'req-3f83ca42-bcec-4976-90cc-6e9359361193'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:33.338644 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-3f83ca42-bcec-4976-90cc-6e9359361193 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fd3c3ba96ba4b62b901c884c95213fb', 'request_id': 'req-3f83ca42-bcec-4976-90cc-6e9359361193'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:33.355148 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-3f83ca42-bcec-4976-90cc-6e9359361193 admin admin] The token cache is being invalidate because project 9fd3c3ba96ba4b62b901c884c95213fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86773) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 17:57:33.355747 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-3f83ca42-bcec-4976-90cc-6e9359361193 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:33.356464 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-3f83ca42-bcec-4976-90cc-6e9359361193 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:33.358123 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1146/2291] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 14 17:57:33 2022] DELETE /identity/v3/projects/9fd3c3ba96ba4b62b901c884c95213fb => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:57:37.143855 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3604d586-9891-4b28-8fc9-671b3123bf1c service neutron] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:37.145317 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-3604d586-9891-4b28-8fc9-671b3123bf1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:57:37.158156 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3604d586-9891-4b28-8fc9-671b3123bf1c service neutron] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:37.214034 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:57:37.222804 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c892ac-eba7-494b-9856-0571bc76d8b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:37.223926 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c892ac-eba7-494b-9856-0571bc76d8b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:37.224255 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c892ac-eba7-494b-9856-0571bc76d8b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:37.225343 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c892ac-eba7-494b-9856-0571bc76d8b6 admin admin] PATH_INFO: `/v3/users/032c5ac6c1e9466094f53af302194e23` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:37.227166 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c892ac-eba7-494b-9856-0571bc76d8b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=032c5ac6c1e9466094f53af302194e23)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:37.229932 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c892ac-eba7-494b-9856-0571bc76d8b6 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:37.281125 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-c3c892ac-eba7-494b-9856-0571bc76d8b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '032c5ac6c1e9466094f53af302194e23'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:37.289358 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-c3c892ac-eba7-494b-9856-0571bc76d8b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '032c5ac6c1e9466094f53af302194e23'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:37.296962 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-c3c892ac-eba7-494b-9856-0571bc76d8b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '032c5ac6c1e9466094f53af302194e23'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:37.297773 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-c3c892ac-eba7-494b-9856-0571bc76d8b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '032c5ac6c1e9466094f53af302194e23'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:37.311282 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-c3c892ac-eba7-494b-9856-0571bc76d8b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '032c5ac6c1e9466094f53af302194e23'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:37.317272 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1146/2292] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 14 17:57:37 2022] DELETE /identity/v3/users/032c5ac6c1e9466094f53af302194e23 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:57:37.321822 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cb4b8a-b610-47c3-814f-d1f1f195de3b None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:37.322312 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cb4b8a-b610-47c3-814f-d1f1f195de3b None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:37.322410 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cb4b8a-b610-47c3-814f-d1f1f195de3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:37.340457 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-19cb4b8a-b610-47c3-814f-d1f1f195de3b None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:57:37.341667 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-19cb4b8a-b610-47c3-814f-d1f1f195de3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:57:37.409336 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1147/2293] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:57:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:57:37.427656 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c892ac-eba7-494b-9856-0571bc76d8b6 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:37.429269 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-c3c892ac-eba7-494b-9856-0571bc76d8b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:57:37.512657 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c892ac-eba7-494b-9856-0571bc76d8b6 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:37.517352 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5947d9a5-45ec-40f5-bb46-cf3a4027e167 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:37.529834 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5947d9a5-45ec-40f5-bb46-cf3a4027e167 service neutron] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:37.529834 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5947d9a5-45ec-40f5-bb46-cf3a4027e167 service neutron] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:37.529834 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5947d9a5-45ec-40f5-bb46-cf3a4027e167 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:37.534481 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5947d9a5-45ec-40f5-bb46-cf3a4027e167 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:37.536621 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5947d9a5-45ec-40f5-bb46-cf3a4027e167 service neutron] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:37.547017 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1147/2294] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:57:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:57:37.867745 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cb4b8a-b610-47c3-814f-d1f1f195de3b None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:37.869303 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-19cb4b8a-b610-47c3-814f-d1f1f195de3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:57:37.884843 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cb4b8a-b610-47c3-814f-d1f1f195de3b None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:37.890803 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b435cdc9-9059-4391-89ba-c7553ec30e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:37.891915 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b435cdc9-9059-4391-89ba-c7553ec30e66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:37.892266 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b435cdc9-9059-4391-89ba-c7553ec30e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:37.892622 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b435cdc9-9059-4391-89ba-c7553ec30e66 admin admin] PATH_INFO: `/v3/projects/855c335e374e442f8d9f6d852503c3f3` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:37.895274 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b435cdc9-9059-4391-89ba-c7553ec30e66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=855c335e374e442f8d9f6d852503c3f3)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:37.897315 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b435cdc9-9059-4391-89ba-c7553ec30e66 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:37.947892 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-b435cdc9-9059-4391-89ba-c7553ec30e66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '855c335e374e442f8d9f6d852503c3f3', 'request_id': 'req-b435cdc9-9059-4391-89ba-c7553ec30e66'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:37.954831 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-b435cdc9-9059-4391-89ba-c7553ec30e66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '855c335e374e442f8d9f6d852503c3f3', 'request_id': 'req-b435cdc9-9059-4391-89ba-c7553ec30e66'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:37.964351 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-b435cdc9-9059-4391-89ba-c7553ec30e66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '855c335e374e442f8d9f6d852503c3f3', 'request_id': 'req-b435cdc9-9059-4391-89ba-c7553ec30e66'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:37.977411 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:57:37.983989 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-b435cdc9-9059-4391-89ba-c7553ec30e66 admin admin] The token cache is being invalidate because project 855c335e374e442f8d9f6d852503c3f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86773) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 17:57:37.984483 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-b435cdc9-9059-4391-89ba-c7553ec30e66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:37.985544 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-b435cdc9-9059-4391-89ba-c7553ec30e66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:37.988736 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1148/2295] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 14 17:57:37 2022] DELETE /identity/v3/projects/855c335e374e442f8d9f6d852503c3f3 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:57:37.995554 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0256f-ed0e-4ac2-bcdf-440913f8c744 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:37.996524 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0256f-ed0e-4ac2-bcdf-440913f8c744 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:37.996989 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0256f-ed0e-4ac2-bcdf-440913f8c744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:38.020245 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-52b0256f-ed0e-4ac2-bcdf-440913f8c744 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:57:38.021627 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-52b0256f-ed0e-4ac2-bcdf-440913f8c744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:57:38.098701 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1148/2296] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:57:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:57:38.108951 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d7a7e-770d-419c-a631-18cc37b91e59 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:38.108951 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d7a7e-770d-419c-a631-18cc37b91e59 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:38.108951 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d7a7e-770d-419c-a631-18cc37b91e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:38.130128 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-269d7a7e-770d-419c-a631-18cc37b91e59 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:57:38.132590 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-269d7a7e-770d-419c-a631-18cc37b91e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:57:38.150277 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1149/2297] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:57:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:57:38.154097 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b0256f-ed0e-4ac2-bcdf-440913f8c744 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:38.165854 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b0256f-ed0e-4ac2-bcdf-440913f8c744 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:38.173218 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51466ad6-2b80-4da2-8fba-1a0d5f8bdeb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:38.174001 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51466ad6-2b80-4da2-8fba-1a0d5f8bdeb7 admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:38.174347 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51466ad6-2b80-4da2-8fba-1a0d5f8bdeb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:38.174585 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51466ad6-2b80-4da2-8fba-1a0d5f8bdeb7 admin admin] PATH_INFO: `/v3/domains` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:38.175973 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51466ad6-2b80-4da2-8fba-1a0d5f8bdeb7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:57:38.176187 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51466ad6-2b80-4da2-8fba-1a0d5f8bdeb7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:38.178360 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51466ad6-2b80-4da2-8fba-1a0d5f8bdeb7 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:38.194641 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1149/2298] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 14 17:57:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:57:38.199351 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269d7a7e-770d-419c-a631-18cc37b91e59 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:38.209712 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269d7a7e-770d-419c-a631-18cc37b91e59 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:38.214922 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c68595-5f0c-42e7-9cb5-588504d5f502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:38.215604 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c68595-5f0c-42e7-9cb5-588504d5f502 admin admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:38.215884 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c68595-5f0c-42e7-9cb5-588504d5f502 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:38.216167 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c68595-5f0c-42e7-9cb5-588504d5f502 admin admin] PATH_INFO: `/v3/projects` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:38.216905 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c68595-5f0c-42e7-9cb5-588504d5f502 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:38.218961 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c68595-5f0c-42e7-9cb5-588504d5f502 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:38.248419 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1150/2299] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 14 17:57:38 2022] POST /identity/v3/projects => generated 389 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:57:38.252789 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51466ad6-2b80-4da2-8fba-1a0d5f8bdeb7 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:38.264088 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51466ad6-2b80-4da2-8fba-1a0d5f8bdeb7 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:38.268102 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:57:38.328046 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad374efd-e948-43e6-b86a-4936f0f9d82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:38.328746 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad374efd-e948-43e6-b86a-4936f0f9d82d admin admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:38.329013 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad374efd-e948-43e6-b86a-4936f0f9d82d admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:38.329294 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad374efd-e948-43e6-b86a-4936f0f9d82d admin admin] PATH_INFO: `/v3/users` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:38.330040 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad374efd-e948-43e6-b86a-4936f0f9d82d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:38.332016 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad374efd-e948-43e6-b86a-4936f0f9d82d admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:38.353892 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1150/2300] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 14 17:57:38 2022] POST /identity/v3/users => generated 295 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:57:38.359686 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c68595-5f0c-42e7-9cb5-588504d5f502 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:38.371493 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c68595-5f0c-42e7-9cb5-588504d5f502 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:38.376590 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2058d0b4-38bb-40be-bc94-06c96b942283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:38.377282 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2058d0b4-38bb-40be-bc94-06c96b942283 admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:38.377622 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2058d0b4-38bb-40be-bc94-06c96b942283 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:38.377920 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2058d0b4-38bb-40be-bc94-06c96b942283 admin admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:38.379327 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2058d0b4-38bb-40be-bc94-06c96b942283 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:38.380940 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2058d0b4-38bb-40be-bc94-06c96b942283 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:38.392095 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1151/2301] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:57:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:57:38.396396 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad374efd-e948-43e6-b86a-4936f0f9d82d admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:38.412300 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad374efd-e948-43e6-b86a-4936f0f9d82d admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:38.417155 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cd4e86-c2e4-4ee9-8fe0-50b254091dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:38.417892 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd4e86-c2e4-4ee9-8fe0-50b254091dc0 admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:38.418158 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd4e86-c2e4-4ee9-8fe0-50b254091dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:38.418432 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd4e86-c2e4-4ee9-8fe0-50b254091dc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:38.419167 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cd4e86-c2e4-4ee9-8fe0-50b254091dc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:38.420752 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cd4e86-c2e4-4ee9-8fe0-50b254091dc0 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:38.432306 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1151/2302] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:57:38 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:57:38.437370 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2058d0b4-38bb-40be-bc94-06c96b942283 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:38.448557 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2058d0b4-38bb-40be-bc94-06c96b942283 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:38.462571 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3690f8-becd-40b5-9439-0f55965c2e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:38.464033 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3690f8-becd-40b5-9439-0f55965c2e94 admin admin] REQUEST_METHOD: `PUT` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:38.464532 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3690f8-becd-40b5-9439-0f55965c2e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:38.465019 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3690f8-becd-40b5-9439-0f55965c2e94 admin admin] PATH_INFO: `/v3/projects/e0469631bd8b4d46996d4738d4cf17e5/users/256c49ce6d154fbf813478051b1e9496/roles/95d753870f97426cb1ce32e078621a4c` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:38.482776 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3690f8-becd-40b5-9439-0f55965c2e94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0469631bd8b4d46996d4738d4cf17e5, user_id=256c49ce6d154fbf813478051b1e9496, role_id=95d753870f97426cb1ce32e078621a4c)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:38.485492 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3690f8-becd-40b5-9439-0f55965c2e94 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:38.500417 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1152/2303] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 17:57:38 2022] PUT /identity/v3/projects/e0469631bd8b4d46996d4738d4cf17e5/users/256c49ce6d154fbf813478051b1e9496/roles/95d753870f97426cb1ce32e078621a4c => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:57:38.510896 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f8ed21-7bbf-460a-9fd2-fbe491b49cfe None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:38.511183 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f8ed21-7bbf-460a-9fd2-fbe491b49cfe None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:38.511480 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f8ed21-7bbf-460a-9fd2-fbe491b49cfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:38.539285 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-c3f8ed21-7bbf-460a-9fd2-fbe491b49cfe None None] MFA Rules not processed for user `256c49ce6d154fbf813478051b1e9496`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:57:38.540504 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-c3f8ed21-7bbf-460a-9fd2-fbe491b49cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:57:38.622243 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1152/2304] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:57:38 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:57:38.633465 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3690f8-becd-40b5-9439-0f55965c2e94 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:38.635215 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-1a3690f8-becd-40b5-9439-0f55965c2e94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:57:38.694733 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3690f8-becd-40b5-9439-0f55965c2e94 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:38.698367 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4fb079-3bd0-43dc-87c2-9913b0c4b54d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de55cae1600841889668e36402861203', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:38.699029 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4fb079-3bd0-43dc-87c2-9913b0c4b54d service cinder] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:38.699315 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4fb079-3bd0-43dc-87c2-9913b0c4b54d service cinder] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:38.699588 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4fb079-3bd0-43dc-87c2-9913b0c4b54d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:38.708716 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4fb079-3bd0-43dc-87c2-9913b0c4b54d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:38.710211 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4fb079-3bd0-43dc-87c2-9913b0c4b54d service cinder] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:38.719939 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1153/2305] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:57:38 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:57:40.210786 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0000556-558f-41f7-81ae-ea6424d5e6b4 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:40.211297 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0000556-558f-41f7-81ae-ea6424d5e6b4 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:40.211402 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0000556-558f-41f7-81ae-ea6424d5e6b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:40.230130 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-e0000556-558f-41f7-81ae-ea6424d5e6b4 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:57:40.231392 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-e0000556-558f-41f7-81ae-ea6424d5e6b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:57:40.296757 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1153/2306] 10.222.0.40 () {58 vars in 1016 bytes} [Thu Jul 14 17:57:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:57:40.346444 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4fb079-3bd0-43dc-87c2-9913b0c4b54d service cinder] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:40.347990 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-7b4fb079-3bd0-43dc-87c2-9913b0c4b54d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:57:40.446614 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4fb079-3bd0-43dc-87c2-9913b0c4b54d service cinder] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:40.452152 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc79d4b6-293d-4190-ae70-45cc21098200 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41b893bdf4ec474dbfa819c22fc29ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:40.452825 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79d4b6-293d-4190-ae70-45cc21098200 service nova] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:40.456883 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79d4b6-293d-4190-ae70-45cc21098200 service nova] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:40.456883 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79d4b6-293d-4190-ae70-45cc21098200 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:40.463811 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc79d4b6-293d-4190-ae70-45cc21098200 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:40.466558 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc79d4b6-293d-4190-ae70-45cc21098200 service nova] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:40.479420 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1154/2307] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:57:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 17:57:41.511898 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d067c-a091-4e8c-af2d-7a4fdeb02d15 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:41.512447 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d067c-a091-4e8c-af2d-7a4fdeb02d15 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:41.512544 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d067c-a091-4e8c-af2d-7a4fdeb02d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:41.536330 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-ce3d067c-a091-4e8c-af2d-7a4fdeb02d15 None None] MFA Rules not processed for user `eb82471499754e30a4dc121c40b208a3`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:57:41.537620 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-ce3d067c-a091-4e8c-af2d-7a4fdeb02d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:57:41.547340 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:57:41.593682 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1154/2308] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:57:41 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:57:46.249362 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc79d4b6-293d-4190-ae70-45cc21098200 service nova] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:46.251047 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-bc79d4b6-293d-4190-ae70-45cc21098200 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:57:46.301088 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc79d4b6-293d-4190-ae70-45cc21098200 service nova] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:46.308008 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270d23ac-fa72-4625-ac47-833e567972d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:46.309166 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270d23ac-fa72-4625-ac47-833e567972d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:46.309451 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270d23ac-fa72-4625-ac47-833e567972d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:46.309785 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270d23ac-fa72-4625-ac47-833e567972d0 admin admin] PATH_INFO: `/v3/users/777bd98166b74354981a7cc6a2a51511` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:46.311805 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270d23ac-fa72-4625-ac47-833e567972d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=777bd98166b74354981a7cc6a2a51511)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:46.315388 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270d23ac-fa72-4625-ac47-833e567972d0 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:46.360541 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:57:46.428807 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-270d23ac-fa72-4625-ac47-833e567972d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '777bd98166b74354981a7cc6a2a51511'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:46.443687 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-270d23ac-fa72-4625-ac47-833e567972d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '777bd98166b74354981a7cc6a2a51511'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:46.476949 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-270d23ac-fa72-4625-ac47-833e567972d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '777bd98166b74354981a7cc6a2a51511'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:46.479772 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-270d23ac-fa72-4625-ac47-833e567972d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '777bd98166b74354981a7cc6a2a51511'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:46.483804 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-270d23ac-fa72-4625-ac47-833e567972d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '777bd98166b74354981a7cc6a2a51511'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:46.507457 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c108810-4d72-4453-bd72-4c30d94e9e4a None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:46.508391 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c108810-4d72-4453-bd72-4c30d94e9e4a None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:46.508855 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c108810-4d72-4453-bd72-4c30d94e9e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:46.513395 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1155/2309] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 14 17:57:46 2022] DELETE /identity/v3/users/777bd98166b74354981a7cc6a2a51511 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:57:46.519101 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c423d7-7be9-466f-a5b3-f2f85be2cf1b None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:46.519624 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c423d7-7be9-466f-a5b3-f2f85be2cf1b None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:46.520615 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c423d7-7be9-466f-a5b3-f2f85be2cf1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:46.534335 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-5c108810-4d72-4453-bd72-4c30d94e9e4a None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:57:46.536232 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-5c108810-4d72-4453-bd72-4c30d94e9e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:57:46.559248 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-25c423d7-7be9-466f-a5b3-f2f85be2cf1b None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:57:46.560492 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-25c423d7-7be9-466f-a5b3-f2f85be2cf1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:57:46.630907 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1155/2310] 10.222.0.40 () {58 vars in 1016 bytes} [Thu Jul 14 17:57:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:57:46.633581 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1156/2311] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:57:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:57:46.644649 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c108810-4d72-4453-bd72-4c30d94e9e4a None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:46.647109 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-5c108810-4d72-4453-bd72-4c30d94e9e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:57:46.653959 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c423d7-7be9-466f-a5b3-f2f85be2cf1b None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:46.655618 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-25c423d7-7be9-466f-a5b3-f2f85be2cf1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:57:46.744298 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c108810-4d72-4453-bd72-4c30d94e9e4a None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:46.748338 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebde81c-0bf2-4427-b210-0a738df09d50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:46.749116 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebde81c-0bf2-4427-b210-0a738df09d50 service neutron] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:46.749405 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebde81c-0bf2-4427-b210-0a738df09d50 service neutron] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:46.749782 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebde81c-0bf2-4427-b210-0a738df09d50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:46.761414 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebde81c-0bf2-4427-b210-0a738df09d50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:46.763087 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebde81c-0bf2-4427-b210-0a738df09d50 service neutron] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:46.769378 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c423d7-7be9-466f-a5b3-f2f85be2cf1b None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:46.775179 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1156/2312] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:57:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:57:46.778983 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64bc7bb-7deb-4cab-a08a-dca300e39cec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41b893bdf4ec474dbfa819c22fc29ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:46.779780 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64bc7bb-7deb-4cab-a08a-dca300e39cec service nova] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:46.780137 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64bc7bb-7deb-4cab-a08a-dca300e39cec service nova] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:46.780432 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64bc7bb-7deb-4cab-a08a-dca300e39cec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:46.795995 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64bc7bb-7deb-4cab-a08a-dca300e39cec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:46.798062 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64bc7bb-7deb-4cab-a08a-dca300e39cec service nova] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:46.816017 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1157/2313] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:57:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:57:47.129091 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebde81c-0bf2-4427-b210-0a738df09d50 service neutron] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:47.130761 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-eebde81c-0bf2-4427-b210-0a738df09d50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:57:47.146887 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebde81c-0bf2-4427-b210-0a738df09d50 service neutron] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:47.151859 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52e45f8-b17f-4814-be6b-2ed575a40316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:47.152820 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e45f8-b17f-4814-be6b-2ed575a40316 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:47.153207 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e45f8-b17f-4814-be6b-2ed575a40316 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:47.153588 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e45f8-b17f-4814-be6b-2ed575a40316 admin admin] PATH_INFO: `/v3/projects/988a8b34db124fa2a3e57ace8048b4ab` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:47.155091 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52e45f8-b17f-4814-be6b-2ed575a40316 admin admin] RBAC: Authorizing `identity:delete_project(project_id=988a8b34db124fa2a3e57ace8048b4ab)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:47.157597 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52e45f8-b17f-4814-be6b-2ed575a40316 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:47.211529 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-a52e45f8-b17f-4814-be6b-2ed575a40316 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '988a8b34db124fa2a3e57ace8048b4ab', 'request_id': 'req-a52e45f8-b17f-4814-be6b-2ed575a40316'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:47.217590 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-a52e45f8-b17f-4814-be6b-2ed575a40316 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '988a8b34db124fa2a3e57ace8048b4ab', 'request_id': 'req-a52e45f8-b17f-4814-be6b-2ed575a40316'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:47.219328 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:57:47.231124 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-a52e45f8-b17f-4814-be6b-2ed575a40316 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '988a8b34db124fa2a3e57ace8048b4ab', 'request_id': 'req-a52e45f8-b17f-4814-be6b-2ed575a40316'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:47.244225 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-a52e45f8-b17f-4814-be6b-2ed575a40316 admin admin] The token cache is being invalidate because project 988a8b34db124fa2a3e57ace8048b4ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86772) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 17:57:47.244515 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-a52e45f8-b17f-4814-be6b-2ed575a40316 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:47.245193 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-a52e45f8-b17f-4814-be6b-2ed575a40316 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:47.246800 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1157/2314] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 14 17:57:47 2022] DELETE /identity/v3/projects/988a8b34db124fa2a3e57ace8048b4ab => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:57:47.251807 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13085f5e-9c26-4a81-9b41-4cfd201b340b None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:47.252340 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13085f5e-9c26-4a81-9b41-4cfd201b340b None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:47.252441 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13085f5e-9c26-4a81-9b41-4cfd201b340b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:47.274976 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-13085f5e-9c26-4a81-9b41-4cfd201b340b None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:57:47.276175 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-13085f5e-9c26-4a81-9b41-4cfd201b340b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:57:47.296939 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:57:47.354352 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1158/2315] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:57:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:57:47.362357 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaff9ac-0ff3-4346-9e56-0c7e09753288 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:47.362652 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaff9ac-0ff3-4346-9e56-0c7e09753288 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:47.362933 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaff9ac-0ff3-4346-9e56-0c7e09753288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:47.382609 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-ccaff9ac-0ff3-4346-9e56-0c7e09753288 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:57:47.383839 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-ccaff9ac-0ff3-4346-9e56-0c7e09753288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:57:47.391733 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1158/2316] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:57:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:57:47.396857 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13085f5e-9c26-4a81-9b41-4cfd201b340b None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:47.406991 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13085f5e-9c26-4a81-9b41-4cfd201b340b None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:47.412826 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57afe429-836a-493a-9b91-ba570b28c3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:47.413504 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57afe429-836a-493a-9b91-ba570b28c3b4 admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:47.413827 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57afe429-836a-493a-9b91-ba570b28c3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:47.414104 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57afe429-836a-493a-9b91-ba570b28c3b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:47.414845 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57afe429-836a-493a-9b91-ba570b28c3b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:57:47.415149 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57afe429-836a-493a-9b91-ba570b28c3b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:47.416751 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57afe429-836a-493a-9b91-ba570b28c3b4 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:47.429779 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1159/2317] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 14 17:57:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:57:47.438166 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaff9ac-0ff3-4346-9e56-0c7e09753288 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:47.448674 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaff9ac-0ff3-4346-9e56-0c7e09753288 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:47.453518 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d30485-1ad3-4db2-91af-6b1727b3eb98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:47.454230 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d30485-1ad3-4db2-91af-6b1727b3eb98 admin admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:47.454518 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d30485-1ad3-4db2-91af-6b1727b3eb98 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:47.454806 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d30485-1ad3-4db2-91af-6b1727b3eb98 admin admin] PATH_INFO: `/v3/projects` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:47.455537 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d30485-1ad3-4db2-91af-6b1727b3eb98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:47.457515 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d30485-1ad3-4db2-91af-6b1727b3eb98 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:47.490020 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1159/2318] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 14 17:57:47 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:57:47.491477 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57afe429-836a-493a-9b91-ba570b28c3b4 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:47.502262 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57afe429-836a-493a-9b91-ba570b28c3b4 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:47.562325 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e59fa71-f2b2-4c3a-91f0-dc62cc3cb3de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:47.563002 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e59fa71-f2b2-4c3a-91f0-dc62cc3cb3de admin admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:47.563291 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e59fa71-f2b2-4c3a-91f0-dc62cc3cb3de admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:47.563569 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e59fa71-f2b2-4c3a-91f0-dc62cc3cb3de admin admin] PATH_INFO: `/v3/users` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:47.564429 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e59fa71-f2b2-4c3a-91f0-dc62cc3cb3de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:47.566382 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e59fa71-f2b2-4c3a-91f0-dc62cc3cb3de admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:47.585425 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1160/2319] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 14 17:57:47 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:57:47.589606 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d30485-1ad3-4db2-91af-6b1727b3eb98 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:47.600487 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d30485-1ad3-4db2-91af-6b1727b3eb98 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:47.605121 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193d10d9-4b39-4f27-8712-5a3a8c742b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:47.605823 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193d10d9-4b39-4f27-8712-5a3a8c742b21 admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:47.606128 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193d10d9-4b39-4f27-8712-5a3a8c742b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:47.606407 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193d10d9-4b39-4f27-8712-5a3a8c742b21 admin admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:47.607167 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193d10d9-4b39-4f27-8712-5a3a8c742b21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:47.608792 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193d10d9-4b39-4f27-8712-5a3a8c742b21 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:47.620710 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1160/2320] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:57:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:57:47.625123 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e59fa71-f2b2-4c3a-91f0-dc62cc3cb3de admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:47.636392 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e59fa71-f2b2-4c3a-91f0-dc62cc3cb3de admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:47.642043 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f730490-068d-4125-9148-1f060c3aaa4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:47.642743 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f730490-068d-4125-9148-1f060c3aaa4e admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:47.643024 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f730490-068d-4125-9148-1f060c3aaa4e admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:47.643296 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f730490-068d-4125-9148-1f060c3aaa4e admin admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:47.644020 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f730490-068d-4125-9148-1f060c3aaa4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:47.646022 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f730490-068d-4125-9148-1f060c3aaa4e admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:47.660026 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1161/2321] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:57:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:57:47.662233 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193d10d9-4b39-4f27-8712-5a3a8c742b21 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:47.673349 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193d10d9-4b39-4f27-8712-5a3a8c742b21 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:47.681371 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d7c54-a52c-4479-bb0e-6acdc4601aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:47.682357 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d7c54-a52c-4479-bb0e-6acdc4601aa0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:47.682743 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d7c54-a52c-4479-bb0e-6acdc4601aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:47.682914 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d7c54-a52c-4479-bb0e-6acdc4601aa0 admin admin] PATH_INFO: `/v3/projects/9f82f29a3fc7453da767acc34e505c2a/users/099950eba8044c7ea876441d956f357b/roles/95d753870f97426cb1ce32e078621a4c` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:47.701911 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524d7c54-a52c-4479-bb0e-6acdc4601aa0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f82f29a3fc7453da767acc34e505c2a, user_id=099950eba8044c7ea876441d956f357b, role_id=95d753870f97426cb1ce32e078621a4c)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:47.704590 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524d7c54-a52c-4479-bb0e-6acdc4601aa0 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:47.719462 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1161/2322] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 17:57:47 2022] PUT /identity/v3/projects/9f82f29a3fc7453da767acc34e505c2a/users/099950eba8044c7ea876441d956f357b/roles/95d753870f97426cb1ce32e078621a4c => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:57:47.738550 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da86871b-1950-456e-b765-e5966a7ebb12 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:47.738931 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da86871b-1950-456e-b765-e5966a7ebb12 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:47.739685 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da86871b-1950-456e-b765-e5966a7ebb12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:47.769872 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-da86871b-1950-456e-b765-e5966a7ebb12 None None] MFA Rules not processed for user `099950eba8044c7ea876441d956f357b`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:57:47.771303 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-da86871b-1950-456e-b765-e5966a7ebb12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:57:47.841356 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1162/2323] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:57:47 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:57:47.846567 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d7c54-a52c-4479-bb0e-6acdc4601aa0 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:47.918933 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d7c54-a52c-4479-bb0e-6acdc4601aa0 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:47.923695 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f917d1f-abd7-49e6-8757-d2cf85d2c2bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:47.924371 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f917d1f-abd7-49e6-8757-d2cf85d2c2bd admin admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:47.924650 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f917d1f-abd7-49e6-8757-d2cf85d2c2bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:47.924924 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f917d1f-abd7-49e6-8757-d2cf85d2c2bd admin admin] PATH_INFO: `/v3/projects` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:47.925677 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f917d1f-abd7-49e6-8757-d2cf85d2c2bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:47.928117 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f917d1f-abd7-49e6-8757-d2cf85d2c2bd admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:47.961591 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1162/2324] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 14 17:57:47 2022] POST /identity/v3/projects => generated 375 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 17:57:47.966000 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da86871b-1950-456e-b765-e5966a7ebb12 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:47.980491 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da86871b-1950-456e-b765-e5966a7ebb12 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:47.995301 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:57:48.049146 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94c5e73-04ec-4c9e-9bfa-ad1e4ac696c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:48.049872 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94c5e73-04ec-4c9e-9bfa-ad1e4ac696c2 admin admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:48.050157 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94c5e73-04ec-4c9e-9bfa-ad1e4ac696c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:48.050434 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94c5e73-04ec-4c9e-9bfa-ad1e4ac696c2 admin admin] PATH_INFO: `/v3/users` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:48.051133 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94c5e73-04ec-4c9e-9bfa-ad1e4ac696c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:48.053718 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94c5e73-04ec-4c9e-9bfa-ad1e4ac696c2 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:48.078993 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1163/2325] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 14 17:57:47 2022] POST /identity/v3/users => generated 294 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:57:48.082968 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f917d1f-abd7-49e6-8757-d2cf85d2c2bd admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:48.094198 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f917d1f-abd7-49e6-8757-d2cf85d2c2bd admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:48.099141 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281c300f-8367-4e9f-9c2b-4d3b2f02fcbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:48.099826 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c300f-8367-4e9f-9c2b-4d3b2f02fcbe admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:48.100107 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c300f-8367-4e9f-9c2b-4d3b2f02fcbe admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:48.100385 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c300f-8367-4e9f-9c2b-4d3b2f02fcbe admin admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:48.101121 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281c300f-8367-4e9f-9c2b-4d3b2f02fcbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:48.102763 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281c300f-8367-4e9f-9c2b-4d3b2f02fcbe admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:48.115458 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1163/2326] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:57:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:57:48.119868 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94c5e73-04ec-4c9e-9bfa-ad1e4ac696c2 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:48.131096 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94c5e73-04ec-4c9e-9bfa-ad1e4ac696c2 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:48.136473 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951a0814-70ab-4d2a-b01e-a02144ebd6fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:48.137474 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951a0814-70ab-4d2a-b01e-a02144ebd6fb admin admin] REQUEST_METHOD: `PUT` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:48.137793 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951a0814-70ab-4d2a-b01e-a02144ebd6fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:48.138070 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951a0814-70ab-4d2a-b01e-a02144ebd6fb admin admin] PATH_INFO: `/v3/projects/a524542e2aab451484f4ac5ed47060d7/users/498b2e68a0f04e158fe1440ee727a6ff/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:48.154501 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951a0814-70ab-4d2a-b01e-a02144ebd6fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=a524542e2aab451484f4ac5ed47060d7, user_id=498b2e68a0f04e158fe1440ee727a6ff, role_id=4651a1cc7b4d4ab7a7a9ca1e77e58e71)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:48.157168 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951a0814-70ab-4d2a-b01e-a02144ebd6fb admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:48.172440 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1164/2327] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 17:57:48 2022] PUT /identity/v3/projects/a524542e2aab451484f4ac5ed47060d7/users/498b2e68a0f04e158fe1440ee727a6ff/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:57:48.177679 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281c300f-8367-4e9f-9c2b-4d3b2f02fcbe admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:48.188300 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281c300f-8367-4e9f-9c2b-4d3b2f02fcbe admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:48.241997 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:57:48.249629 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dc206d-7aa9-46f3-bb00-85097bf19c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:48.250741 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc206d-7aa9-46f3-bb00-85097bf19c28 admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:48.251050 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc206d-7aa9-46f3-bb00-85097bf19c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:48.251409 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc206d-7aa9-46f3-bb00-85097bf19c28 admin admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:48.252192 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dc206d-7aa9-46f3-bb00-85097bf19c28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:48.254209 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dc206d-7aa9-46f3-bb00-85097bf19c28 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:48.264661 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1164/2328] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:57:48 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:57:48.269052 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951a0814-70ab-4d2a-b01e-a02144ebd6fb admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:48.279536 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951a0814-70ab-4d2a-b01e-a02144ebd6fb admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:48.284312 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9145c99d-19db-4213-8108-f54cf637fd89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:48.285230 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9145c99d-19db-4213-8108-f54cf637fd89 admin admin] REQUEST_METHOD: `PUT` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:48.285509 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9145c99d-19db-4213-8108-f54cf637fd89 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:48.286347 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9145c99d-19db-4213-8108-f54cf637fd89 admin admin] PATH_INFO: `/v3/projects/a524542e2aab451484f4ac5ed47060d7/users/498b2e68a0f04e158fe1440ee727a6ff/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:48.288369 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9145c99d-19db-4213-8108-f54cf637fd89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a524542e2aab451484f4ac5ed47060d7, user_id=498b2e68a0f04e158fe1440ee727a6ff, role_id=4651a1cc7b4d4ab7a7a9ca1e77e58e71)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:48.291041 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9145c99d-19db-4213-8108-f54cf637fd89 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:48.302747 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1165/2329] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 17:57:48 2022] PUT /identity/v3/projects/a524542e2aab451484f4ac5ed47060d7/users/498b2e68a0f04e158fe1440ee727a6ff/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 17:57:48.313764 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf55b06-f674-4bae-9d77-76a1153512d6 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:48.314108 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf55b06-f674-4bae-9d77-76a1153512d6 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:48.314430 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf55b06-f674-4bae-9d77-76a1153512d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:48.343049 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-4bf55b06-f674-4bae-9d77-76a1153512d6 None None] MFA Rules not processed for user `498b2e68a0f04e158fe1440ee727a6ff`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:57:48.344448 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-4bf55b06-f674-4bae-9d77-76a1153512d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:57:48.425357 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1165/2330] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:57:48 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:57:48.437189 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9145c99d-19db-4213-8108-f54cf637fd89 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:48.438953 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-9145c99d-19db-4213-8108-f54cf637fd89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:57:48.497963 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9145c99d-19db-4213-8108-f54cf637fd89 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:48.501615 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deda8b1-c525-40af-af02-415fe6fc3f05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de55cae1600841889668e36402861203', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:48.502272 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deda8b1-c525-40af-af02-415fe6fc3f05 service cinder] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:48.502552 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deda8b1-c525-40af-af02-415fe6fc3f05 service cinder] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:48.502825 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deda8b1-c525-40af-af02-415fe6fc3f05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:48.565480 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4deda8b1-c525-40af-af02-415fe6fc3f05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:48.566982 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4deda8b1-c525-40af-af02-415fe6fc3f05 service cinder] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:48.576507 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1166/2331] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:57:48 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:57:51.128676 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf55b06-f674-4bae-9d77-76a1153512d6 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:51.193584 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf55b06-f674-4bae-9d77-76a1153512d6 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:51.198670 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e352db-a9fe-4ca8-9969-6d57da929a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:51.199625 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e352db-a9fe-4ca8-9969-6d57da929a9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:51.199939 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e352db-a9fe-4ca8-9969-6d57da929a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:51.200208 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e352db-a9fe-4ca8-9969-6d57da929a9c admin admin] PATH_INFO: `/v3/users/099950eba8044c7ea876441d956f357b` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:51.201398 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e352db-a9fe-4ca8-9969-6d57da929a9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=099950eba8044c7ea876441d956f357b)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:51.203377 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e352db-a9fe-4ca8-9969-6d57da929a9c admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:51.254077 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-02e352db-a9fe-4ca8-9969-6d57da929a9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '099950eba8044c7ea876441d956f357b'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:51.262594 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-02e352db-a9fe-4ca8-9969-6d57da929a9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '099950eba8044c7ea876441d956f357b'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:51.269863 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-02e352db-a9fe-4ca8-9969-6d57da929a9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '099950eba8044c7ea876441d956f357b'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:51.271019 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-02e352db-a9fe-4ca8-9969-6d57da929a9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '099950eba8044c7ea876441d956f357b'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:51.283833 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-02e352db-a9fe-4ca8-9969-6d57da929a9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '099950eba8044c7ea876441d956f357b'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:51.285293 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:57:51.291428 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1166/2332] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 14 17:57:51 2022] DELETE /identity/v3/users/099950eba8044c7ea876441d956f357b => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:57:51.296106 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd11ff-3769-4137-8036-0efbf6e47f25 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:51.296594 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd11ff-3769-4137-8036-0efbf6e47f25 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:51.296688 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd11ff-3769-4137-8036-0efbf6e47f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:51.318095 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-8fcd11ff-3769-4137-8036-0efbf6e47f25 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:57:51.320225 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-8fcd11ff-3769-4137-8036-0efbf6e47f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:57:51.340097 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:57:51.389943 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1167/2333] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:57:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:57:51.401870 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e352db-a9fe-4ca8-9969-6d57da929a9c admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:51.403459 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-02e352db-a9fe-4ca8-9969-6d57da929a9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:57:51.486368 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e352db-a9fe-4ca8-9969-6d57da929a9c admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:51.491790 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbb9fe0-c928-4be9-ab27-13526bb09af3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:51.491790 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbb9fe0-c928-4be9-ab27-13526bb09af3 service neutron] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:51.491790 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbb9fe0-c928-4be9-ab27-13526bb09af3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:51.491790 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbb9fe0-c928-4be9-ab27-13526bb09af3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:51.502179 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbb9fe0-c928-4be9-ab27-13526bb09af3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:51.503662 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbb9fe0-c928-4be9-ab27-13526bb09af3 service neutron] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:51.514436 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1167/2334] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:57:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:57:51.784073 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcd11ff-3769-4137-8036-0efbf6e47f25 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:51.785598 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-8fcd11ff-3769-4137-8036-0efbf6e47f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:57:51.798264 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcd11ff-3769-4137-8036-0efbf6e47f25 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:51.803855 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7261fcbb-f34e-4fae-948f-9d7805e7b945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:51.804814 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7261fcbb-f34e-4fae-948f-9d7805e7b945 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:51.805172 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7261fcbb-f34e-4fae-948f-9d7805e7b945 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:51.805456 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7261fcbb-f34e-4fae-948f-9d7805e7b945 admin admin] PATH_INFO: `/v3/projects/9f82f29a3fc7453da767acc34e505c2a` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:51.806831 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7261fcbb-f34e-4fae-948f-9d7805e7b945 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f82f29a3fc7453da767acc34e505c2a)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:51.809039 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7261fcbb-f34e-4fae-948f-9d7805e7b945 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:51.860288 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-7261fcbb-f34e-4fae-948f-9d7805e7b945 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f82f29a3fc7453da767acc34e505c2a', 'request_id': 'req-7261fcbb-f34e-4fae-948f-9d7805e7b945'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:51.866623 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-7261fcbb-f34e-4fae-948f-9d7805e7b945 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f82f29a3fc7453da767acc34e505c2a', 'request_id': 'req-7261fcbb-f34e-4fae-948f-9d7805e7b945'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:51.872545 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-7261fcbb-f34e-4fae-948f-9d7805e7b945 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f82f29a3fc7453da767acc34e505c2a', 'request_id': 'req-7261fcbb-f34e-4fae-948f-9d7805e7b945'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:51.884527 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-7261fcbb-f34e-4fae-948f-9d7805e7b945 admin admin] The token cache is being invalidate because project 9f82f29a3fc7453da767acc34e505c2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86773) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 17:57:51.884820 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-7261fcbb-f34e-4fae-948f-9d7805e7b945 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:51.885449 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-7261fcbb-f34e-4fae-948f-9d7805e7b945 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:51.887092 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1168/2335] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 14 17:57:51 2022] DELETE /identity/v3/projects/9f82f29a3fc7453da767acc34e505c2a => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:57:51.891087 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbb9fe0-c928-4be9-ab27-13526bb09af3 service neutron] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:51.901387 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbb9fe0-c928-4be9-ab27-13526bb09af3 service neutron] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:51.957620 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce725a0c-d213-4af3-b70d-e865e3d6b9ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:51.959143 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce725a0c-d213-4af3-b70d-e865e3d6b9ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:51.959429 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce725a0c-d213-4af3-b70d-e865e3d6b9ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:51.959707 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce725a0c-d213-4af3-b70d-e865e3d6b9ad admin admin] PATH_INFO: `/v3/users/498b2e68a0f04e158fe1440ee727a6ff` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:51.960915 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce725a0c-d213-4af3-b70d-e865e3d6b9ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=498b2e68a0f04e158fe1440ee727a6ff)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:51.962879 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce725a0c-d213-4af3-b70d-e865e3d6b9ad admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:52.010159 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-ce725a0c-d213-4af3-b70d-e865e3d6b9ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '498b2e68a0f04e158fe1440ee727a6ff'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:52.017974 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-ce725a0c-d213-4af3-b70d-e865e3d6b9ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '498b2e68a0f04e158fe1440ee727a6ff'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:52.026439 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-ce725a0c-d213-4af3-b70d-e865e3d6b9ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '498b2e68a0f04e158fe1440ee727a6ff'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:52.027131 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-ce725a0c-d213-4af3-b70d-e865e3d6b9ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '498b2e68a0f04e158fe1440ee727a6ff'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:52.040141 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-ce725a0c-d213-4af3-b70d-e865e3d6b9ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '498b2e68a0f04e158fe1440ee727a6ff'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:52.048659 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1168/2336] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 14 17:57:51 2022] DELETE /identity/v3/users/498b2e68a0f04e158fe1440ee727a6ff => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:57:52.303091 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7261fcbb-f34e-4fae-948f-9d7805e7b945 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:52.305419 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-7261fcbb-f34e-4fae-948f-9d7805e7b945 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:57:52.319694 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7261fcbb-f34e-4fae-948f-9d7805e7b945 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:52.352331 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce725a0c-d213-4af3-b70d-e865e3d6b9ad admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:52.354863 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-ce725a0c-d213-4af3-b70d-e865e3d6b9ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:57:52.395195 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:57:52.395352 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eab9878-a3e5-4006-a89c-7041ca02bee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:52.396236 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eab9878-a3e5-4006-a89c-7041ca02bee2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:52.396776 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eab9878-a3e5-4006-a89c-7041ca02bee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:52.397138 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eab9878-a3e5-4006-a89c-7041ca02bee2 admin admin] PATH_INFO: `/v3/users/256c49ce6d154fbf813478051b1e9496` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:52.400085 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eab9878-a3e5-4006-a89c-7041ca02bee2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=256c49ce6d154fbf813478051b1e9496)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:52.403107 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eab9878-a3e5-4006-a89c-7041ca02bee2 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:52.453793 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce725a0c-d213-4af3-b70d-e865e3d6b9ad admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:52.462718 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10d4c1e-f188-4acc-8503-63b17400102b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:52.463840 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d4c1e-f188-4acc-8503-63b17400102b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:52.464279 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d4c1e-f188-4acc-8503-63b17400102b admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:52.464701 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d4c1e-f188-4acc-8503-63b17400102b admin admin] PATH_INFO: `/v3/projects/a524542e2aab451484f4ac5ed47060d7` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:52.464897 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-8eab9878-a3e5-4006-a89c-7041ca02bee2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '256c49ce6d154fbf813478051b1e9496'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:52.466465 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10d4c1e-f188-4acc-8503-63b17400102b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a524542e2aab451484f4ac5ed47060d7)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:52.466982 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:57:52.468841 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10d4c1e-f188-4acc-8503-63b17400102b admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:52.475841 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-8eab9878-a3e5-4006-a89c-7041ca02bee2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '256c49ce6d154fbf813478051b1e9496'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:52.491191 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-8eab9878-a3e5-4006-a89c-7041ca02bee2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '256c49ce6d154fbf813478051b1e9496'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:52.492005 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-8eab9878-a3e5-4006-a89c-7041ca02bee2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '256c49ce6d154fbf813478051b1e9496'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:52.492609 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-8eab9878-a3e5-4006-a89c-7041ca02bee2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '256c49ce6d154fbf813478051b1e9496'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:52.517096 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1169/2337] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 14 17:57:52 2022] DELETE /identity/v3/users/256c49ce6d154fbf813478051b1e9496 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:57:52.523227 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75de992-471c-464b-92ed-f181b2308df5 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:52.523725 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75de992-471c-464b-92ed-f181b2308df5 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:52.524307 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75de992-471c-464b-92ed-f181b2308df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:52.537261 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-e10d4c1e-f188-4acc-8503-63b17400102b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a524542e2aab451484f4ac5ed47060d7', 'request_id': 'req-e10d4c1e-f188-4acc-8503-63b17400102b'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:52.544223 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-e10d4c1e-f188-4acc-8503-63b17400102b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a524542e2aab451484f4ac5ed47060d7', 'request_id': 'req-e10d4c1e-f188-4acc-8503-63b17400102b'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:52.552449 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-a75de992-471c-464b-92ed-f181b2308df5 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:57:52.553808 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-e10d4c1e-f188-4acc-8503-63b17400102b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a524542e2aab451484f4ac5ed47060d7', 'request_id': 'req-e10d4c1e-f188-4acc-8503-63b17400102b'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:52.554118 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-a75de992-471c-464b-92ed-f181b2308df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:57:52.566022 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-e10d4c1e-f188-4acc-8503-63b17400102b admin admin] The token cache is being invalidate because project a524542e2aab451484f4ac5ed47060d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86772) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 17:57:52.566309 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-e10d4c1e-f188-4acc-8503-63b17400102b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:52.566979 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-e10d4c1e-f188-4acc-8503-63b17400102b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:52.568979 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1169/2338] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 14 17:57:52 2022] DELETE /identity/v3/projects/a524542e2aab451484f4ac5ed47060d7 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:57:52.574161 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ea8cd5-3fff-4d64-9c3d-a34cc17f6b0a None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:52.574542 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ea8cd5-3fff-4d64-9c3d-a34cc17f6b0a None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:52.574897 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ea8cd5-3fff-4d64-9c3d-a34cc17f6b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:52.599630 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-f4ea8cd5-3fff-4d64-9c3d-a34cc17f6b0a None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:57:52.600984 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-f4ea8cd5-3fff-4d64-9c3d-a34cc17f6b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:57:52.623940 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1170/2339] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:57:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:57:52.634166 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75de992-471c-464b-92ed-f181b2308df5 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:52.635774 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-a75de992-471c-464b-92ed-f181b2308df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:57:52.666257 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1170/2340] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:57:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 17:57:52.675045 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf40ccf-d673-449d-a692-61e996cf4076 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:52.675333 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf40ccf-d673-449d-a692-61e996cf4076 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:52.675612 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf40ccf-d673-449d-a692-61e996cf4076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:52.694501 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-2bf40ccf-d673-449d-a692-61e996cf4076 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:57:52.695697 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-2bf40ccf-d673-449d-a692-61e996cf4076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:57:52.698245 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75de992-471c-464b-92ed-f181b2308df5 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:52.701863 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcb18ac-2a48-4540-8262-860c63db52c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:52.702514 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcb18ac-2a48-4540-8262-860c63db52c7 service neutron] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:52.702830 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcb18ac-2a48-4540-8262-860c63db52c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:52.703073 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcb18ac-2a48-4540-8262-860c63db52c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:52.703524 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1171/2341] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:57:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 17:57:52.707850 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf40ccf-d673-449d-a692-61e996cf4076 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:52.714478 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcb18ac-2a48-4540-8262-860c63db52c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:52.715901 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcb18ac-2a48-4540-8262-860c63db52c7 service neutron] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:52.717063 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf40ccf-d673-449d-a692-61e996cf4076 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:52.721706 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31727769-0745-47eb-9574-f14d10024461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:52.722342 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31727769-0745-47eb-9574-f14d10024461 admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:52.722623 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31727769-0745-47eb-9574-f14d10024461 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:52.722898 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31727769-0745-47eb-9574-f14d10024461 admin admin] PATH_INFO: `/v3/domains` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:52.723645 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31727769-0745-47eb-9574-f14d10024461 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:57:52.724019 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31727769-0745-47eb-9574-f14d10024461 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:52.725561 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31727769-0745-47eb-9574-f14d10024461 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:52.726024 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1171/2342] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:57:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:57:52.737638 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1172/2343] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 14 17:57:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 17:57:52.742151 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcb18ac-2a48-4540-8262-860c63db52c7 service neutron] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:52.752591 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcb18ac-2a48-4540-8262-860c63db52c7 service neutron] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:52.758392 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74199e59-2445-441f-b455-13f8f7621745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:52.759051 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74199e59-2445-441f-b455-13f8f7621745 admin admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:52.759366 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74199e59-2445-441f-b455-13f8f7621745 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:52.759641 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74199e59-2445-441f-b455-13f8f7621745 admin admin] PATH_INFO: `/v3/projects` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:52.760551 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74199e59-2445-441f-b455-13f8f7621745 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:52.762430 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74199e59-2445-441f-b455-13f8f7621745 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:52.806456 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1172/2344] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 14 17:57:52 2022] POST /identity/v3/projects => generated 373 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:57:52.810815 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31727769-0745-47eb-9574-f14d10024461 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:52.826100 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31727769-0745-47eb-9574-f14d10024461 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:52.872652 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:57:52.913954 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d23bb3d-85ac-499c-a81a-dddea34ca19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:52.914860 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d23bb3d-85ac-499c-a81a-dddea34ca19b admin admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:52.915146 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d23bb3d-85ac-499c-a81a-dddea34ca19b admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:52.915430 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d23bb3d-85ac-499c-a81a-dddea34ca19b admin admin] PATH_INFO: `/v3/users` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:52.916130 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d23bb3d-85ac-499c-a81a-dddea34ca19b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:52.918796 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d23bb3d-85ac-499c-a81a-dddea34ca19b admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:52.956847 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1173/2345] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 14 17:57:52 2022] POST /identity/v3/users => generated 287 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:57:52.958274 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74199e59-2445-441f-b455-13f8f7621745 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:52.968742 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74199e59-2445-441f-b455-13f8f7621745 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:52.974018 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f47668e-a5e3-4454-85fb-26680a340006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:52.974687 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f47668e-a5e3-4454-85fb-26680a340006 admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:52.974966 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f47668e-a5e3-4454-85fb-26680a340006 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:52.975243 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f47668e-a5e3-4454-85fb-26680a340006 admin admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:52.975977 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f47668e-a5e3-4454-85fb-26680a340006 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:52.977604 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f47668e-a5e3-4454-85fb-26680a340006 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:52.992550 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1173/2346] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:57:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:57:52.993462 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d23bb3d-85ac-499c-a81a-dddea34ca19b admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:53.004516 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d23bb3d-85ac-499c-a81a-dddea34ca19b admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:53.009677 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3611129-060b-4839-bb84-96a67a2f7752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:53.010371 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3611129-060b-4839-bb84-96a67a2f7752 admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:53.010651 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3611129-060b-4839-bb84-96a67a2f7752 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:53.010923 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3611129-060b-4839-bb84-96a67a2f7752 admin admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:53.011647 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3611129-060b-4839-bb84-96a67a2f7752 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:53.013223 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3611129-060b-4839-bb84-96a67a2f7752 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:53.025646 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1174/2347] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:57:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 17:57:53.028498 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f47668e-a5e3-4454-85fb-26680a340006 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:53.039062 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f47668e-a5e3-4454-85fb-26680a340006 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:53.043804 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0112cc7-eb45-4845-9e3c-891a129b7295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:53.044687 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0112cc7-eb45-4845-9e3c-891a129b7295 admin admin] REQUEST_METHOD: `PUT` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:53.044974 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0112cc7-eb45-4845-9e3c-891a129b7295 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:53.045249 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0112cc7-eb45-4845-9e3c-891a129b7295 admin admin] PATH_INFO: `/v3/projects/d888853d02004558b5d5b7d1e3aa59f8/users/537559ad786748438dd06c4838237566/roles/95d753870f97426cb1ce32e078621a4c` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:53.060731 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0112cc7-eb45-4845-9e3c-891a129b7295 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d888853d02004558b5d5b7d1e3aa59f8, user_id=537559ad786748438dd06c4838237566, role_id=95d753870f97426cb1ce32e078621a4c)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:53.063418 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0112cc7-eb45-4845-9e3c-891a129b7295 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:53.078914 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1174/2348] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 17:57:53 2022] PUT /identity/v3/projects/d888853d02004558b5d5b7d1e3aa59f8/users/537559ad786748438dd06c4838237566/roles/95d753870f97426cb1ce32e078621a4c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:57:53.084538 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df3792-c166-45af-893a-55e0057896e4 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:53.084901 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df3792-c166-45af-893a-55e0057896e4 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:53.085248 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df3792-c166-45af-893a-55e0057896e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:53.103746 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0112cc7-eb45-4845-9e3c-891a129b7295 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:53.105788 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-c0112cc7-eb45-4845-9e3c-891a129b7295 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:57:53.108228 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-19df3792-c166-45af-893a-55e0057896e4 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:57:53.109456 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-19df3792-c166-45af-893a-55e0057896e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:57:53.123229 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:INSERT=3,keystone:DELETE=3,keystone:SELECT=94 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:57:53.178670 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1175/2349] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:57:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 17:57:53.183286 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0112cc7-eb45-4845-9e3c-891a129b7295 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:53.188204 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c99d32-60db-4072-ad00-cb108c259e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:53.188537 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19df3792-c166-45af-893a-55e0057896e4 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:53.189068 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c99d32-60db-4072-ad00-cb108c259e1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:53.189346 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c99d32-60db-4072-ad00-cb108c259e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:53.189650 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c99d32-60db-4072-ad00-cb108c259e1b admin admin] PATH_INFO: `/v3/projects/e0469631bd8b4d46996d4738d4cf17e5` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:53.190069 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-19df3792-c166-45af-893a-55e0057896e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:57:53.190858 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c99d32-60db-4072-ad00-cb108c259e1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0469631bd8b4d46996d4738d4cf17e5)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:53.193335 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c99d32-60db-4072-ad00-cb108c259e1b admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:53.243188 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-e6c99d32-60db-4072-ad00-cb108c259e1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0469631bd8b4d46996d4738d4cf17e5', 'request_id': 'req-e6c99d32-60db-4072-ad00-cb108c259e1b'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:53.249078 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19df3792-c166-45af-893a-55e0057896e4 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:53.249411 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-e6c99d32-60db-4072-ad00-cb108c259e1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0469631bd8b4d46996d4738d4cf17e5', 'request_id': 'req-e6c99d32-60db-4072-ad00-cb108c259e1b'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:53.257341 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-e6c99d32-60db-4072-ad00-cb108c259e1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0469631bd8b4d46996d4738d4cf17e5', 'request_id': 'req-e6c99d32-60db-4072-ad00-cb108c259e1b'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:53.270551 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-e6c99d32-60db-4072-ad00-cb108c259e1b admin admin] The token cache is being invalidate because project e0469631bd8b4d46996d4738d4cf17e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86773) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 17:57:53.270963 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-e6c99d32-60db-4072-ad00-cb108c259e1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:53.271603 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-e6c99d32-60db-4072-ad00-cb108c259e1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:57:53.273246 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1175/2350] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 14 17:57:53 2022] DELETE /identity/v3/projects/e0469631bd8b4d46996d4738d4cf17e5 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 17:57:53.278154 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d22d3cc-dbbd-4bd8-b724-28bb71b3ea25 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:53.278379 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d22d3cc-dbbd-4bd8-b724-28bb71b3ea25 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:53.278755 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d22d3cc-dbbd-4bd8-b724-28bb71b3ea25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:53.296378 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-2d22d3cc-dbbd-4bd8-b724-28bb71b3ea25 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:57:53.297624 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-2d22d3cc-dbbd-4bd8-b724-28bb71b3ea25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:57:53.298733 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1bc45b-6cc0-41e8-a364-5ebe36be8b7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:53.299395 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1bc45b-6cc0-41e8-a364-5ebe36be8b7f service neutron] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:53.299680 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1bc45b-6cc0-41e8-a364-5ebe36be8b7f service neutron] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:53.299950 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1bc45b-6cc0-41e8-a364-5ebe36be8b7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:53.302294 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-4e1bc45b-6cc0-41e8-a364-5ebe36be8b7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:57:53.323115 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:57:53.362306 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1176/2351] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:57:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 17:57:53.370626 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71864c64-e50c-4840-8fe2-506b0cdfcd79 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:53.370910 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71864c64-e50c-4840-8fe2-506b0cdfcd79 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:53.371191 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71864c64-e50c-4840-8fe2-506b0cdfcd79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:53.372580 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1bc45b-6cc0-41e8-a364-5ebe36be8b7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:53.375618 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1bc45b-6cc0-41e8-a364-5ebe36be8b7f service neutron] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:53.390053 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-71864c64-e50c-4840-8fe2-506b0cdfcd79 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:57:53.390479 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1176/2352] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:57:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 17:57:53.391264 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-71864c64-e50c-4840-8fe2-506b0cdfcd79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:57:53.399676 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1177/2353] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:57:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 17:57:53.403831 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1bc45b-6cc0-41e8-a364-5ebe36be8b7f service neutron] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:53.414239 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1bc45b-6cc0-41e8-a364-5ebe36be8b7f service neutron] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:53.419650 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19132115-fa68-40ef-9df1-bddb83992d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:53.420286 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19132115-fa68-40ef-9df1-bddb83992d7a admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:53.420725 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19132115-fa68-40ef-9df1-bddb83992d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:53.421011 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19132115-fa68-40ef-9df1-bddb83992d7a admin admin] PATH_INFO: `/v3/domains` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:53.422201 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19132115-fa68-40ef-9df1-bddb83992d7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:57:53.422201 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19132115-fa68-40ef-9df1-bddb83992d7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:53.423677 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19132115-fa68-40ef-9df1-bddb83992d7a admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:53.440656 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1177/2354] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 14 17:57:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:57:53.441857 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71864c64-e50c-4840-8fe2-506b0cdfcd79 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:53.453042 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71864c64-e50c-4840-8fe2-506b0cdfcd79 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:53.458604 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3495d8a-6efc-40ed-9e26-7e291951d6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:53.459335 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3495d8a-6efc-40ed-9e26-7e291951d6a8 admin admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:53.459718 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3495d8a-6efc-40ed-9e26-7e291951d6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:53.460095 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3495d8a-6efc-40ed-9e26-7e291951d6a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:53.460918 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3495d8a-6efc-40ed-9e26-7e291951d6a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:53.462982 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3495d8a-6efc-40ed-9e26-7e291951d6a8 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:53.493703 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1178/2355] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 14 17:57:53 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 17:57:53.494884 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19132115-fa68-40ef-9df1-bddb83992d7a admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:53.505224 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19132115-fa68-40ef-9df1-bddb83992d7a admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:53.582159 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc66e0b-d0cd-41f0-b26f-39e43ef0c36f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:53.582897 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc66e0b-d0cd-41f0-b26f-39e43ef0c36f admin admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:53.583179 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc66e0b-d0cd-41f0-b26f-39e43ef0c36f admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:53.584239 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc66e0b-d0cd-41f0-b26f-39e43ef0c36f admin admin] PATH_INFO: `/v3/users` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:53.584952 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc66e0b-d0cd-41f0-b26f-39e43ef0c36f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:53.587064 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc66e0b-d0cd-41f0-b26f-39e43ef0c36f admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:53.612758 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1178/2356] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 14 17:57:53 2022] POST /identity/v3/users => generated 286 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 17:57:53.614075 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3495d8a-6efc-40ed-9e26-7e291951d6a8 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:53.624839 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3495d8a-6efc-40ed-9e26-7e291951d6a8 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:53.630042 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fa272b-950d-40c8-a0ee-d609f03d6deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:53.630730 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa272b-950d-40c8-a0ee-d609f03d6deb admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:53.631017 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa272b-950d-40c8-a0ee-d609f03d6deb admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:53.631299 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa272b-950d-40c8-a0ee-d609f03d6deb admin admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:53.632039 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fa272b-950d-40c8-a0ee-d609f03d6deb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:53.633710 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fa272b-950d-40c8-a0ee-d609f03d6deb admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:53.644786 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1179/2357] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:57:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:57:53.648886 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc66e0b-d0cd-41f0-b26f-39e43ef0c36f admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:53.659434 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc66e0b-d0cd-41f0-b26f-39e43ef0c36f admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:53.664839 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f576bb2d-85d5-4e64-b192-280bd8186b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:53.666196 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f576bb2d-85d5-4e64-b192-280bd8186b0c admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:53.666482 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f576bb2d-85d5-4e64-b192-280bd8186b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:53.666765 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f576bb2d-85d5-4e64-b192-280bd8186b0c admin admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:53.667522 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f576bb2d-85d5-4e64-b192-280bd8186b0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:53.669301 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f576bb2d-85d5-4e64-b192-280bd8186b0c admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:53.684278 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1179/2358] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:57:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:57:53.685867 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fa272b-950d-40c8-a0ee-d609f03d6deb admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:53.691580 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:57:53.699175 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fa272b-950d-40c8-a0ee-d609f03d6deb admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:53.706044 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1722d28c-25a5-4d73-ad25-84329e13c914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:53.707058 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1722d28c-25a5-4d73-ad25-84329e13c914 admin admin] REQUEST_METHOD: `PUT` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:53.707415 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1722d28c-25a5-4d73-ad25-84329e13c914 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:53.707769 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1722d28c-25a5-4d73-ad25-84329e13c914 admin admin] PATH_INFO: `/v3/projects/22486f27a9f04835b7f8e7206afa7ad5/users/db6eddb4c43846e59678da445eb6e628/roles/95d753870f97426cb1ce32e078621a4c` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:53.729792 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1722d28c-25a5-4d73-ad25-84329e13c914 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22486f27a9f04835b7f8e7206afa7ad5, user_id=db6eddb4c43846e59678da445eb6e628, role_id=95d753870f97426cb1ce32e078621a4c)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:53.733266 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1722d28c-25a5-4d73-ad25-84329e13c914 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:53.760309 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1180/2359] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 17:57:53 2022] PUT /identity/v3/projects/22486f27a9f04835b7f8e7206afa7ad5/users/db6eddb4c43846e59678da445eb6e628/roles/95d753870f97426cb1ce32e078621a4c => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:57:53.763308 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef27a39-7682-4e99-bef6-41389ddfb639 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:53.763742 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef27a39-7682-4e99-bef6-41389ddfb639 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:53.764057 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef27a39-7682-4e99-bef6-41389ddfb639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:53.786474 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-6ef27a39-7682-4e99-bef6-41389ddfb639 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:57:53.787676 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-6ef27a39-7682-4e99-bef6-41389ddfb639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:57:53.871204 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1180/2360] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:57:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:57:53.881608 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1722d28c-25a5-4d73-ad25-84329e13c914 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:53.883394 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-1722d28c-25a5-4d73-ad25-84329e13c914 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:57:53.944261 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1722d28c-25a5-4d73-ad25-84329e13c914 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:53.947974 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a170a04-9907-4c91-a6fa-c5ec42945a3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:53.948629 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a170a04-9907-4c91-a6fa-c5ec42945a3f service neutron] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:53.948912 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a170a04-9907-4c91-a6fa-c5ec42945a3f service neutron] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:53.949193 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a170a04-9907-4c91-a6fa-c5ec42945a3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:53.959031 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a170a04-9907-4c91-a6fa-c5ec42945a3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:53.960477 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a170a04-9907-4c91-a6fa-c5ec42945a3f service neutron] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:53.970923 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1181/2361] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:57:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:57:54.295195 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2b78bb-98ff-4d20-99bc-6ea5db6394a5 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:54.295738 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2b78bb-98ff-4d20-99bc-6ea5db6394a5 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:54.296202 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2b78bb-98ff-4d20-99bc-6ea5db6394a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:54.336756 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-da2b78bb-98ff-4d20-99bc-6ea5db6394a5 None None] MFA Rules not processed for user `537559ad786748438dd06c4838237566`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:57:54.343005 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-da2b78bb-98ff-4d20-99bc-6ea5db6394a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:57:54.363701 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:57:54.455539 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1181/2362] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:57:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:57:54.464304 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a170a04-9907-4c91-a6fa-c5ec42945a3f service neutron] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:54.466425 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-8a170a04-9907-4c91-a6fa-c5ec42945a3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:57:54.539620 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a170a04-9907-4c91-a6fa-c5ec42945a3f service neutron] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:54.558447 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f03198-0e61-4f67-8fb0-eb1350d0c3fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de55cae1600841889668e36402861203', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:54.559677 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f03198-0e61-4f67-8fb0-eb1350d0c3fb service cinder] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:54.560121 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f03198-0e61-4f67-8fb0-eb1350d0c3fb service cinder] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:54.561353 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f03198-0e61-4f67-8fb0-eb1350d0c3fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:54.574322 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f03198-0e61-4f67-8fb0-eb1350d0c3fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:54.576315 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f03198-0e61-4f67-8fb0-eb1350d0c3fb service cinder] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:54.600958 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1182/2363] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:57:54 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:57:56.127843 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3658aec9-dd41-4245-9fcc-3e28139e60bf None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:56.128405 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3658aec9-dd41-4245-9fcc-3e28139e60bf None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:56.128825 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3658aec9-dd41-4245-9fcc-3e28139e60bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:56.136676 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f330167f-9fc3-410b-9c43-0bd8e8a13442 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:56.137660 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f330167f-9fc3-410b-9c43-0bd8e8a13442 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:56.138130 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f330167f-9fc3-410b-9c43-0bd8e8a13442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:56.158907 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-f330167f-9fc3-410b-9c43-0bd8e8a13442 None None] MFA Rules not processed for user `537559ad786748438dd06c4838237566`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:57:56.160457 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-f330167f-9fc3-410b-9c43-0bd8e8a13442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:57:56.169471 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-3658aec9-dd41-4245-9fcc-3e28139e60bf None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:57:56.170891 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-3658aec9-dd41-4245-9fcc-3e28139e60bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:57:56.171981 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1183/2364] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:57:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 17:57:56.180957 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1182/2365] 10.222.0.40 () {58 vars in 1016 bytes} [Thu Jul 14 17:57:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:57:56.206076 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f330167f-9fc3-410b-9c43-0bd8e8a13442 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:56.208191 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-f330167f-9fc3-410b-9c43-0bd8e8a13442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:57:56.313285 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f330167f-9fc3-410b-9c43-0bd8e8a13442 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:56.323963 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5044f1a2-2bb8-4da5-bdfb-8764c4b2c6cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41b893bdf4ec474dbfa819c22fc29ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:56.324639 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5044f1a2-2bb8-4da5-bdfb-8764c4b2c6cb service nova] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:56.324920 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5044f1a2-2bb8-4da5-bdfb-8764c4b2c6cb service nova] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:56.325199 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5044f1a2-2bb8-4da5-bdfb-8764c4b2c6cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:56.335023 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5044f1a2-2bb8-4da5-bdfb-8764c4b2c6cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:56.336778 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5044f1a2-2bb8-4da5-bdfb-8764c4b2c6cb service nova] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:56.348604 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1184/2366] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:57:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:57:58.647604 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b540b0e-7a4a-4d7e-80db-1c9d0730ba51 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:58.648159 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b540b0e-7a4a-4d7e-80db-1c9d0730ba51 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:58.649602 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b540b0e-7a4a-4d7e-80db-1c9d0730ba51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:58.728810 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-3b540b0e-7a4a-4d7e-80db-1c9d0730ba51 None None] MFA Rules not processed for user `db6eddb4c43846e59678da445eb6e628`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:57:58.730094 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-3b540b0e-7a4a-4d7e-80db-1c9d0730ba51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:57:58.877506 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1183/2367] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:57:58 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:57:58.882993 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5044f1a2-2bb8-4da5-bdfb-8764c4b2c6cb service nova] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:58.889734 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:57:58.896793 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5044f1a2-2bb8-4da5-bdfb-8764c4b2c6cb service nova] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:58.905396 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753d78aa-7ae7-4362-a218-a41c47f7f076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:58.906228 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d78aa-7ae7-4362-a218-a41c47f7f076 admin admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:58.906397 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d78aa-7ae7-4362-a218-a41c47f7f076 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:58.907049 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d78aa-7ae7-4362-a218-a41c47f7f076 admin admin] PATH_INFO: `/v3/projects` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:58.907964 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753d78aa-7ae7-4362-a218-a41c47f7f076 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:58.911290 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753d78aa-7ae7-4362-a218-a41c47f7f076 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:58.944971 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1185/2368] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 14 17:57:58 2022] POST /identity/v3/projects => generated 371 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 17:57:58.949138 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b540b0e-7a4a-4d7e-80db-1c9d0730ba51 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:58.961514 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b540b0e-7a4a-4d7e-80db-1c9d0730ba51 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:59.029933 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0cf8e0-37bf-4c0a-9fab-179ccd14f180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:59.030576 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0cf8e0-37bf-4c0a-9fab-179ccd14f180 admin admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:59.030860 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0cf8e0-37bf-4c0a-9fab-179ccd14f180 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:59.031167 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0cf8e0-37bf-4c0a-9fab-179ccd14f180 admin admin] PATH_INFO: `/v3/users` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:59.031924 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0cf8e0-37bf-4c0a-9fab-179ccd14f180 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:59.033987 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0cf8e0-37bf-4c0a-9fab-179ccd14f180 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:59.057334 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1184/2369] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 14 17:57:58 2022] POST /identity/v3/users => generated 292 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 17:57:59.061706 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753d78aa-7ae7-4362-a218-a41c47f7f076 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:59.072933 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753d78aa-7ae7-4362-a218-a41c47f7f076 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:59.077876 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37189fa6-0fad-4523-8ab5-f8874b927a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:59.078558 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37189fa6-0fad-4523-8ab5-f8874b927a1c admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:59.078840 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37189fa6-0fad-4523-8ab5-f8874b927a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:59.079114 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37189fa6-0fad-4523-8ab5-f8874b927a1c admin admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:59.079850 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37189fa6-0fad-4523-8ab5-f8874b927a1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:59.081497 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37189fa6-0fad-4523-8ab5-f8874b927a1c admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:59.093736 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1186/2370] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:57:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:57:59.105402 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0cf8e0-37bf-4c0a-9fab-179ccd14f180 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:59.140466 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0cf8e0-37bf-4c0a-9fab-179ccd14f180 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:59.146885 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68b83f6-81b0-410d-aaa7-25047ad4c5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:59.147816 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b83f6-81b0-410d-aaa7-25047ad4c5f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:59.148101 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b83f6-81b0-410d-aaa7-25047ad4c5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:59.148515 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b83f6-81b0-410d-aaa7-25047ad4c5f9 admin admin] PATH_INFO: `/v3/projects/d2ff7e5682ab420ca633b3393db38b0f/users/04a6f39dddff49f3b12caa99de8b7011/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:59.164363 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68b83f6-81b0-410d-aaa7-25047ad4c5f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2ff7e5682ab420ca633b3393db38b0f, user_id=04a6f39dddff49f3b12caa99de8b7011, role_id=4651a1cc7b4d4ab7a7a9ca1e77e58e71)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:59.167122 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68b83f6-81b0-410d-aaa7-25047ad4c5f9 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:59.189185 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:57:59.206145 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1185/2371] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 17:57:59 2022] PUT /identity/v3/projects/d2ff7e5682ab420ca633b3393db38b0f/users/04a6f39dddff49f3b12caa99de8b7011/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:57:59.210094 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37189fa6-0fad-4523-8ab5-f8874b927a1c admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:59.220849 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37189fa6-0fad-4523-8ab5-f8874b927a1c admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:59.324385 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46543b5e-0431-4dd9-949a-004775261015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:59.325088 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46543b5e-0431-4dd9-949a-004775261015 admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:59.325443 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46543b5e-0431-4dd9-949a-004775261015 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:59.325845 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46543b5e-0431-4dd9-949a-004775261015 admin admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:59.326772 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46543b5e-0431-4dd9-949a-004775261015 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:59.328794 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46543b5e-0431-4dd9-949a-004775261015 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:59.345294 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1187/2372] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:57:59 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 17:57:59.346840 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68b83f6-81b0-410d-aaa7-25047ad4c5f9 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:57:59.359879 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68b83f6-81b0-410d-aaa7-25047ad4c5f9 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:57:59.366158 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fff527-51ca-4519-b9f4-54aeae8d05a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:57:59.369594 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fff527-51ca-4519-b9f4-54aeae8d05a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:57:59.369594 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fff527-51ca-4519-b9f4-54aeae8d05a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:57:59.369594 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fff527-51ca-4519-b9f4-54aeae8d05a7 admin admin] PATH_INFO: `/v3/projects/d2ff7e5682ab420ca633b3393db38b0f/users/04a6f39dddff49f3b12caa99de8b7011/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:57:59.371704 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fff527-51ca-4519-b9f4-54aeae8d05a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2ff7e5682ab420ca633b3393db38b0f, user_id=04a6f39dddff49f3b12caa99de8b7011, role_id=4651a1cc7b4d4ab7a7a9ca1e77e58e71)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:57:59.374564 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fff527-51ca-4519-b9f4-54aeae8d05a7 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:57:59.397961 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1186/2373] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 17:57:59 2022] PUT /identity/v3/projects/d2ff7e5682ab420ca633b3393db38b0f/users/04a6f39dddff49f3b12caa99de8b7011/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:58:01.292563 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e88544c-c537-4174-a4cc-1c03db3d37e1 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:58:01.293149 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e88544c-c537-4174-a4cc-1c03db3d37e1 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:58:01.293789 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e88544c-c537-4174-a4cc-1c03db3d37e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:58:01.347219 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-3e88544c-c537-4174-a4cc-1c03db3d37e1 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:58:01.351422 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-3e88544c-c537-4174-a4cc-1c03db3d37e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:58:01.503948 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1188/2374] 10.222.0.40 () {58 vars in 1016 bytes} [Thu Jul 14 17:58:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:58:01.528843 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fff527-51ca-4519-b9f4-54aeae8d05a7 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:58:01.530958 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-f0fff527-51ca-4519-b9f4-54aeae8d05a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:58:01.652990 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fff527-51ca-4519-b9f4-54aeae8d05a7 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:58:01.666290 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a883fdca-a42b-4986-ac6c-606da6c42b34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41b893bdf4ec474dbfa819c22fc29ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:58:01.666290 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a883fdca-a42b-4986-ac6c-606da6c42b34 service nova] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:58:01.666290 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a883fdca-a42b-4986-ac6c-606da6c42b34 service nova] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:58:01.666827 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a883fdca-a42b-4986-ac6c-606da6c42b34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:58:01.689677 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a883fdca-a42b-4986-ac6c-606da6c42b34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:58:01.691997 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a883fdca-a42b-4986-ac6c-606da6c42b34 service nova] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:58:01.709191 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1187/2375] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:58:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:58:06.027528 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e308e1-2985-4ff7-970d-0571c6bc0c66 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:58:06.027987 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e308e1-2985-4ff7-970d-0571c6bc0c66 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:58:06.028091 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e308e1-2985-4ff7-970d-0571c6bc0c66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:58:06.062488 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-45e308e1-2985-4ff7-970d-0571c6bc0c66 None None] MFA Rules not processed for user `04a6f39dddff49f3b12caa99de8b7011`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:58:06.063995 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-45e308e1-2985-4ff7-970d-0571c6bc0c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:58:06.126113 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:58:06.153508 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1189/2376] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:58:06 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:58:06.167687 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a883fdca-a42b-4986-ac6c-606da6c42b34 service nova] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:58:06.179884 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a883fdca-a42b-4986-ac6c-606da6c42b34 service nova] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:58:06.186985 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b48560d-0cb0-42fa-bb0a-a57f3676011e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41b893bdf4ec474dbfa819c22fc29ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:58:06.187647 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b48560d-0cb0-42fa-bb0a-a57f3676011e service nova] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:58:06.187933 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b48560d-0cb0-42fa-bb0a-a57f3676011e service nova] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:58:06.188211 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b48560d-0cb0-42fa-bb0a-a57f3676011e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:58:06.245744 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b48560d-0cb0-42fa-bb0a-a57f3676011e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:58:06.247257 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b48560d-0cb0-42fa-bb0a-a57f3676011e service nova] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:58:06.257486 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1188/2377] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:58:06 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:58:07.360487 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a7fd4-8de8-48aa-9d71-ffe36e162f5b None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:58:07.360998 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a7fd4-8de8-48aa-9d71-ffe36e162f5b None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:58:07.361104 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a7fd4-8de8-48aa-9d71-ffe36e162f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:58:07.383411 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-fa9a7fd4-8de8-48aa-9d71-ffe36e162f5b None None] MFA Rules not processed for user `db6eddb4c43846e59678da445eb6e628`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:58:07.384722 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-fa9a7fd4-8de8-48aa-9d71-ffe36e162f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:58:07.398645 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1190/2378] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:58:07 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:58:10.797502 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e235eaa5-ada1-4eb9-b2d2-67a4d3faef78 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:58:10.798243 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e235eaa5-ada1-4eb9-b2d2-67a4d3faef78 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:58:10.798368 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e235eaa5-ada1-4eb9-b2d2-67a4d3faef78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:58:10.820297 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-e235eaa5-ada1-4eb9-b2d2-67a4d3faef78 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:58:10.821546 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-e235eaa5-ada1-4eb9-b2d2-67a4d3faef78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:58:10.833900 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1189/2379] 10.222.0.40 () {58 vars in 1016 bytes} [Thu Jul 14 17:58:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:58:10.867723 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9a7fd4-8de8-48aa-9d71-ffe36e162f5b None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:58:10.881498 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9a7fd4-8de8-48aa-9d71-ffe36e162f5b None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:58:10.890817 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6e3345-97c6-4a20-9455-258d80884982 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41b893bdf4ec474dbfa819c22fc29ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:58:10.891512 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6e3345-97c6-4a20-9455-258d80884982 service nova] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:58:10.891812 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6e3345-97c6-4a20-9455-258d80884982 service nova] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:58:10.892083 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6e3345-97c6-4a20-9455-258d80884982 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:58:10.909972 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6e3345-97c6-4a20-9455-258d80884982 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:58:10.911727 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6e3345-97c6-4a20-9455-258d80884982 service nova] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:58:10.932797 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1191/2380] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:58:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:58:16.026759 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684579b4-95f4-42bb-aae4-f0d9f69167b3 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:58:16.027192 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684579b4-95f4-42bb-aae4-f0d9f69167b3 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:58:16.027284 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684579b4-95f4-42bb-aae4-f0d9f69167b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:58:16.045671 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-684579b4-95f4-42bb-aae4-f0d9f69167b3 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:58:16.046861 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-684579b4-95f4-42bb-aae4-f0d9f69167b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:58:16.054582 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1190/2381] 10.222.0.40 () {58 vars in 1016 bytes} [Thu Jul 14 17:58:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:58:16.082918 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6e3345-97c6-4a20-9455-258d80884982 service nova] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:58:16.094590 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6e3345-97c6-4a20-9455-258d80884982 service nova] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:58:16.100063 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05af309a-8925-4fcb-a15d-9618b69eff9a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41b893bdf4ec474dbfa819c22fc29ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:58:16.100707 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af309a-8925-4fcb-a15d-9618b69eff9a service nova] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:58:16.100991 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af309a-8925-4fcb-a15d-9618b69eff9a service nova] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:58:16.101284 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af309a-8925-4fcb-a15d-9618b69eff9a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:58:16.110761 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05af309a-8925-4fcb-a15d-9618b69eff9a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:58:16.112724 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05af309a-8925-4fcb-a15d-9618b69eff9a service nova] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:58:16.123062 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1192/2382] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:58:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:58:23.660919 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684579b4-95f4-42bb-aae4-f0d9f69167b3 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:58:23.662783 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-684579b4-95f4-42bb-aae4-f0d9f69167b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:58:23.735902 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:58:23.756031 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684579b4-95f4-42bb-aae4-f0d9f69167b3 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:58:23.761126 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451fed39-205e-41b9-a511-4da263583e45 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5324ab45f4a4449980dad920278f5034', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:58:23.761814 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451fed39-205e-41b9-a511-4da263583e45 service placement] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:58:23.762094 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451fed39-205e-41b9-a511-4da263583e45 service placement] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:58:23.762369 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451fed39-205e-41b9-a511-4da263583e45 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:58:23.764250 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-451fed39-205e-41b9-a511-4da263583e45 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:58:23.779826 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451fed39-205e-41b9-a511-4da263583e45 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:58:23.781411 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451fed39-205e-41b9-a511-4da263583e45 service placement] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:58:23.792974 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1191/2383] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:58:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:58:24.703377 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e1e4c1-a854-4c89-ada2-ce74a56afe49 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:58:24.703914 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e1e4c1-a854-4c89-ada2-ce74a56afe49 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:58:24.704095 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e1e4c1-a854-4c89-ada2-ce74a56afe49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:58:24.724263 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-b3e1e4c1-a854-4c89-ada2-ce74a56afe49 None None] MFA Rules not processed for user `537559ad786748438dd06c4838237566`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:58:24.725818 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-b3e1e4c1-a854-4c89-ada2-ce74a56afe49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:58:24.802374 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1193/2384] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:58:24 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:58:33.788168 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=6 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:58:34.795357 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=44 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:58:35.644854 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2b5124-7f75-4e3f-bd6d-352d2db043af None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:58:35.645348 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2b5124-7f75-4e3f-bd6d-352d2db043af None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:58:35.645348 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2b5124-7f75-4e3f-bd6d-352d2db043af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:58:35.664001 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-be2b5124-7f75-4e3f-bd6d-352d2db043af None None] MFA Rules not processed for user `6cb37447d9024c49b2997e4d753f0059`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:58:35.665224 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-be2b5124-7f75-4e3f-bd6d-352d2db043af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:58:35.723196 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1192/2385] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:58:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:58:45.715790 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=25 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:58:55.045295 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e1e4c1-a854-4c89-ada2-ce74a56afe49 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:58:55.046800 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-b3e1e4c1-a854-4c89-ada2-ce74a56afe49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:58:55.114889 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e1e4c1-a854-4c89-ada2-ce74a56afe49 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:58:55.118485 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0657ba5-93b4-4383-af6e-a76a5822e425 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:58:55.119146 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0657ba5-93b4-4383-af6e-a76a5822e425 service neutron] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:58:55.119453 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0657ba5-93b4-4383-af6e-a76a5822e425 service neutron] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:58:55.119731 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0657ba5-93b4-4383-af6e-a76a5822e425 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:58:55.129991 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0657ba5-93b4-4383-af6e-a76a5822e425 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:58:55.131437 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0657ba5-93b4-4383-af6e-a76a5822e425 service neutron] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:58:55.141609 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1194/2386] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:58:55 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:58:58.255560 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48265566-b9b5-4f1f-bbab-b1d825686822 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:58:58.256087 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48265566-b9b5-4f1f-bbab-b1d825686822 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:58:58.256087 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48265566-b9b5-4f1f-bbab-b1d825686822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:58:58.277737 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-48265566-b9b5-4f1f-bbab-b1d825686822 None None] MFA Rules not processed for user `45542602225b452fa323f5499c1843ec`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:58:58.279258 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-48265566-b9b5-4f1f-bbab-b1d825686822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:58:58.348578 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1193/2387] 10.222.0.67 () {58 vars in 1009 bytes} [Thu Jul 14 17:58:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:58:58.404050 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0657ba5-93b4-4383-af6e-a76a5822e425 service neutron] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:58:58.405759 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-b0657ba5-93b4-4383-af6e-a76a5822e425 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:58:58.479316 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0657ba5-93b4-4383-af6e-a76a5822e425 service neutron] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:58:58.484831 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e3fc01-8e04-4d9e-8942-636d5ddfd746 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c65607a396474192a43c374d306ef5ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:58:58.485494 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e3fc01-8e04-4d9e-8942-636d5ddfd746 service swift] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:58:58.485809 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e3fc01-8e04-4d9e-8942-636d5ddfd746 service swift] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:58:58.486082 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e3fc01-8e04-4d9e-8942-636d5ddfd746 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:58:58.494807 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e3fc01-8e04-4d9e-8942-636d5ddfd746 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:58:58.496425 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e3fc01-8e04-4d9e-8942-636d5ddfd746 service swift] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:58:58.506149 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1195/2388] 10.222.0.67 () {60 vars in 1384 bytes} [Thu Jul 14 17:58:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 14 17:59:04.411007 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c0db7-ac6e-49fd-9826-2ee863b23440 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:59:04.412578 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c0db7-ac6e-49fd-9826-2ee863b23440 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:59:04.413776 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c0db7-ac6e-49fd-9826-2ee863b23440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:59:04.470509 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-2f6c0db7-ac6e-49fd-9826-2ee863b23440 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:59:04.471787 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-2f6c0db7-ac6e-49fd-9826-2ee863b23440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:59:04.481352 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1194/2389] 10.222.0.40 () {58 vars in 1016 bytes} [Thu Jul 14 17:59:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:59:04.502943 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e3fc01-8e04-4d9e-8942-636d5ddfd746 service swift] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:59:04.521069 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e3fc01-8e04-4d9e-8942-636d5ddfd746 service swift] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:59:04.527256 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa458e0c-0454-4960-bd55-cedf0699f97f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41b893bdf4ec474dbfa819c22fc29ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:59:04.527930 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa458e0c-0454-4960-bd55-cedf0699f97f service nova] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:59:04.528392 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa458e0c-0454-4960-bd55-cedf0699f97f service nova] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:59:04.528995 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa458e0c-0454-4960-bd55-cedf0699f97f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:59:04.539793 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa458e0c-0454-4960-bd55-cedf0699f97f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:59:04.541513 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa458e0c-0454-4960-bd55-cedf0699f97f service nova] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:59:04.566321 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1196/2390] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:59:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:59:09.771040 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f0080-43fd-497c-b058-3c4cee8f71aa None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:59:09.772021 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f0080-43fd-497c-b058-3c4cee8f71aa None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:59:09.772309 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f0080-43fd-497c-b058-3c4cee8f71aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:59:09.801238 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-aa0f0080-43fd-497c-b058-3c4cee8f71aa None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:59:09.803837 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-aa0f0080-43fd-497c-b058-3c4cee8f71aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:59:09.818820 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1195/2391] 10.222.0.40 () {58 vars in 1016 bytes} [Thu Jul 14 17:59:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:59:09.846436 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa458e0c-0454-4960-bd55-cedf0699f97f service nova] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:59:09.887899 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa458e0c-0454-4960-bd55-cedf0699f97f service nova] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:59:09.894895 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98c78d0-f739-442d-981a-d8e510030cf5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41b893bdf4ec474dbfa819c22fc29ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:59:09.897009 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98c78d0-f739-442d-981a-d8e510030cf5 service nova] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:59:09.897145 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98c78d0-f739-442d-981a-d8e510030cf5 service nova] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:59:09.897423 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98c78d0-f739-442d-981a-d8e510030cf5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:59:09.912584 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98c78d0-f739-442d-981a-d8e510030cf5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:59:09.915657 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98c78d0-f739-442d-981a-d8e510030cf5 service nova] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:59:09.940184 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1197/2392] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:59:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:59:13.766860 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfe231a-b847-4966-a06a-9ba2db9f0488 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:59:13.769379 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfe231a-b847-4966-a06a-9ba2db9f0488 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:59:13.771000 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfe231a-b847-4966-a06a-9ba2db9f0488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:59:13.795596 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-adfe231a-b847-4966-a06a-9ba2db9f0488 None None] MFA Rules not processed for user `45542602225b452fa323f5499c1843ec`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:59:13.796868 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-adfe231a-b847-4966-a06a-9ba2db9f0488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:59:13.804976 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1196/2393] 10.222.0.67 () {58 vars in 1009 bytes} [Thu Jul 14 17:59:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:59:13.819940 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98c78d0-f739-442d-981a-d8e510030cf5 service nova] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:59:13.834122 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98c78d0-f739-442d-981a-d8e510030cf5 service nova] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:59:13.840409 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf970b53-223b-4013-897a-8466183bac88 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c65607a396474192a43c374d306ef5ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:59:13.841070 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf970b53-223b-4013-897a-8466183bac88 service swift] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:59:13.841354 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf970b53-223b-4013-897a-8466183bac88 service swift] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:59:13.841853 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf970b53-223b-4013-897a-8466183bac88 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:59:13.854744 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf970b53-223b-4013-897a-8466183bac88 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:59:13.856480 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf970b53-223b-4013-897a-8466183bac88 service swift] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:59:13.866243 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1198/2394] 10.222.0.67 () {60 vars in 1384 bytes} [Thu Jul 14 17:59:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 17:59:14.713293 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c6e871-e48e-40ac-8ca2-15e8763a6c07 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:59:14.713614 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c6e871-e48e-40ac-8ca2-15e8763a6c07 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:59:14.714026 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c6e871-e48e-40ac-8ca2-15e8763a6c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:59:14.734551 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-18c6e871-e48e-40ac-8ca2-15e8763a6c07 None None] MFA Rules not processed for user `45542602225b452fa323f5499c1843ec`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:59:14.735936 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-18c6e871-e48e-40ac-8ca2-15e8763a6c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:59:14.743954 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1197/2395] 10.222.0.67 () {58 vars in 967 bytes} [Thu Jul 14 17:59:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:59:14.758858 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf970b53-223b-4013-897a-8466183bac88 service swift] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:59:14.770372 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf970b53-223b-4013-897a-8466183bac88 service swift] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:59:14.775994 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1917f35-8cef-405f-bb28-d9f9d8a02228 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c65607a396474192a43c374d306ef5ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:59:14.776645 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1917f35-8cef-405f-bb28-d9f9d8a02228 service swift] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:59:14.776934 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1917f35-8cef-405f-bb28-d9f9d8a02228 service swift] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:59:14.777218 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1917f35-8cef-405f-bb28-d9f9d8a02228 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:59:14.787244 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1917f35-8cef-405f-bb28-d9f9d8a02228 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:59:14.788869 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1917f35-8cef-405f-bb28-d9f9d8a02228 service swift] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:59:14.797731 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1199/2396] 10.222.0.67 () {60 vars in 1384 bytes} [Thu Jul 14 17:59:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 17:59:14.979893 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb5ccc-a303-4eec-bc69-e7f14a1658f2 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:59:14.987273 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb5ccc-a303-4eec-bc69-e7f14a1658f2 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:59:14.987731 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb5ccc-a303-4eec-bc69-e7f14a1658f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:59:15.026448 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-c2fb5ccc-a303-4eec-bc69-e7f14a1658f2 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:59:15.028088 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-c2fb5ccc-a303-4eec-bc69-e7f14a1658f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:59:15.041698 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1198/2397] 10.222.0.40 () {58 vars in 1016 bytes} [Thu Jul 14 17:59:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:59:15.075092 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1917f35-8cef-405f-bb28-d9f9d8a02228 service swift] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:59:15.092222 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1917f35-8cef-405f-bb28-d9f9d8a02228 service swift] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:59:15.106735 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71778b79-1c2e-45c3-b430-bd5c32942bd4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41b893bdf4ec474dbfa819c22fc29ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:59:15.107086 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71778b79-1c2e-45c3-b430-bd5c32942bd4 service nova] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:59:15.107370 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71778b79-1c2e-45c3-b430-bd5c32942bd4 service nova] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:59:15.107898 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71778b79-1c2e-45c3-b430-bd5c32942bd4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:59:15.119711 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71778b79-1c2e-45c3-b430-bd5c32942bd4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:59:15.121827 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71778b79-1c2e-45c3-b430-bd5c32942bd4 service nova] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:59:15.135377 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1200/2398] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:59:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:59:17.004102 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fb5ccc-a303-4eec-bc69-e7f14a1658f2 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:59:17.005692 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-c2fb5ccc-a303-4eec-bc69-e7f14a1658f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:59:17.024829 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fb5ccc-a303-4eec-bc69-e7f14a1658f2 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:59:17.030080 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88bf0be-6248-4496-b39d-b97ab8473120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:59:17.031181 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88bf0be-6248-4496-b39d-b97ab8473120 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:59:17.031464 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88bf0be-6248-4496-b39d-b97ab8473120 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:59:17.031770 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88bf0be-6248-4496-b39d-b97ab8473120 admin admin] PATH_INFO: `/v3/users/537559ad786748438dd06c4838237566` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:59:17.033021 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88bf0be-6248-4496-b39d-b97ab8473120 admin admin] RBAC: Authorizing `identity:delete_user(user_id=537559ad786748438dd06c4838237566)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:59:17.034971 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88bf0be-6248-4496-b39d-b97ab8473120 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:59:17.095320 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-a88bf0be-6248-4496-b39d-b97ab8473120 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '537559ad786748438dd06c4838237566'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:59:17.104948 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-a88bf0be-6248-4496-b39d-b97ab8473120 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '537559ad786748438dd06c4838237566'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:59:17.113927 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-a88bf0be-6248-4496-b39d-b97ab8473120 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '537559ad786748438dd06c4838237566'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:59:17.114611 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-a88bf0be-6248-4496-b39d-b97ab8473120 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '537559ad786748438dd06c4838237566'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:59:17.127664 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-a88bf0be-6248-4496-b39d-b97ab8473120 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '537559ad786748438dd06c4838237566'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:59:17.137159 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1199/2399] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 14 17:59:17 2022] DELETE /identity/v3/users/537559ad786748438dd06c4838237566 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:59:17.332798 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71778b79-1c2e-45c3-b430-bd5c32942bd4 service nova] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:59:17.344384 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71778b79-1c2e-45c3-b430-bd5c32942bd4 service nova] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:59:17.374320 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:59:17.409370 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6c4f38-ca30-4b59-a9dc-1b505949fc2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:59:17.410328 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6c4f38-ca30-4b59-a9dc-1b505949fc2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:59:17.410614 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6c4f38-ca30-4b59-a9dc-1b505949fc2d admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:59:17.410891 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6c4f38-ca30-4b59-a9dc-1b505949fc2d admin admin] PATH_INFO: `/v3/projects/d888853d02004558b5d5b7d1e3aa59f8` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:59:17.412075 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6c4f38-ca30-4b59-a9dc-1b505949fc2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d888853d02004558b5d5b7d1e3aa59f8)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:59:17.414118 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6c4f38-ca30-4b59-a9dc-1b505949fc2d admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:59:17.465812 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-ac6c4f38-ca30-4b59-a9dc-1b505949fc2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd888853d02004558b5d5b7d1e3aa59f8', 'request_id': 'req-ac6c4f38-ca30-4b59-a9dc-1b505949fc2d'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:59:17.472248 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-ac6c4f38-ca30-4b59-a9dc-1b505949fc2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd888853d02004558b5d5b7d1e3aa59f8', 'request_id': 'req-ac6c4f38-ca30-4b59-a9dc-1b505949fc2d'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:59:17.478228 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-ac6c4f38-ca30-4b59-a9dc-1b505949fc2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd888853d02004558b5d5b7d1e3aa59f8', 'request_id': 'req-ac6c4f38-ca30-4b59-a9dc-1b505949fc2d'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:59:17.491180 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-ac6c4f38-ca30-4b59-a9dc-1b505949fc2d admin admin] The token cache is being invalidate because project d888853d02004558b5d5b7d1e3aa59f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86773) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 17:59:17.491450 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-ac6c4f38-ca30-4b59-a9dc-1b505949fc2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:59:17.492067 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-ac6c4f38-ca30-4b59-a9dc-1b505949fc2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:59:17.493923 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1201/2400] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 14 17:59:17 2022] DELETE /identity/v3/projects/d888853d02004558b5d5b7d1e3aa59f8 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:59:17.498766 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d6ba7-2860-4cb3-870e-28861ade45a3 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:59:17.499057 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d6ba7-2860-4cb3-870e-28861ade45a3 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:59:17.499332 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d6ba7-2860-4cb3-870e-28861ade45a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:59:17.521055 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-d64d6ba7-2860-4cb3-870e-28861ade45a3 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:59:17.522291 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-d64d6ba7-2860-4cb3-870e-28861ade45a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:59:17.566412 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:59:17.589704 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1200/2401] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:59:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:59:17.597636 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ea29c4-8c4c-4949-82e7-bec9d08e9213 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:59:17.597960 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ea29c4-8c4c-4949-82e7-bec9d08e9213 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:59:17.598348 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ea29c4-8c4c-4949-82e7-bec9d08e9213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:59:17.617712 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-14ea29c4-8c4c-4949-82e7-bec9d08e9213 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:59:17.618776 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-14ea29c4-8c4c-4949-82e7-bec9d08e9213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:59:17.628478 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1202/2402] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:59:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:59:17.632527 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64d6ba7-2860-4cb3-870e-28861ade45a3 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:59:17.643238 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64d6ba7-2860-4cb3-870e-28861ade45a3 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:59:17.647951 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921c6a73-f2a3-4b32-9d8c-c67b00fbdc99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:59:17.648615 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c6a73-f2a3-4b32-9d8c-c67b00fbdc99 admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:59:17.648900 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c6a73-f2a3-4b32-9d8c-c67b00fbdc99 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:59:17.649177 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c6a73-f2a3-4b32-9d8c-c67b00fbdc99 admin admin] PATH_INFO: `/v3/domains` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:59:17.649949 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921c6a73-f2a3-4b32-9d8c-c67b00fbdc99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 17:59:17.650257 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921c6a73-f2a3-4b32-9d8c-c67b00fbdc99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:59:17.651852 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921c6a73-f2a3-4b32-9d8c-c67b00fbdc99 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:59:17.664493 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1201/2403] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 14 17:59:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 17:59:17.668692 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ea29c4-8c4c-4949-82e7-bec9d08e9213 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:59:17.681147 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ea29c4-8c4c-4949-82e7-bec9d08e9213 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:59:17.688875 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0204e20d-1cd3-4795-8ac6-7b819a27655d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:59:17.689866 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0204e20d-1cd3-4795-8ac6-7b819a27655d admin admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:59:17.690147 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0204e20d-1cd3-4795-8ac6-7b819a27655d admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:59:17.690419 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0204e20d-1cd3-4795-8ac6-7b819a27655d admin admin] PATH_INFO: `/v3/projects` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:59:17.691130 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0204e20d-1cd3-4795-8ac6-7b819a27655d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:59:17.693021 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0204e20d-1cd3-4795-8ac6-7b819a27655d admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:59:17.721346 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1203/2404] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 14 17:59:17 2022] POST /identity/v3/projects => generated 367 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 17:59:17.725677 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921c6a73-f2a3-4b32-9d8c-c67b00fbdc99 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:59:17.737484 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921c6a73-f2a3-4b32-9d8c-c67b00fbdc99 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:59:17.799791 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3109eca3-46ef-4b93-b5d8-4b849e648056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:59:17.800613 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109eca3-46ef-4b93-b5d8-4b849e648056 admin admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:59:17.800932 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109eca3-46ef-4b93-b5d8-4b849e648056 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:59:17.801209 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109eca3-46ef-4b93-b5d8-4b849e648056 admin admin] PATH_INFO: `/v3/users` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:59:17.802159 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3109eca3-46ef-4b93-b5d8-4b849e648056 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:59:17.804115 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3109eca3-46ef-4b93-b5d8-4b849e648056 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:59:17.832070 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1202/2405] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 14 17:59:17 2022] POST /identity/v3/users => generated 284 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 17:59:17.838221 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0204e20d-1cd3-4795-8ac6-7b819a27655d admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:59:17.855718 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0204e20d-1cd3-4795-8ac6-7b819a27655d admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:59:17.861999 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb519efb-c019-4340-980f-f1c7a6707729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:59:17.862796 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb519efb-c019-4340-980f-f1c7a6707729 admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:59:17.863133 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb519efb-c019-4340-980f-f1c7a6707729 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:59:17.863394 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb519efb-c019-4340-980f-f1c7a6707729 admin admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:59:17.864877 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb519efb-c019-4340-980f-f1c7a6707729 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:59:17.866667 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb519efb-c019-4340-980f-f1c7a6707729 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:59:17.887700 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1204/2406] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:59:17 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 17:59:17.893887 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3109eca3-46ef-4b93-b5d8-4b849e648056 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:59:17.910130 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3109eca3-46ef-4b93-b5d8-4b849e648056 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:59:17.919711 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91fe29f-4394-4725-9500-78ea958b0f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:59:17.920582 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91fe29f-4394-4725-9500-78ea958b0f86 admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:59:17.920971 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91fe29f-4394-4725-9500-78ea958b0f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:59:17.921443 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91fe29f-4394-4725-9500-78ea958b0f86 admin admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:59:17.923161 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91fe29f-4394-4725-9500-78ea958b0f86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:59:17.924366 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91fe29f-4394-4725-9500-78ea958b0f86 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:59:17.936277 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1203/2407] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 17:59:17 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 17:59:17.942813 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb519efb-c019-4340-980f-f1c7a6707729 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:59:17.953504 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb519efb-c019-4340-980f-f1c7a6707729 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:59:17.962593 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a82728-fce0-488c-8c36-3631c4f4a5c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:59:17.966079 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a82728-fce0-488c-8c36-3631c4f4a5c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:59:17.966571 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a82728-fce0-488c-8c36-3631c4f4a5c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:59:17.967229 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a82728-fce0-488c-8c36-3631c4f4a5c8 admin admin] PATH_INFO: `/v3/projects/b00e79028e0c46febefa94f5b6e2adc5/users/7c074e61c2ec441895a879e86200d271/roles/95d753870f97426cb1ce32e078621a4c` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:59:17.989995 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a82728-fce0-488c-8c36-3631c4f4a5c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b00e79028e0c46febefa94f5b6e2adc5, user_id=7c074e61c2ec441895a879e86200d271, role_id=95d753870f97426cb1ce32e078621a4c)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:59:17.992686 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a82728-fce0-488c-8c36-3631c4f4a5c8 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:59:18.007637 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1205/2408] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 17:59:17 2022] PUT /identity/v3/projects/b00e79028e0c46febefa94f5b6e2adc5/users/7c074e61c2ec441895a879e86200d271/roles/95d753870f97426cb1ce32e078621a4c => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:59:18.018802 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7780b030-37cf-4c31-b043-b8822903cd4c None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:59:18.019361 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7780b030-37cf-4c31-b043-b8822903cd4c None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:59:18.019361 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7780b030-37cf-4c31-b043-b8822903cd4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:59:18.058012 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-7780b030-37cf-4c31-b043-b8822903cd4c None None] MFA Rules not processed for user `7c074e61c2ec441895a879e86200d271`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:59:18.061608 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-7780b030-37cf-4c31-b043-b8822903cd4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:59:18.140778 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1204/2409] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:59:18 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:59:18.154072 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a82728-fce0-488c-8c36-3631c4f4a5c8 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:59:18.155947 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-41a82728-fce0-488c-8c36-3631c4f4a5c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:59:18.233574 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a82728-fce0-488c-8c36-3631c4f4a5c8 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:59:18.238353 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7bbf65-1889-453c-8462-1988ba6716a4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eb7180aab4541b4aab6cf8648eac1f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:59:18.239195 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7bbf65-1889-453c-8462-1988ba6716a4 service glance] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:59:18.239546 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7bbf65-1889-453c-8462-1988ba6716a4 service glance] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:59:18.239889 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7bbf65-1889-453c-8462-1988ba6716a4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:59:18.247245 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:59:18.250685 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7bbf65-1889-453c-8462-1988ba6716a4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:59:18.253084 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7bbf65-1889-453c-8462-1988ba6716a4 service glance] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:59:18.264073 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1206/2410] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:59:18 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:59:20.260356 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ce15ed-bf01-43d3-aa61-ba397395bd5b None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:59:20.260896 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ce15ed-bf01-43d3-aa61-ba397395bd5b None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:59:20.260896 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ce15ed-bf01-43d3-aa61-ba397395bd5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:59:20.281713 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-87ce15ed-bf01-43d3-aa61-ba397395bd5b None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:59:20.283493 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-87ce15ed-bf01-43d3-aa61-ba397395bd5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:59:20.336823 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:59:20.401218 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1205/2411] 10.222.0.40 () {58 vars in 1016 bytes} [Thu Jul 14 17:59:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 17:59:20.428923 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7bbf65-1889-453c-8462-1988ba6716a4 service glance] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:59:20.431069 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-9d7bbf65-1889-453c-8462-1988ba6716a4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:59:20.561484 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7bbf65-1889-453c-8462-1988ba6716a4 service glance] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:59:20.572674 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa9f176-c682-4557-9c1f-4f24b8c0b3d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41b893bdf4ec474dbfa819c22fc29ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:59:20.573433 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa9f176-c682-4557-9c1f-4f24b8c0b3d2 service nova] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:59:20.573847 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa9f176-c682-4557-9c1f-4f24b8c0b3d2 service nova] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:59:20.574227 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa9f176-c682-4557-9c1f-4f24b8c0b3d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:59:20.584215 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa9f176-c682-4557-9c1f-4f24b8c0b3d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:59:20.586808 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa9f176-c682-4557-9c1f-4f24b8c0b3d2 service nova] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:59:20.598208 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1207/2412] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:59:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:59:25.500503 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f1455-8145-4af9-b9fc-2b40a95a30bf None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:59:25.500993 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f1455-8145-4af9-b9fc-2b40a95a30bf None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:59:25.501195 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f1455-8145-4af9-b9fc-2b40a95a30bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:59:25.521180 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-302f1455-8145-4af9-b9fc-2b40a95a30bf None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:59:25.522416 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-302f1455-8145-4af9-b9fc-2b40a95a30bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:59:25.530607 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1206/2413] 10.222.0.40 () {58 vars in 1016 bytes} [Thu Jul 14 17:59:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:59:25.558926 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa9f176-c682-4557-9c1f-4f24b8c0b3d2 service nova] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:59:25.560871 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-aaa9f176-c682-4557-9c1f-4f24b8c0b3d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:59:25.577559 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa9f176-c682-4557-9c1f-4f24b8c0b3d2 service nova] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:59:25.582861 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133b1844-1829-4d5b-96fc-f6965f4e2727 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41b893bdf4ec474dbfa819c22fc29ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:59:25.583502 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b1844-1829-4d5b-96fc-f6965f4e2727 service nova] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:59:25.583783 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b1844-1829-4d5b-96fc-f6965f4e2727 service nova] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:59:25.584284 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b1844-1829-4d5b-96fc-f6965f4e2727 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:59:25.601970 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133b1844-1829-4d5b-96fc-f6965f4e2727 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:59:25.603983 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133b1844-1829-4d5b-96fc-f6965f4e2727 service nova] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:59:25.615769 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1208/2414] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:59:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:59:35.200455 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e2876-3280-4937-845b-57ab5c9f8185 None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:59:35.201669 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e2876-3280-4937-845b-57ab5c9f8185 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:59:35.202049 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e2876-3280-4937-845b-57ab5c9f8185 None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:59:35.203503 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1207/2415] 10.222.0.67 () {54 vars in 921 bytes} [Thu Jul 14 17:59:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:59:35.210653 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd3d6b-7edf-453c-836d-7f6e0cf6c17d None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:59:35.211172 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd3d6b-7edf-453c-836d-7f6e0cf6c17d None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:59:35.211591 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd3d6b-7edf-453c-836d-7f6e0cf6c17d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:59:35.233310 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-ffcd3d6b-7edf-453c-836d-7f6e0cf6c17d None None] MFA Rules not processed for user `41b893bdf4ec474dbfa819c22fc29ce9`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:59:35.234488 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-ffcd3d6b-7edf-453c-836d-7f6e0cf6c17d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:59:35.244029 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1209/2416] 10.222.0.67 () {58 vars in 1018 bytes} [Thu Jul 14 17:59:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 17:59:35.255874 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6e2876-3280-4937-845b-57ab5c9f8185 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:59:35.257603 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-4a6e2876-3280-4937-845b-57ab5c9f8185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:59:35.271217 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6e2876-3280-4937-845b-57ab5c9f8185 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:59:35.274839 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b300ccc9-8cbf-4318-beea-85be10abd13a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eb7180aab4541b4aab6cf8648eac1f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:59:35.275535 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b300ccc9-8cbf-4318-beea-85be10abd13a service glance] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:59:35.275763 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b300ccc9-8cbf-4318-beea-85be10abd13a service glance] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:59:35.276075 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b300ccc9-8cbf-4318-beea-85be10abd13a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:59:35.287484 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b300ccc9-8cbf-4318-beea-85be10abd13a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:59:35.289208 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b300ccc9-8cbf-4318-beea-85be10abd13a service glance] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:59:35.301715 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1208/2417] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:59:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:59:35.371196 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba34ce-4419-4380-85fd-402814a46d5d None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:59:35.371483 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba34ce-4419-4380-85fd-402814a46d5d None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:59:35.371942 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba34ce-4419-4380-85fd-402814a46d5d None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:59:35.373330 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1210/2418] 10.222.0.67 () {54 vars in 921 bytes} [Thu Jul 14 17:59:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:59:35.378830 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21eac53-da2c-46a8-a62b-ea833a066e17 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:59:35.379194 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21eac53-da2c-46a8-a62b-ea833a066e17 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:59:35.379517 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21eac53-da2c-46a8-a62b-ea833a066e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:59:35.404378 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-b21eac53-da2c-46a8-a62b-ea833a066e17 None None] MFA Rules not processed for user `7bda83c5499f43f9838fda2679a522d4`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:59:35.406091 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-b21eac53-da2c-46a8-a62b-ea833a066e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:59:35.458454 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1209/2419] 10.222.0.67 () {58 vars in 1018 bytes} [Thu Jul 14 17:59:35 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:59:35.471925 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ba34ce-4419-4380-85fd-402814a46d5d None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:59:35.473792 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-20ba34ce-4419-4380-85fd-402814a46d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:59:35.487010 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ba34ce-4419-4380-85fd-402814a46d5d None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:59:35.490451 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5ed2a0-b067-434b-9d2a-6ca793f34c09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:59:35.491097 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5ed2a0-b067-434b-9d2a-6ca793f34c09 service neutron] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:59:35.491382 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5ed2a0-b067-434b-9d2a-6ca793f34c09 service neutron] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:59:35.491660 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5ed2a0-b067-434b-9d2a-6ca793f34c09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:59:35.499277 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5ed2a0-b067-434b-9d2a-6ca793f34c09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:59:35.500707 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5ed2a0-b067-434b-9d2a-6ca793f34c09 service neutron] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:59:35.509379 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1211/2420] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:59:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:59:35.594377 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443118d8-356b-40d2-9642-f20efbe1e3c7 None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:59:35.594773 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443118d8-356b-40d2-9642-f20efbe1e3c7 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:59:35.595058 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443118d8-356b-40d2-9642-f20efbe1e3c7 None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:59:35.596435 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1210/2421] 10.222.0.67 () {54 vars in 921 bytes} [Thu Jul 14 17:59:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 17:59:35.603862 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eddd0f-86a6-4fe9-9117-8c305001d50b None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:59:35.604452 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eddd0f-86a6-4fe9-9117-8c305001d50b None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:59:35.604669 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eddd0f-86a6-4fe9-9117-8c305001d50b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:59:35.624171 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-69eddd0f-86a6-4fe9-9117-8c305001d50b None None] MFA Rules not processed for user `41b893bdf4ec474dbfa819c22fc29ce9`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:59:35.625408 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-69eddd0f-86a6-4fe9-9117-8c305001d50b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:59:35.635923 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1212/2422] 10.222.0.67 () {58 vars in 1018 bytes} [Thu Jul 14 17:59:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 17:59:35.647067 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443118d8-356b-40d2-9642-f20efbe1e3c7 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:59:35.658324 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443118d8-356b-40d2-9642-f20efbe1e3c7 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:59:35.661977 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee999c1-f492-4b3f-afba-daa03b6c2e86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:59:35.662621 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee999c1-f492-4b3f-afba-daa03b6c2e86 service neutron] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:59:35.662903 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee999c1-f492-4b3f-afba-daa03b6c2e86 service neutron] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:59:35.663176 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee999c1-f492-4b3f-afba-daa03b6c2e86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:59:35.673431 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee999c1-f492-4b3f-afba-daa03b6c2e86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:59:35.674923 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee999c1-f492-4b3f-afba-daa03b6c2e86 service neutron] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:59:35.685589 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1211/2423] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:59:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:59:42.826680 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1942648-e39b-47dd-802e-62fd10729737 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:59:42.827527 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1942648-e39b-47dd-802e-62fd10729737 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:59:42.827872 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1942648-e39b-47dd-802e-62fd10729737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:59:42.873762 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-a1942648-e39b-47dd-802e-62fd10729737 None None] MFA Rules not processed for user `45542602225b452fa323f5499c1843ec`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:59:42.877995 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-a1942648-e39b-47dd-802e-62fd10729737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:59:42.957338 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1213/2424] 10.222.0.67 () {58 vars in 1009 bytes} [Thu Jul 14 17:59:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:59:42.971095 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee999c1-f492-4b3f-afba-daa03b6c2e86 service neutron] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:59:42.972586 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-8ee999c1-f492-4b3f-afba-daa03b6c2e86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:59:43.060713 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee999c1-f492-4b3f-afba-daa03b6c2e86 service neutron] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:59:43.066333 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b656e8a-6f05-4637-924e-9e4249b966e2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c65607a396474192a43c374d306ef5ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:59:43.066963 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b656e8a-6f05-4637-924e-9e4249b966e2 service swift] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:59:43.067315 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b656e8a-6f05-4637-924e-9e4249b966e2 service swift] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:59:43.067535 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b656e8a-6f05-4637-924e-9e4249b966e2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:59:43.078085 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b656e8a-6f05-4637-924e-9e4249b966e2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:59:43.081951 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b656e8a-6f05-4637-924e-9e4249b966e2 service swift] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:59:43.094101 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1212/2425] 10.222.0.67 () {60 vars in 1384 bytes} [Thu Jul 14 17:59:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 17:59:52.950595 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=79 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:59:53.090001 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=79 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 17:59:58.216109 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1942648-e39b-47dd-802e-62fd10729737 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:59:58.228710 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1942648-e39b-47dd-802e-62fd10729737 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:59:58.233272 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb77e7b-2cfe-42ad-835d-546b74dded4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:59:58.234178 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb77e7b-2cfe-42ad-835d-546b74dded4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:59:58.234464 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb77e7b-2cfe-42ad-835d-546b74dded4b admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:59:58.234745 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb77e7b-2cfe-42ad-835d-546b74dded4b admin admin] PATH_INFO: `/v3/users/7c074e61c2ec441895a879e86200d271` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:59:58.235931 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb77e7b-2cfe-42ad-835d-546b74dded4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c074e61c2ec441895a879e86200d271)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:59:58.237885 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb77e7b-2cfe-42ad-835d-546b74dded4b admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:59:58.290923 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-4bb77e7b-2cfe-42ad-835d-546b74dded4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c074e61c2ec441895a879e86200d271'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:59:58.299439 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-4bb77e7b-2cfe-42ad-835d-546b74dded4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c074e61c2ec441895a879e86200d271'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:59:58.312646 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-4bb77e7b-2cfe-42ad-835d-546b74dded4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c074e61c2ec441895a879e86200d271'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:59:58.313330 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-4bb77e7b-2cfe-42ad-835d-546b74dded4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c074e61c2ec441895a879e86200d271'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:59:58.313965 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-4bb77e7b-2cfe-42ad-835d-546b74dded4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c074e61c2ec441895a879e86200d271'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:59:58.326438 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1214/2426] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 14 17:59:58 2022] DELETE /identity/v3/users/7c074e61c2ec441895a879e86200d271 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 17:59:58.330828 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394f036a-c43e-4e7b-85a3-5f13528ed44c None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:59:58.331364 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394f036a-c43e-4e7b-85a3-5f13528ed44c None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:59:58.331364 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394f036a-c43e-4e7b-85a3-5f13528ed44c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:59:58.349014 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-394f036a-c43e-4e7b-85a3-5f13528ed44c None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 17:59:58.350242 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-394f036a-c43e-4e7b-85a3-5f13528ed44c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:59:58.408799 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1213/2427] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 17:59:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 17:59:58.419479 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb77e7b-2cfe-42ad-835d-546b74dded4b admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:59:58.420887 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-4bb77e7b-2cfe-42ad-835d-546b74dded4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:59:58.480753 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb77e7b-2cfe-42ad-835d-546b74dded4b admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:59:58.485064 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3106703-c095-42cd-acca-0946474049b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:59:58.485737 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3106703-c095-42cd-acca-0946474049b1 service neutron] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:59:58.486017 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3106703-c095-42cd-acca-0946474049b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:59:58.486289 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3106703-c095-42cd-acca-0946474049b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:59:58.495828 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3106703-c095-42cd-acca-0946474049b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:59:58.497563 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3106703-c095-42cd-acca-0946474049b1 service neutron] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:59:58.507539 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1215/2428] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 17:59:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 17:59:58.783154 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394f036a-c43e-4e7b-85a3-5f13528ed44c None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 17:59:58.784853 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-394f036a-c43e-4e7b-85a3-5f13528ed44c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 17:59:58.803350 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394f036a-c43e-4e7b-85a3-5f13528ed44c None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 17:59:58.808821 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79c8748-5ca0-4187-8e15-94565689f338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 17:59:58.810136 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c8748-5ca0-4187-8e15-94565689f338 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 17:59:58.810539 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c8748-5ca0-4187-8e15-94565689f338 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 17:59:58.810809 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c8748-5ca0-4187-8e15-94565689f338 admin admin] PATH_INFO: `/v3/projects/b00e79028e0c46febefa94f5b6e2adc5` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 17:59:58.812229 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79c8748-5ca0-4187-8e15-94565689f338 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b00e79028e0c46febefa94f5b6e2adc5)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 17:59:58.814497 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79c8748-5ca0-4187-8e15-94565689f338 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 17:59:58.877464 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-b79c8748-5ca0-4187-8e15-94565689f338 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b00e79028e0c46febefa94f5b6e2adc5', 'request_id': 'req-b79c8748-5ca0-4187-8e15-94565689f338'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:59:58.888790 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-b79c8748-5ca0-4187-8e15-94565689f338 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b00e79028e0c46febefa94f5b6e2adc5', 'request_id': 'req-b79c8748-5ca0-4187-8e15-94565689f338'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:59:58.897441 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-b79c8748-5ca0-4187-8e15-94565689f338 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b00e79028e0c46febefa94f5b6e2adc5', 'request_id': 'req-b79c8748-5ca0-4187-8e15-94565689f338'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:59:58.910288 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-b79c8748-5ca0-4187-8e15-94565689f338 admin admin] The token cache is being invalidate because project b00e79028e0c46febefa94f5b6e2adc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86772) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 17:59:58.910576 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-b79c8748-5ca0-4187-8e15-94565689f338 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:59:58.911255 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-b79c8748-5ca0-4187-8e15-94565689f338 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 17:59:58.912839 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1214/2429] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 14 17:59:58 2022] DELETE /identity/v3/projects/b00e79028e0c46febefa94f5b6e2adc5 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:00:07.859173 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d5aeda-3957-4dd2-a4c4-8d6e9ee0c9c0 None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:00:07.859732 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d5aeda-3957-4dd2-a4c4-8d6e9ee0c9c0 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:00:07.859828 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d5aeda-3957-4dd2-a4c4-8d6e9ee0c9c0 None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:00:07.861199 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1216/2430] 10.222.0.67 () {54 vars in 921 bytes} [Thu Jul 14 18:00:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:00:07.874426 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952652fc-eb52-43f0-83a9-b35852e9312f None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:00:07.875305 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952652fc-eb52-43f0-83a9-b35852e9312f None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:00:07.875586 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952652fc-eb52-43f0-83a9-b35852e9312f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:00:07.896170 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-952652fc-eb52-43f0-83a9-b35852e9312f None None] MFA Rules not processed for user `5324ab45f4a4449980dad920278f5034`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:00:07.897379 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-952652fc-eb52-43f0-83a9-b35852e9312f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:00:07.945320 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d5aeda-3957-4dd2-a4c4-8d6e9ee0c9c0 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:00:07.949113 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-35d5aeda-3957-4dd2-a4c4-8d6e9ee0c9c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:00:07.978982 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1215/2431] 10.222.0.67 () {58 vars in 1018 bytes} [Thu Jul 14 18:00:07 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:00:07.991073 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952652fc-eb52-43f0-83a9-b35852e9312f None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:00:07.993009 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-952652fc-eb52-43f0-83a9-b35852e9312f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:00:08.007341 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952652fc-eb52-43f0-83a9-b35852e9312f None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:00:08.013398 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fd0454-a313-4bcb-86a3-8ed85f9ef78f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5324ab45f4a4449980dad920278f5034', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:00:08.013823 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd0454-a313-4bcb-86a3-8ed85f9ef78f service placement] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:00:08.014149 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd0454-a313-4bcb-86a3-8ed85f9ef78f service placement] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:00:08.014505 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd0454-a313-4bcb-86a3-8ed85f9ef78f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:00:08.024648 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fd0454-a313-4bcb-86a3-8ed85f9ef78f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:00:08.026407 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fd0454-a313-4bcb-86a3-8ed85f9ef78f service placement] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:00:08.033134 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d5aeda-3957-4dd2-a4c4-8d6e9ee0c9c0 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:00:08.036655 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1216/2432] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 18:00:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 18:00:08.038756 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842783ee-fe0f-4cfd-a42b-269d1df59880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:00:08.039715 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842783ee-fe0f-4cfd-a42b-269d1df59880 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:00:08.040034 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842783ee-fe0f-4cfd-a42b-269d1df59880 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:00:08.040313 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842783ee-fe0f-4cfd-a42b-269d1df59880 admin admin] PATH_INFO: `/v3/users/6cb37447d9024c49b2997e4d753f0059` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:00:08.041616 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842783ee-fe0f-4cfd-a42b-269d1df59880 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cb37447d9024c49b2997e4d753f0059)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:00:08.043644 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842783ee-fe0f-4cfd-a42b-269d1df59880 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:00:08.061613 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:00:08.101171 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-842783ee-fe0f-4cfd-a42b-269d1df59880 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cb37447d9024c49b2997e4d753f0059'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:00:08.108745 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-842783ee-fe0f-4cfd-a42b-269d1df59880 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cb37447d9024c49b2997e4d753f0059'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:00:08.121825 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-842783ee-fe0f-4cfd-a42b-269d1df59880 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cb37447d9024c49b2997e4d753f0059'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:00:08.123108 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-842783ee-fe0f-4cfd-a42b-269d1df59880 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cb37447d9024c49b2997e4d753f0059'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:00:08.123734 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-842783ee-fe0f-4cfd-a42b-269d1df59880 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cb37447d9024c49b2997e4d753f0059'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:00:08.136817 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1217/2433] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 14 18:00:07 2022] DELETE /identity/v3/users/6cb37447d9024c49b2997e4d753f0059 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 18:00:08.312873 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fd0454-a313-4bcb-86a3-8ed85f9ef78f service placement] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:00:08.326850 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fd0454-a313-4bcb-86a3-8ed85f9ef78f service placement] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:00:08.331018 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:00:08.397140 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e86237a-34ef-41b1-8267-117f28a1f422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:00:08.398039 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e86237a-34ef-41b1-8267-117f28a1f422 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:00:08.398326 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e86237a-34ef-41b1-8267-117f28a1f422 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:00:08.398606 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e86237a-34ef-41b1-8267-117f28a1f422 admin admin] PATH_INFO: `/v3/projects/f2a07212dc1741f19a0e5f6982a4d58d` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:00:08.399821 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e86237a-34ef-41b1-8267-117f28a1f422 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2a07212dc1741f19a0e5f6982a4d58d)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:00:08.401793 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e86237a-34ef-41b1-8267-117f28a1f422 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:00:08.447798 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-2e86237a-34ef-41b1-8267-117f28a1f422 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2a07212dc1741f19a0e5f6982a4d58d', 'request_id': 'req-2e86237a-34ef-41b1-8267-117f28a1f422'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:00:08.453222 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-2e86237a-34ef-41b1-8267-117f28a1f422 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2a07212dc1741f19a0e5f6982a4d58d', 'request_id': 'req-2e86237a-34ef-41b1-8267-117f28a1f422'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:00:08.462933 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-2e86237a-34ef-41b1-8267-117f28a1f422 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2a07212dc1741f19a0e5f6982a4d58d', 'request_id': 'req-2e86237a-34ef-41b1-8267-117f28a1f422'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:00:08.474402 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-2e86237a-34ef-41b1-8267-117f28a1f422 admin admin] The token cache is being invalidate because project f2a07212dc1741f19a0e5f6982a4d58d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86772) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 18:00:08.474803 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-2e86237a-34ef-41b1-8267-117f28a1f422 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:00:08.475445 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-2e86237a-34ef-41b1-8267-117f28a1f422 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:00:08.477607 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1217/2434] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 14 18:00:08 2022] DELETE /identity/v3/projects/f2a07212dc1741f19a0e5f6982a4d58d => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:00:09.896584 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ebae2-d4e1-44d4-b0bd-9135c55a0c4f None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:00:09.897116 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ebae2-d4e1-44d4-b0bd-9135c55a0c4f None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:00:09.897116 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ebae2-d4e1-44d4-b0bd-9135c55a0c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:00:09.917275 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-e19ebae2-d4e1-44d4-b0bd-9135c55a0c4f None None] MFA Rules not processed for user `45542602225b452fa323f5499c1843ec`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:00:09.918615 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-e19ebae2-d4e1-44d4-b0bd-9135c55a0c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:00:09.979277 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1218/2435] 10.222.0.67 () {58 vars in 967 bytes} [Thu Jul 14 18:00:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:00:10.002201 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e86237a-34ef-41b1-8267-117f28a1f422 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:00:10.003629 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-2e86237a-34ef-41b1-8267-117f28a1f422 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:00:10.075666 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e86237a-34ef-41b1-8267-117f28a1f422 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:00:10.080810 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792bf15f-fd6a-460a-a685-f17c02f0398e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c65607a396474192a43c374d306ef5ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:00:10.081460 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792bf15f-fd6a-460a-a685-f17c02f0398e service swift] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:00:10.081771 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792bf15f-fd6a-460a-a685-f17c02f0398e service swift] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:00:10.082049 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792bf15f-fd6a-460a-a685-f17c02f0398e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:00:10.090529 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792bf15f-fd6a-460a-a685-f17c02f0398e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:00:10.092110 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792bf15f-fd6a-460a-a685-f17c02f0398e service swift] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:00:10.100204 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1218/2436] 10.222.0.67 () {60 vars in 1384 bytes} [Thu Jul 14 18:00:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 18:00:10.632547 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19ebae2-d4e1-44d4-b0bd-9135c55a0c4f None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:00:10.633978 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-e19ebae2-d4e1-44d4-b0bd-9135c55a0c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:00:10.692734 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19ebae2-d4e1-44d4-b0bd-9135c55a0c4f None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:00:10.696221 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688ad10b-f58d-4fa2-8c6d-65d9849a458f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:00:10.696862 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688ad10b-f58d-4fa2-8c6d-65d9849a458f service neutron] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:00:10.697145 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688ad10b-f58d-4fa2-8c6d-65d9849a458f service neutron] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:00:10.697613 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688ad10b-f58d-4fa2-8c6d-65d9849a458f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:00:10.699384 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-688ad10b-f58d-4fa2-8c6d-65d9849a458f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:00:10.749058 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:00:10.770458 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688ad10b-f58d-4fa2-8c6d-65d9849a458f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:00:10.771894 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688ad10b-f58d-4fa2-8c6d-65d9849a458f service neutron] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:00:10.783197 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1219/2437] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 18:00:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:00:11.962550 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792bf15f-fd6a-460a-a685-f17c02f0398e service swift] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:00:11.971772 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792bf15f-fd6a-460a-a685-f17c02f0398e service swift] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:00:11.975448 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0964bb4b-47a4-4620-9e1d-599e14c099bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:00:11.976078 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0964bb4b-47a4-4620-9e1d-599e14c099bb service neutron] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:00:11.976357 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0964bb4b-47a4-4620-9e1d-599e14c099bb service neutron] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:00:11.976629 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0964bb4b-47a4-4620-9e1d-599e14c099bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:00:11.978864 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-0964bb4b-47a4-4620-9e1d-599e14c099bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:00:11.991988 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0964bb4b-47a4-4620-9e1d-599e14c099bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:00:11.994293 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0964bb4b-47a4-4620-9e1d-599e14c099bb service neutron] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:00:12.005254 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1219/2438] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 18:00:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:00:20.778343 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=9 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:00:22.000480 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=86,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:00:26.598433 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688ad10b-f58d-4fa2-8c6d-65d9849a458f service neutron] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:00:26.599842 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-688ad10b-f58d-4fa2-8c6d-65d9849a458f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:00:26.613970 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688ad10b-f58d-4fa2-8c6d-65d9849a458f service neutron] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:00:26.619669 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bf7bed-aeeb-40f3-86d9-6eb607bdf629 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41b893bdf4ec474dbfa819c22fc29ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:00:26.620321 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf7bed-aeeb-40f3-86d9-6eb607bdf629 service nova] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:00:26.620608 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf7bed-aeeb-40f3-86d9-6eb607bdf629 service nova] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:00:26.620889 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf7bed-aeeb-40f3-86d9-6eb607bdf629 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:00:26.622718 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-e5bf7bed-aeeb-40f3-86d9-6eb607bdf629 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:00:26.680733 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bf7bed-aeeb-40f3-86d9-6eb607bdf629 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:00:26.682352 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bf7bed-aeeb-40f3-86d9-6eb607bdf629 service nova] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:00:26.691373 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1220/2439] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 18:00:26 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:00:30.347652 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3873316a-fa7a-44d1-b49a-0e29461f77ea None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:00:30.348193 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3873316a-fa7a-44d1-b49a-0e29461f77ea None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:00:30.348193 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3873316a-fa7a-44d1-b49a-0e29461f77ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:00:30.365919 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-3873316a-fa7a-44d1-b49a-0e29461f77ea None None] MFA Rules not processed for user `eb82471499754e30a4dc121c40b208a3`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:00:30.367099 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-3873316a-fa7a-44d1-b49a-0e29461f77ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:00:30.374559 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1220/2440] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 18:00:30 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:00:36.687065 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=28 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:00:40.361246 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=3 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:00:49.065237 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bf7bed-aeeb-40f3-86d9-6eb607bdf629 service nova] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:00:49.077220 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bf7bed-aeeb-40f3-86d9-6eb607bdf629 service nova] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:00:49.083378 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88010df-fc2a-49bc-a5b7-6974bb9da197 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41b893bdf4ec474dbfa819c22fc29ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:00:49.084055 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88010df-fc2a-49bc-a5b7-6974bb9da197 service nova] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:00:49.084338 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88010df-fc2a-49bc-a5b7-6974bb9da197 service nova] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:00:49.084617 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88010df-fc2a-49bc-a5b7-6974bb9da197 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:00:49.086527 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-b88010df-fc2a-49bc-a5b7-6974bb9da197 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:00:49.154177 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88010df-fc2a-49bc-a5b7-6974bb9da197 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:00:49.155792 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88010df-fc2a-49bc-a5b7-6974bb9da197 service nova] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:00:49.166065 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1221/2441] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 18:00:49 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:00:59.161397 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=28 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:01:06.506282 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3873316a-fa7a-44d1-b49a-0e29461f77ea None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:01:06.517919 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3873316a-fa7a-44d1-b49a-0e29461f77ea None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:01:06.521911 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8260ad-457f-4e24-9b4f-a294f474eb85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:01:06.522800 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8260ad-457f-4e24-9b4f-a294f474eb85 service neutron] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:01:06.523087 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8260ad-457f-4e24-9b4f-a294f474eb85 service neutron] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:01:06.523376 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8260ad-457f-4e24-9b4f-a294f474eb85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:01:06.525438 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-1e8260ad-457f-4e24-9b4f-a294f474eb85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:01:06.560747 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8260ad-457f-4e24-9b4f-a294f474eb85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:01:06.562380 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8260ad-457f-4e24-9b4f-a294f474eb85 service neutron] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:01:06.571853 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1221/2442] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 18:01:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:01:16.567741 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=10 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:01:19.209294 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88010df-fc2a-49bc-a5b7-6974bb9da197 service nova] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:01:19.251409 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88010df-fc2a-49bc-a5b7-6974bb9da197 service nova] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:01:19.256834 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00d3caf-0f03-4e50-8ae0-ffead63f6445 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41b893bdf4ec474dbfa819c22fc29ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:01:19.257449 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00d3caf-0f03-4e50-8ae0-ffead63f6445 service nova] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:01:19.257755 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00d3caf-0f03-4e50-8ae0-ffead63f6445 service nova] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:01:19.258037 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00d3caf-0f03-4e50-8ae0-ffead63f6445 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:01:19.259916 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-e00d3caf-0f03-4e50-8ae0-ffead63f6445 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:01:19.317218 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00d3caf-0f03-4e50-8ae0-ffead63f6445 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:01:19.318848 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00d3caf-0f03-4e50-8ae0-ffead63f6445 service nova] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:01:19.327859 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1222/2443] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 18:01:19 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 18:01:25.545570 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8260ad-457f-4e24-9b4f-a294f474eb85 service neutron] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:01:25.546556 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-1e8260ad-457f-4e24-9b4f-a294f474eb85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:01:25.597494 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8260ad-457f-4e24-9b4f-a294f474eb85 service neutron] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:01:25.608319 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1730895c-eb06-44e5-a977-af20f926ea32 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41b893bdf4ec474dbfa819c22fc29ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:01:25.609164 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1730895c-eb06-44e5-a977-af20f926ea32 service nova] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:01:25.609451 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1730895c-eb06-44e5-a977-af20f926ea32 service nova] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:01:25.609751 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1730895c-eb06-44e5-a977-af20f926ea32 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:01:25.614626 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-1730895c-eb06-44e5-a977-af20f926ea32 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:01:25.639406 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1730895c-eb06-44e5-a977-af20f926ea32 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:01:25.642826 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1730895c-eb06-44e5-a977-af20f926ea32 service nova] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:01:25.664413 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1222/2444] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 18:01:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:01:28.653067 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0e8ab0-2fd2-417b-a795-23ece0e32268 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:01:28.653604 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0e8ab0-2fd2-417b-a795-23ece0e32268 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:01:28.653707 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0e8ab0-2fd2-417b-a795-23ece0e32268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:01:28.671479 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-3e0e8ab0-2fd2-417b-a795-23ece0e32268 None None] MFA Rules not processed for user `dc2eceb8989543d4bdbbcd706ddbe676`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:01:28.672670 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-3e0e8ab0-2fd2-417b-a795-23ece0e32268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:01:28.679485 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1223/2445] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 18:01:28 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:01:28.989006 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1730895c-eb06-44e5-a977-af20f926ea32 service nova] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:01:29.007531 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1730895c-eb06-44e5-a977-af20f926ea32 service nova] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:01:29.011607 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f90e1bd-938a-4ee0-b4a2-e7bda186f794 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:01:29.012246 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f90e1bd-938a-4ee0-b4a2-e7bda186f794 service neutron] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:01:29.012535 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f90e1bd-938a-4ee0-b4a2-e7bda186f794 service neutron] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:01:29.012812 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f90e1bd-938a-4ee0-b4a2-e7bda186f794 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:01:29.014618 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-5f90e1bd-938a-4ee0-b4a2-e7bda186f794 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:01:29.036963 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f90e1bd-938a-4ee0-b4a2-e7bda186f794 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:01:29.038427 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f90e1bd-938a-4ee0-b4a2-e7bda186f794 service neutron] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:01:29.046565 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1223/2446] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 18:01:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:01:29.362547 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0e8ab0-2fd2-417b-a795-23ece0e32268 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:01:29.363994 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-3e0e8ab0-2fd2-417b-a795-23ece0e32268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:01:29.438732 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0e8ab0-2fd2-417b-a795-23ece0e32268 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:01:29.443762 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e06e3b-c343-4d6d-ae0e-3396d874cbc9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5324ab45f4a4449980dad920278f5034', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:01:29.444413 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e06e3b-c343-4d6d-ae0e-3396d874cbc9 service placement] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:01:29.444699 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e06e3b-c343-4d6d-ae0e-3396d874cbc9 service placement] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:01:29.444977 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e06e3b-c343-4d6d-ae0e-3396d874cbc9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:01:29.447437 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-27e06e3b-c343-4d6d-ae0e-3396d874cbc9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:01:29.459530 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e06e3b-c343-4d6d-ae0e-3396d874cbc9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:01:29.461145 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e06e3b-c343-4d6d-ae0e-3396d874cbc9 service placement] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:01:29.471516 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1224/2447] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 18:01:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:01:37.768721 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f90e1bd-938a-4ee0-b4a2-e7bda186f794 service neutron] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:01:37.782808 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f90e1bd-938a-4ee0-b4a2-e7bda186f794 service neutron] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:01:37.788446 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5bdc02-0752-47cf-b76d-b17a00850364 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41b893bdf4ec474dbfa819c22fc29ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:01:37.789099 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5bdc02-0752-47cf-b76d-b17a00850364 service nova] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:01:37.789374 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5bdc02-0752-47cf-b76d-b17a00850364 service nova] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:01:37.789687 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5bdc02-0752-47cf-b76d-b17a00850364 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:01:37.791480 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-ad5bdc02-0752-47cf-b76d-b17a00850364 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:01:37.804197 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5bdc02-0752-47cf-b76d-b17a00850364 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:01:37.805862 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5bdc02-0752-47cf-b76d-b17a00850364 service nova] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:01:37.816831 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1224/2448] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 18:01:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:01:39.467137 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=77 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:01:47.812323 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=36 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:02:01.743609 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e06e3b-c343-4d6d-ae0e-3396d874cbc9 service placement] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:02:01.753746 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e06e3b-c343-4d6d-ae0e-3396d874cbc9 service placement] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:02:01.757282 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e3127b-a432-40d7-aea3-8b67307da96d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:02:01.757962 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e3127b-a432-40d7-aea3-8b67307da96d service neutron] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:02:01.758244 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e3127b-a432-40d7-aea3-8b67307da96d service neutron] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:02:01.758519 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e3127b-a432-40d7-aea3-8b67307da96d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:02:01.760283 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-29e3127b-a432-40d7-aea3-8b67307da96d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:02:01.866370 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e3127b-a432-40d7-aea3-8b67307da96d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:02:01.867858 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e3127b-a432-40d7-aea3-8b67307da96d service neutron] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:02:01.892026 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1225/2449] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 18:02:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:02:05.657165 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5bdc02-0752-47cf-b76d-b17a00850364 service nova] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:02:05.658715 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-ad5bdc02-0752-47cf-b76d-b17a00850364 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:02:05.681140 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5bdc02-0752-47cf-b76d-b17a00850364 service nova] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:02:05.686190 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bf0727-521b-4e54-9fa4-f10e79edda5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:02:05.687130 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf0727-521b-4e54-9fa4-f10e79edda5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:02:05.687407 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf0727-521b-4e54-9fa4-f10e79edda5e admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:02:05.687675 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf0727-521b-4e54-9fa4-f10e79edda5e admin admin] PATH_INFO: `/v3/users/eb82471499754e30a4dc121c40b208a3` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:02:05.688882 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bf0727-521b-4e54-9fa4-f10e79edda5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb82471499754e30a4dc121c40b208a3)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:02:05.691166 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bf0727-521b-4e54-9fa4-f10e79edda5e admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:02:05.746194 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-35bf0727-521b-4e54-9fa4-f10e79edda5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb82471499754e30a4dc121c40b208a3'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:02:05.756131 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-35bf0727-521b-4e54-9fa4-f10e79edda5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb82471499754e30a4dc121c40b208a3'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:02:05.765130 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-35bf0727-521b-4e54-9fa4-f10e79edda5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb82471499754e30a4dc121c40b208a3'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:02:05.766049 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-35bf0727-521b-4e54-9fa4-f10e79edda5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb82471499754e30a4dc121c40b208a3'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:02:05.780481 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-35bf0727-521b-4e54-9fa4-f10e79edda5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb82471499754e30a4dc121c40b208a3'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:02:05.787399 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1225/2450] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 14 18:02:05 2022] DELETE /identity/v3/users/eb82471499754e30a4dc121c40b208a3 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:02:05.981939 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e3127b-a432-40d7-aea3-8b67307da96d service neutron] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:02:05.998639 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e3127b-a432-40d7-aea3-8b67307da96d service neutron] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:02:06.063323 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb288ba-6997-4aca-945b-e4cc6996a501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:02:06.064373 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb288ba-6997-4aca-945b-e4cc6996a501 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:02:06.064704 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb288ba-6997-4aca-945b-e4cc6996a501 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:02:06.065027 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb288ba-6997-4aca-945b-e4cc6996a501 admin admin] PATH_INFO: `/v3/projects/f7487b126eed4c2f9f571d3e94b3ae6a` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:02:06.066542 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb288ba-6997-4aca-945b-e4cc6996a501 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7487b126eed4c2f9f571d3e94b3ae6a)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:02:06.068688 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb288ba-6997-4aca-945b-e4cc6996a501 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:02:06.118252 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-feb288ba-6997-4aca-945b-e4cc6996a501 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7487b126eed4c2f9f571d3e94b3ae6a', 'request_id': 'req-feb288ba-6997-4aca-945b-e4cc6996a501'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:02:06.131287 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-feb288ba-6997-4aca-945b-e4cc6996a501 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7487b126eed4c2f9f571d3e94b3ae6a', 'request_id': 'req-feb288ba-6997-4aca-945b-e4cc6996a501'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:02:06.141771 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-feb288ba-6997-4aca-945b-e4cc6996a501 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7487b126eed4c2f9f571d3e94b3ae6a', 'request_id': 'req-feb288ba-6997-4aca-945b-e4cc6996a501'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:02:06.147650 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:02:06.158255 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-feb288ba-6997-4aca-945b-e4cc6996a501 admin admin] The token cache is being invalidate because project f7487b126eed4c2f9f571d3e94b3ae6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86773) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 18:02:06.158609 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-feb288ba-6997-4aca-945b-e4cc6996a501 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:02:06.159273 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-feb288ba-6997-4aca-945b-e4cc6996a501 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:02:06.164489 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1226/2451] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 14 18:02:05 2022] DELETE /identity/v3/projects/f7487b126eed4c2f9f571d3e94b3ae6a => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:02:06.166728 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f8963-4cd1-4698-8be6-0f3d3293970c None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:02:06.167042 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f8963-4cd1-4698-8be6-0f3d3293970c None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:02:06.167632 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f8963-4cd1-4698-8be6-0f3d3293970c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:02:06.237051 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-138f8963-4cd1-4698-8be6-0f3d3293970c None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:02:06.238550 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-138f8963-4cd1-4698-8be6-0f3d3293970c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:02:06.319591 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1226/2452] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 18:02:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:02:06.327611 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bbc8d8-b066-4b39-ab2d-2aaf7cf381b6 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:02:06.327923 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bbc8d8-b066-4b39-ab2d-2aaf7cf381b6 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:02:06.328169 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bbc8d8-b066-4b39-ab2d-2aaf7cf381b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:02:06.348813 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-b1bbc8d8-b066-4b39-ab2d-2aaf7cf381b6 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:02:06.350084 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-b1bbc8d8-b066-4b39-ab2d-2aaf7cf381b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:02:06.359187 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1227/2453] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 18:02:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 18:02:06.364676 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138f8963-4cd1-4698-8be6-0f3d3293970c None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:02:06.383738 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138f8963-4cd1-4698-8be6-0f3d3293970c None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:02:06.402015 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820131c4-d171-4d2c-a4be-153c8e7258ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:02:06.403100 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820131c4-d171-4d2c-a4be-153c8e7258ad admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:02:06.405077 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820131c4-d171-4d2c-a4be-153c8e7258ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:02:06.405617 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820131c4-d171-4d2c-a4be-153c8e7258ad admin admin] PATH_INFO: `/v3/domains` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:02:06.407877 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820131c4-d171-4d2c-a4be-153c8e7258ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:02:06.408438 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820131c4-d171-4d2c-a4be-153c8e7258ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:02:06.413208 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820131c4-d171-4d2c-a4be-153c8e7258ad admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:02:06.437916 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1227/2454] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 14 18:02:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:02:06.442799 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bbc8d8-b066-4b39-ab2d-2aaf7cf381b6 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:02:06.462678 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bbc8d8-b066-4b39-ab2d-2aaf7cf381b6 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:02:06.470908 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d031d7-441e-4a38-98ce-fa01cb4af51c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:02:06.471601 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d031d7-441e-4a38-98ce-fa01cb4af51c admin admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:02:06.471888 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d031d7-441e-4a38-98ce-fa01cb4af51c admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:02:06.472193 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d031d7-441e-4a38-98ce-fa01cb4af51c admin admin] PATH_INFO: `/v3/projects` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:02:06.472922 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d031d7-441e-4a38-98ce-fa01cb4af51c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:02:06.475603 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d031d7-441e-4a38-98ce-fa01cb4af51c admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:02:06.536949 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1228/2455] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 14 18:02:06 2022] POST /identity/v3/projects => generated 383 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 18:02:06.542515 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820131c4-d171-4d2c-a4be-153c8e7258ad admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:02:06.555756 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820131c4-d171-4d2c-a4be-153c8e7258ad admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:02:06.587477 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:02:06.629891 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12415ed-2288-499a-a58c-958f9f914be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:02:06.630576 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12415ed-2288-499a-a58c-958f9f914be8 admin admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:02:06.630858 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12415ed-2288-499a-a58c-958f9f914be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:02:06.631135 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12415ed-2288-499a-a58c-958f9f914be8 admin admin] PATH_INFO: `/v3/users` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:02:06.631894 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12415ed-2288-499a-a58c-958f9f914be8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:02:06.633875 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12415ed-2288-499a-a58c-958f9f914be8 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:02:06.656977 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1228/2456] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 14 18:02:06 2022] POST /identity/v3/users => generated 292 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 18:02:06.661118 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d031d7-441e-4a38-98ce-fa01cb4af51c admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:02:06.678210 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d031d7-441e-4a38-98ce-fa01cb4af51c admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:02:06.685187 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d7c72f-e128-43a7-aea2-985d56ebed1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:02:06.686315 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d7c72f-e128-43a7-aea2-985d56ebed1c admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:02:06.686708 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d7c72f-e128-43a7-aea2-985d56ebed1c admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:02:06.687016 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d7c72f-e128-43a7-aea2-985d56ebed1c admin admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:02:06.688042 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d7c72f-e128-43a7-aea2-985d56ebed1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:02:06.690730 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d7c72f-e128-43a7-aea2-985d56ebed1c admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:02:06.702753 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1229/2457] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 18:02:06 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 18:02:06.708227 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12415ed-2288-499a-a58c-958f9f914be8 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:02:06.721246 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12415ed-2288-499a-a58c-958f9f914be8 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:02:06.729044 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ddea6c-bc96-4852-adb7-f219cf90b492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:02:06.731600 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ddea6c-bc96-4852-adb7-f219cf90b492 admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:02:06.731600 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ddea6c-bc96-4852-adb7-f219cf90b492 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:02:06.732213 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ddea6c-bc96-4852-adb7-f219cf90b492 admin admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:02:06.732894 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ddea6c-bc96-4852-adb7-f219cf90b492 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:02:06.734687 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ddea6c-bc96-4852-adb7-f219cf90b492 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:02:06.746952 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1229/2458] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 18:02:06 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 18:02:06.752055 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d7c72f-e128-43a7-aea2-985d56ebed1c admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:02:06.768900 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d7c72f-e128-43a7-aea2-985d56ebed1c admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:02:06.775896 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e0501c-6efa-4254-acbb-5f010cbda782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:02:06.777444 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e0501c-6efa-4254-acbb-5f010cbda782 admin admin] REQUEST_METHOD: `PUT` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:02:06.777990 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e0501c-6efa-4254-acbb-5f010cbda782 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:02:06.778479 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e0501c-6efa-4254-acbb-5f010cbda782 admin admin] PATH_INFO: `/v3/projects/cbec0871ac2848e093d084460db28350/users/17180b44ab2440f6ae13e674234ae1c4/roles/95d753870f97426cb1ce32e078621a4c` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:02:06.806127 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e0501c-6efa-4254-acbb-5f010cbda782 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbec0871ac2848e093d084460db28350, user_id=17180b44ab2440f6ae13e674234ae1c4, role_id=95d753870f97426cb1ce32e078621a4c)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:02:06.812325 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e0501c-6efa-4254-acbb-5f010cbda782 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:02:06.829874 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1230/2459] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 18:02:06 2022] PUT /identity/v3/projects/cbec0871ac2848e093d084460db28350/users/17180b44ab2440f6ae13e674234ae1c4/roles/95d753870f97426cb1ce32e078621a4c => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:02:06.835294 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a01e8-f8c5-45c9-8db8-f1193d290dee None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:02:06.835592 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a01e8-f8c5-45c9-8db8-f1193d290dee None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:02:06.835878 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a01e8-f8c5-45c9-8db8-f1193d290dee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:02:06.856268 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-a59a01e8-f8c5-45c9-8db8-f1193d290dee None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:02:06.857494 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-a59a01e8-f8c5-45c9-8db8-f1193d290dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:02:06.923995 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1230/2460] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 18:02:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:02:06.934440 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e0501c-6efa-4254-acbb-5f010cbda782 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:02:06.937622 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-c2e0501c-6efa-4254-acbb-5f010cbda782 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:02:07.004070 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e0501c-6efa-4254-acbb-5f010cbda782 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:02:07.008000 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4338e31f-e5bc-4ddf-ad49-745a4f433294 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:02:07.008660 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4338e31f-e5bc-4ddf-ad49-745a4f433294 service neutron] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:02:07.008942 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4338e31f-e5bc-4ddf-ad49-745a4f433294 service neutron] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:02:07.009216 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4338e31f-e5bc-4ddf-ad49-745a4f433294 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:02:07.020090 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4338e31f-e5bc-4ddf-ad49-745a4f433294 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:02:07.021549 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4338e31f-e5bc-4ddf-ad49-745a4f433294 service neutron] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:02:07.032349 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1231/2461] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 18:02:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 18:02:12.441814 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89ba16d-9bee-48bd-bd1d-8af0b40064da None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:02:12.442536 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89ba16d-9bee-48bd-bd1d-8af0b40064da None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:02:12.442536 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89ba16d-9bee-48bd-bd1d-8af0b40064da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:02:12.477916 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-d89ba16d-9bee-48bd-bd1d-8af0b40064da None None] MFA Rules not processed for user `17180b44ab2440f6ae13e674234ae1c4`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:02:12.480027 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-d89ba16d-9bee-48bd-bd1d-8af0b40064da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:02:12.610109 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1231/2462] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 18:02:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:02:12.625022 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4338e31f-e5bc-4ddf-ad49-745a4f433294 service neutron] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:02:12.627305 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-4338e31f-e5bc-4ddf-ad49-745a4f433294 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:02:12.757557 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4338e31f-e5bc-4ddf-ad49-745a4f433294 service neutron] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:02:12.765060 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b878c14-5142-40c2-a45c-e0b7f4b8dbb9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41b893bdf4ec474dbfa819c22fc29ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:02:12.765419 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b878c14-5142-40c2-a45c-e0b7f4b8dbb9 service nova] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:02:12.766029 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b878c14-5142-40c2-a45c-e0b7f4b8dbb9 service nova] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:02:12.766029 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b878c14-5142-40c2-a45c-e0b7f4b8dbb9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:02:12.776194 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b878c14-5142-40c2-a45c-e0b7f4b8dbb9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:02:12.778036 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b878c14-5142-40c2-a45c-e0b7f4b8dbb9 service nova] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:02:12.789655 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1232/2463] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 18:02:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:02:15.193630 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d58f5a5-0773-444b-b89a-55dfc7295d5c None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:02:15.194490 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d58f5a5-0773-444b-b89a-55dfc7295d5c None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:02:15.194832 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d58f5a5-0773-444b-b89a-55dfc7295d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:02:15.263347 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-6d58f5a5-0773-444b-b89a-55dfc7295d5c None None] MFA Rules not processed for user `17180b44ab2440f6ae13e674234ae1c4`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:02:15.265157 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-6d58f5a5-0773-444b-b89a-55dfc7295d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:02:15.329884 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1232/2464] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 18:02:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:02:16.504578 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b878c14-5142-40c2-a45c-e0b7f4b8dbb9 service nova] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:02:16.520757 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b878c14-5142-40c2-a45c-e0b7f4b8dbb9 service nova] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:02:16.534855 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f66d833-b6a7-4232-ac0c-a56b61f4479c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:02:16.545474 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f66d833-b6a7-4232-ac0c-a56b61f4479c service neutron] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:02:16.546733 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f66d833-b6a7-4232-ac0c-a56b61f4479c service neutron] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:02:16.547309 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f66d833-b6a7-4232-ac0c-a56b61f4479c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:02:16.558549 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-6f66d833-b6a7-4232-ac0c-a56b61f4479c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:02:16.588034 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f66d833-b6a7-4232-ac0c-a56b61f4479c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:02:16.592178 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f66d833-b6a7-4232-ac0c-a56b61f4479c service neutron] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:02:16.599150 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:02:16.614764 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1233/2465] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 18:02:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:02:20.672667 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0014f6bf-0207-4a79-ab51-5bd20388deaf None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:02:20.673803 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0014f6bf-0207-4a79-ab51-5bd20388deaf None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:02:20.674014 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0014f6bf-0207-4a79-ab51-5bd20388deaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:02:20.701089 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-0014f6bf-0207-4a79-ab51-5bd20388deaf None None] MFA Rules not processed for user `d66a790ca51f45dcb16812011445f31b`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:02:20.702823 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-0014f6bf-0207-4a79-ab51-5bd20388deaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:02:20.750027 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:02:20.808126 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1233/2466] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 18:02:20 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:02:24.865520 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f66d833-b6a7-4232-ac0c-a56b61f4479c service neutron] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:02:24.894449 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f66d833-b6a7-4232-ac0c-a56b61f4479c service neutron] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:02:24.901241 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af6134d-02fc-44d3-8a39-75c0518d2315 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41b893bdf4ec474dbfa819c22fc29ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:02:24.902418 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af6134d-02fc-44d3-8a39-75c0518d2315 service nova] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:02:24.902896 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af6134d-02fc-44d3-8a39-75c0518d2315 service nova] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:02:24.903192 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af6134d-02fc-44d3-8a39-75c0518d2315 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:02:24.905765 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-7af6134d-02fc-44d3-8a39-75c0518d2315 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:02:24.923056 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af6134d-02fc-44d3-8a39-75c0518d2315 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:02:24.924723 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af6134d-02fc-44d3-8a39-75c0518d2315 service nova] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:02:24.938866 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1234/2467] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 18:02:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 18:02:30.799279 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=11 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:02:34.932896 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=7 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:03:39.057982 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce278dc-6993-46ad-875b-5730288a5e09 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:03:39.058548 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce278dc-6993-46ad-875b-5730288a5e09 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:03:39.058548 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce278dc-6993-46ad-875b-5730288a5e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:03:39.090914 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-8ce278dc-6993-46ad-875b-5730288a5e09 None None] MFA Rules not processed for user `45542602225b452fa323f5499c1843ec`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:03:39.092528 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-8ce278dc-6993-46ad-875b-5730288a5e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:03:39.162649 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1234/2468] 10.222.0.67 () {58 vars in 1009 bytes} [Thu Jul 14 18:03:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 18:03:39.207745 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af6134d-02fc-44d3-8a39-75c0518d2315 service nova] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:03:39.209235 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-7af6134d-02fc-44d3-8a39-75c0518d2315 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:03:39.277733 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af6134d-02fc-44d3-8a39-75c0518d2315 service nova] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:03:39.282691 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc0730a-3e86-4c53-a725-750ffaa7502b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c65607a396474192a43c374d306ef5ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:03:39.283344 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc0730a-3e86-4c53-a725-750ffaa7502b service swift] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:03:39.283631 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc0730a-3e86-4c53-a725-750ffaa7502b service swift] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:03:39.283911 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc0730a-3e86-4c53-a725-750ffaa7502b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:03:39.293447 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc0730a-3e86-4c53-a725-750ffaa7502b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:03:39.295139 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc0730a-3e86-4c53-a725-750ffaa7502b service swift] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:03:39.303250 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1235/2469] 10.222.0.67 () {60 vars in 1384 bytes} [Thu Jul 14 18:03:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 14 18:03:49.155469 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=32 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:03:49.300053 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=32 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:03:55.949345 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce278dc-6993-46ad-875b-5730288a5e09 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:03:55.950855 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-8ce278dc-6993-46ad-875b-5730288a5e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:03:56.048327 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce278dc-6993-46ad-875b-5730288a5e09 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:03:56.053485 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfd887c-7b52-4ea8-8eb4-9e34cc44a88a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5324ab45f4a4449980dad920278f5034', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:03:56.054165 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfd887c-7b52-4ea8-8eb4-9e34cc44a88a service placement] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:03:56.054450 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfd887c-7b52-4ea8-8eb4-9e34cc44a88a service placement] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:03:56.054727 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfd887c-7b52-4ea8-8eb4-9e34cc44a88a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:03:56.056561 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-8cfd887c-7b52-4ea8-8eb4-9e34cc44a88a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:03:56.069234 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfd887c-7b52-4ea8-8eb4-9e34cc44a88a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:03:56.070872 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfd887c-7b52-4ea8-8eb4-9e34cc44a88a service placement] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:03:56.081486 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1235/2470] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 18:03:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:03:57.971605 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36f25c0-0d61-42a6-921b-86a719b19b9f None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:03:57.973205 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36f25c0-0d61-42a6-921b-86a719b19b9f None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:03:57.973815 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36f25c0-0d61-42a6-921b-86a719b19b9f None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:03:57.975997 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1236/2471] 10.222.0.67 () {54 vars in 921 bytes} [Thu Jul 14 18:03:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 18:03:57.990687 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad40d0-a3a3-4524-8865-953b65953279 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:03:57.991282 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad40d0-a3a3-4524-8865-953b65953279 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:03:57.991405 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad40d0-a3a3-4524-8865-953b65953279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:03:58.026414 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-82ad40d0-a3a3-4524-8865-953b65953279 None None] MFA Rules not processed for user `41b893bdf4ec474dbfa819c22fc29ce9`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:03:58.027700 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-82ad40d0-a3a3-4524-8865-953b65953279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:03:58.048733 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1236/2472] 10.222.0.67 () {58 vars in 1018 bytes} [Thu Jul 14 18:03:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:03:58.068188 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36f25c0-0d61-42a6-921b-86a719b19b9f None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:03:58.071307 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-c36f25c0-0d61-42a6-921b-86a719b19b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:03:58.179150 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36f25c0-0d61-42a6-921b-86a719b19b9f None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:03:58.184370 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e97c02e-c090-462a-8779-f6825258fff2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eb7180aab4541b4aab6cf8648eac1f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:03:58.185191 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e97c02e-c090-462a-8779-f6825258fff2 service glance] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:03:58.185551 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e97c02e-c090-462a-8779-f6825258fff2 service glance] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:03:58.185962 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e97c02e-c090-462a-8779-f6825258fff2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:03:58.198147 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e97c02e-c090-462a-8779-f6825258fff2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:03:58.199794 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e97c02e-c090-462a-8779-f6825258fff2 service glance] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:03:58.212870 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1237/2473] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 18:03:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:03:58.290099 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a780501-d99a-468b-bae8-1db406afe353 None None] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:03:58.290379 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a780501-d99a-468b-bae8-1db406afe353 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:03:58.290587 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a780501-d99a-468b-bae8-1db406afe353 None None] PATH_INFO: `/` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:03:58.292064 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1237/2474] 10.222.0.67 () {54 vars in 921 bytes} [Thu Jul 14 18:03:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 18:03:58.297948 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d43eb5-2718-4f2c-a4b0-0f72247d5e6b None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:03:58.298288 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d43eb5-2718-4f2c-a4b0-0f72247d5e6b None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:03:58.298608 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d43eb5-2718-4f2c-a4b0-0f72247d5e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:03:58.319331 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-15d43eb5-2718-4f2c-a4b0-0f72247d5e6b None None] MFA Rules not processed for user `7bda83c5499f43f9838fda2679a522d4`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:03:58.320584 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-15d43eb5-2718-4f2c-a4b0-0f72247d5e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:03:58.327508 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1238/2475] 10.222.0.67 () {58 vars in 1018 bytes} [Thu Jul 14 18:03:58 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:03:58.340453 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a780501-d99a-468b-bae8-1db406afe353 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:03:58.352515 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a780501-d99a-468b-bae8-1db406afe353 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:03:58.356490 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebca16e-1bdf-40e7-89fc-d1645517cffc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:03:58.357161 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebca16e-1bdf-40e7-89fc-d1645517cffc service neutron] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:03:58.357445 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebca16e-1bdf-40e7-89fc-d1645517cffc service neutron] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:03:58.357768 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebca16e-1bdf-40e7-89fc-d1645517cffc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:03:58.366187 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebca16e-1bdf-40e7-89fc-d1645517cffc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:03:58.367642 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebca16e-1bdf-40e7-89fc-d1645517cffc service neutron] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:03:58.376806 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1238/2476] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 18:03:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:03:58.472865 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b5ed81-4be0-4bd7-adf9-8b5a67d4e4af None None] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:03:58.473139 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b5ed81-4be0-4bd7-adf9-8b5a67d4e4af None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:03:58.473416 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b5ed81-4be0-4bd7-adf9-8b5a67d4e4af None None] PATH_INFO: `/` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:03:58.474891 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1239/2477] 10.222.0.67 () {54 vars in 921 bytes} [Thu Jul 14 18:03:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 18:03:58.481657 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a5ca3-53ef-4325-933b-6e9ac61bfdcf None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:03:58.482587 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a5ca3-53ef-4325-933b-6e9ac61bfdcf None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:03:58.482587 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a5ca3-53ef-4325-933b-6e9ac61bfdcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:03:58.505169 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-740a5ca3-53ef-4325-933b-6e9ac61bfdcf None None] MFA Rules not processed for user `41b893bdf4ec474dbfa819c22fc29ce9`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:03:58.506675 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-740a5ca3-53ef-4325-933b-6e9ac61bfdcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:03:58.516603 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1239/2478] 10.222.0.67 () {58 vars in 1018 bytes} [Thu Jul 14 18:03:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:03:58.527490 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b5ed81-4be0-4bd7-adf9-8b5a67d4e4af None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:03:58.538763 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b5ed81-4be0-4bd7-adf9-8b5a67d4e4af None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:03:58.542520 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e348f76c-00e2-40c9-8edd-703d65a1cb41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:03:58.543110 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e348f76c-00e2-40c9-8edd-703d65a1cb41 service neutron] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:03:58.543394 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e348f76c-00e2-40c9-8edd-703d65a1cb41 service neutron] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:03:58.543671 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e348f76c-00e2-40c9-8edd-703d65a1cb41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:03:58.555301 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e348f76c-00e2-40c9-8edd-703d65a1cb41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:03:58.556743 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e348f76c-00e2-40c9-8edd-703d65a1cb41 service neutron] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:03:58.568999 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1240/2479] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 18:03:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:04:00.371635 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e254a3d-4036-484d-957d-a4d145c515dd None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:04:00.372146 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e254a3d-4036-484d-957d-a4d145c515dd None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:04:00.372252 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e254a3d-4036-484d-957d-a4d145c515dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:04:00.390967 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-0e254a3d-4036-484d-957d-a4d145c515dd None None] MFA Rules not processed for user `45542602225b452fa323f5499c1843ec`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:04:00.392093 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-0e254a3d-4036-484d-957d-a4d145c515dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:04:00.400010 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1240/2480] 10.222.0.67 () {58 vars in 1009 bytes} [Thu Jul 14 18:04:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 18:04:00.412619 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e348f76c-00e2-40c9-8edd-703d65a1cb41 service neutron] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:04:00.424188 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e348f76c-00e2-40c9-8edd-703d65a1cb41 service neutron] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:04:00.430084 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445601f2-a9d6-44f1-be7e-adfb94dd7a0f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c65607a396474192a43c374d306ef5ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:04:00.430823 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445601f2-a9d6-44f1-be7e-adfb94dd7a0f service swift] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:04:00.431177 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445601f2-a9d6-44f1-be7e-adfb94dd7a0f service swift] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:04:00.431522 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445601f2-a9d6-44f1-be7e-adfb94dd7a0f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:04:00.440530 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445601f2-a9d6-44f1-be7e-adfb94dd7a0f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:04:00.442285 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445601f2-a9d6-44f1-be7e-adfb94dd7a0f service swift] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:04:00.461687 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1241/2481] 10.222.0.67 () {60 vars in 1384 bytes} [Thu Jul 14 18:04:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 18:04:10.385139 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=65 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:04:10.447588 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=41 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:04:21.123768 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ca9bc3-c5e7-41c3-a362-582d61886d8b None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:04:21.124297 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ca9bc3-c5e7-41c3-a362-582d61886d8b None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:04:21.124297 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ca9bc3-c5e7-41c3-a362-582d61886d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:04:21.145153 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-61ca9bc3-c5e7-41c3-a362-582d61886d8b None None] MFA Rules not processed for user `45542602225b452fa323f5499c1843ec`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:04:21.146997 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-61ca9bc3-c5e7-41c3-a362-582d61886d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:04:21.156793 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1241/2482] 10.222.0.67 () {58 vars in 967 bytes} [Thu Jul 14 18:04:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:04:21.168945 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445601f2-a9d6-44f1-be7e-adfb94dd7a0f service swift] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:04:21.179550 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445601f2-a9d6-44f1-be7e-adfb94dd7a0f service swift] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:04:21.184488 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13ab08d-6d60-4932-97df-5a0e9350f0ea service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c65607a396474192a43c374d306ef5ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:04:21.185126 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13ab08d-6d60-4932-97df-5a0e9350f0ea service swift] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:04:21.185412 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13ab08d-6d60-4932-97df-5a0e9350f0ea service swift] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:04:21.185718 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13ab08d-6d60-4932-97df-5a0e9350f0ea service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:04:21.194230 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13ab08d-6d60-4932-97df-5a0e9350f0ea service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:04:21.195806 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13ab08d-6d60-4932-97df-5a0e9350f0ea service swift] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:04:21.203807 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1242/2483] 10.222.0.67 () {60 vars in 1384 bytes} [Thu Jul 14 18:04:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 18:04:25.447038 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662cbef5-c712-4a04-82ac-0206836b0d24 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:04:25.447590 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662cbef5-c712-4a04-82ac-0206836b0d24 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:04:25.447714 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662cbef5-c712-4a04-82ac-0206836b0d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:04:25.466832 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-662cbef5-c712-4a04-82ac-0206836b0d24 None None] MFA Rules not processed for user `17180b44ab2440f6ae13e674234ae1c4`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:04:25.468217 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-662cbef5-c712-4a04-82ac-0206836b0d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:04:25.475143 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1242/2484] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 18:04:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:04:31.200605 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=6 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:04:35.065380 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13ab08d-6d60-4932-97df-5a0e9350f0ea service swift] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:04:35.074660 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13ab08d-6d60-4932-97df-5a0e9350f0ea service swift] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:04:35.078272 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f35e8c-31d0-4a9d-9f7d-d58e2f6ea9e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:04:35.078906 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f35e8c-31d0-4a9d-9f7d-d58e2f6ea9e0 service neutron] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:04:35.079193 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f35e8c-31d0-4a9d-9f7d-d58e2f6ea9e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:04:35.079468 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f35e8c-31d0-4a9d-9f7d-d58e2f6ea9e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:04:35.081208 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-94f35e8c-31d0-4a9d-9f7d-d58e2f6ea9e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:04:35.139074 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f35e8c-31d0-4a9d-9f7d-d58e2f6ea9e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:04:35.140508 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f35e8c-31d0-4a9d-9f7d-d58e2f6ea9e0 service neutron] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:04:35.150205 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1243/2485] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 18:04:35 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:04:35.461666 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=6 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:04:43.999271 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662cbef5-c712-4a04-82ac-0206836b0d24 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:04:44.000526 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-662cbef5-c712-4a04-82ac-0206836b0d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:04:44.018854 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662cbef5-c712-4a04-82ac-0206836b0d24 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:04:44.023601 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94bf903-88ba-4455-b2ef-045a9162236a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:04:44.024651 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94bf903-88ba-4455-b2ef-045a9162236a service neutron] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:04:44.025131 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94bf903-88ba-4455-b2ef-045a9162236a service neutron] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:04:44.026006 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94bf903-88ba-4455-b2ef-045a9162236a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:04:44.031788 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-a94bf903-88ba-4455-b2ef-045a9162236a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:04:44.046173 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94bf903-88ba-4455-b2ef-045a9162236a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:04:44.047612 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94bf903-88ba-4455-b2ef-045a9162236a service neutron] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:04:44.059188 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1243/2486] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 18:04:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:04:45.145979 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=28 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:04:48.170479 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f35e8c-31d0-4a9d-9f7d-d58e2f6ea9e0 service neutron] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:04:48.183349 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f35e8c-31d0-4a9d-9f7d-d58e2f6ea9e0 service neutron] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:04:48.188445 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcea2fb1-d0d1-43df-b939-a824cb5708b9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5324ab45f4a4449980dad920278f5034', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:04:48.189107 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea2fb1-d0d1-43df-b939-a824cb5708b9 service placement] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:04:48.189394 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea2fb1-d0d1-43df-b939-a824cb5708b9 service placement] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:04:48.189707 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea2fb1-d0d1-43df-b939-a824cb5708b9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:04:48.191526 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-bcea2fb1-d0d1-43df-b939-a824cb5708b9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:04:48.203999 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcea2fb1-d0d1-43df-b939-a824cb5708b9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:04:48.205653 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcea2fb1-d0d1-43df-b939-a824cb5708b9 service placement] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:04:48.218231 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1244/2487] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 18:04:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:04:51.115660 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94bf903-88ba-4455-b2ef-045a9162236a service neutron] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:04:51.127535 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94bf903-88ba-4455-b2ef-045a9162236a service neutron] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:04:51.132068 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bce0f1-95d1-4188-a058-0cde017e2ee7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:04:51.132907 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bce0f1-95d1-4188-a058-0cde017e2ee7 service neutron] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:04:51.133274 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bce0f1-95d1-4188-a058-0cde017e2ee7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:04:51.133826 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bce0f1-95d1-4188-a058-0cde017e2ee7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:04:51.135854 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-16bce0f1-95d1-4188-a058-0cde017e2ee7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:04:51.150607 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bce0f1-95d1-4188-a058-0cde017e2ee7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:04:51.153140 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bce0f1-95d1-4188-a058-0cde017e2ee7 service neutron] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:04:51.165047 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1244/2488] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 18:04:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:04:51.698658 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcea2fb1-d0d1-43df-b939-a824cb5708b9 service placement] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:04:51.700826 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-bcea2fb1-d0d1-43df-b939-a824cb5708b9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:04:51.715298 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcea2fb1-d0d1-43df-b939-a824cb5708b9 service placement] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:04:51.720030 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56120e1-0d17-4508-9bdd-e087d633e37a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:04:51.720922 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56120e1-0d17-4508-9bdd-e087d633e37a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:04:51.721206 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56120e1-0d17-4508-9bdd-e087d633e37a admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:04:51.721486 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56120e1-0d17-4508-9bdd-e087d633e37a admin admin] PATH_INFO: `/v3/users/db6eddb4c43846e59678da445eb6e628` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:04:51.722841 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56120e1-0d17-4508-9bdd-e087d633e37a admin admin] RBAC: Authorizing `identity:delete_user(user_id=db6eddb4c43846e59678da445eb6e628)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:04:51.724786 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56120e1-0d17-4508-9bdd-e087d633e37a admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:04:51.786248 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-e56120e1-0d17-4508-9bdd-e087d633e37a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db6eddb4c43846e59678da445eb6e628'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:04:51.797819 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-e56120e1-0d17-4508-9bdd-e087d633e37a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db6eddb4c43846e59678da445eb6e628'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:04:51.814519 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-e56120e1-0d17-4508-9bdd-e087d633e37a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db6eddb4c43846e59678da445eb6e628'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:04:51.816085 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-e56120e1-0d17-4508-9bdd-e087d633e37a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db6eddb4c43846e59678da445eb6e628'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:04:51.816707 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-e56120e1-0d17-4508-9bdd-e087d633e37a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db6eddb4c43846e59678da445eb6e628'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:04:51.832009 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1245/2489] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 14 18:04:51 2022] DELETE /identity/v3/users/db6eddb4c43846e59678da445eb6e628 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:04:52.067565 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bce0f1-95d1-4188-a058-0cde017e2ee7 service neutron] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:04:52.082201 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bce0f1-95d1-4188-a058-0cde017e2ee7 service neutron] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:04:52.150129 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652ccaf3-e206-4fb3-9234-536a349704fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:04:52.151111 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652ccaf3-e206-4fb3-9234-536a349704fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:04:52.151452 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652ccaf3-e206-4fb3-9234-536a349704fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:04:52.151787 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652ccaf3-e206-4fb3-9234-536a349704fe admin admin] PATH_INFO: `/v3/projects/22486f27a9f04835b7f8e7206afa7ad5` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:04:52.153607 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652ccaf3-e206-4fb3-9234-536a349704fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=22486f27a9f04835b7f8e7206afa7ad5)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:04:52.155607 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652ccaf3-e206-4fb3-9234-536a349704fe admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:04:52.212005 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-652ccaf3-e206-4fb3-9234-536a349704fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22486f27a9f04835b7f8e7206afa7ad5', 'request_id': 'req-652ccaf3-e206-4fb3-9234-536a349704fe'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:04:52.218825 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-652ccaf3-e206-4fb3-9234-536a349704fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22486f27a9f04835b7f8e7206afa7ad5', 'request_id': 'req-652ccaf3-e206-4fb3-9234-536a349704fe'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:04:52.227024 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-652ccaf3-e206-4fb3-9234-536a349704fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22486f27a9f04835b7f8e7206afa7ad5', 'request_id': 'req-652ccaf3-e206-4fb3-9234-536a349704fe'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:04:52.240989 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-652ccaf3-e206-4fb3-9234-536a349704fe admin admin] The token cache is being invalidate because project 22486f27a9f04835b7f8e7206afa7ad5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86772) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 18:04:52.241264 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-652ccaf3-e206-4fb3-9234-536a349704fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:04:52.241948 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-652ccaf3-e206-4fb3-9234-536a349704fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:04:52.243709 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1245/2490] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 14 18:04:52 2022] DELETE /identity/v3/projects/22486f27a9f04835b7f8e7206afa7ad5 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:04:52.248984 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56120e1-0d17-4508-9bdd-e087d633e37a admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:04:52.250456 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-e56120e1-0d17-4508-9bdd-e087d633e37a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:04:52.265357 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56120e1-0d17-4508-9bdd-e087d633e37a admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:04:52.342359 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6482aa47-786e-4927-957f-0cee66812ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:04:52.343313 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6482aa47-786e-4927-957f-0cee66812ff8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:04:52.343625 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6482aa47-786e-4927-957f-0cee66812ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:04:52.343919 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6482aa47-786e-4927-957f-0cee66812ff8 admin admin] PATH_INFO: `/v3/users/04a6f39dddff49f3b12caa99de8b7011` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:04:52.345825 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6482aa47-786e-4927-957f-0cee66812ff8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04a6f39dddff49f3b12caa99de8b7011)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:04:52.347331 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6482aa47-786e-4927-957f-0cee66812ff8 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:04:52.417319 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-6482aa47-786e-4927-957f-0cee66812ff8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04a6f39dddff49f3b12caa99de8b7011'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:04:52.430724 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-6482aa47-786e-4927-957f-0cee66812ff8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04a6f39dddff49f3b12caa99de8b7011'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:04:52.438390 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:04:52.449214 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-6482aa47-786e-4927-957f-0cee66812ff8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04a6f39dddff49f3b12caa99de8b7011'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:04:52.451144 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-6482aa47-786e-4927-957f-0cee66812ff8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04a6f39dddff49f3b12caa99de8b7011'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:04:52.462110 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-6482aa47-786e-4927-957f-0cee66812ff8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04a6f39dddff49f3b12caa99de8b7011'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:04:52.487387 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1246/2491] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 14 18:04:52 2022] DELETE /identity/v3/users/04a6f39dddff49f3b12caa99de8b7011 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:04:53.086823 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652ccaf3-e206-4fb3-9234-536a349704fe admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:04:53.088414 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-652ccaf3-e206-4fb3-9234-536a349704fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:04:53.102009 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652ccaf3-e206-4fb3-9234-536a349704fe admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:04:53.164540 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b7fd4e-3e19-44b8-be13-1e19e87e7a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:04:53.165319 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b7fd4e-3e19-44b8-be13-1e19e87e7a05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:04:53.165640 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b7fd4e-3e19-44b8-be13-1e19e87e7a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:04:53.165919 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b7fd4e-3e19-44b8-be13-1e19e87e7a05 admin admin] PATH_INFO: `/v3/projects/d2ff7e5682ab420ca633b3393db38b0f` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:04:53.167149 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b7fd4e-3e19-44b8-be13-1e19e87e7a05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2ff7e5682ab420ca633b3393db38b0f)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:04:53.169138 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b7fd4e-3e19-44b8-be13-1e19e87e7a05 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:04:53.176496 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:04:53.220905 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-34b7fd4e-3e19-44b8-be13-1e19e87e7a05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2ff7e5682ab420ca633b3393db38b0f', 'request_id': 'req-34b7fd4e-3e19-44b8-be13-1e19e87e7a05'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:04:53.227071 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-34b7fd4e-3e19-44b8-be13-1e19e87e7a05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2ff7e5682ab420ca633b3393db38b0f', 'request_id': 'req-34b7fd4e-3e19-44b8-be13-1e19e87e7a05'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:04:53.235124 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-34b7fd4e-3e19-44b8-be13-1e19e87e7a05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2ff7e5682ab420ca633b3393db38b0f', 'request_id': 'req-34b7fd4e-3e19-44b8-be13-1e19e87e7a05'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:04:53.251136 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-34b7fd4e-3e19-44b8-be13-1e19e87e7a05 admin admin] The token cache is being invalidate because project d2ff7e5682ab420ca633b3393db38b0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86772) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 18:04:53.251888 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-34b7fd4e-3e19-44b8-be13-1e19e87e7a05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:04:53.252574 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-34b7fd4e-3e19-44b8-be13-1e19e87e7a05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:04:53.254330 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1246/2492] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 14 18:04:53 2022] DELETE /identity/v3/projects/d2ff7e5682ab420ca633b3393db38b0f => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:04:54.908744 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6482aa47-786e-4927-957f-0cee66812ff8 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:04:54.910363 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-6482aa47-786e-4927-957f-0cee66812ff8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:04:54.923927 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6482aa47-786e-4927-957f-0cee66812ff8 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:04:54.982089 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d971a15-38fe-4f7b-85de-34d267a1280a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:04:54.982958 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d971a15-38fe-4f7b-85de-34d267a1280a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:04:54.983339 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d971a15-38fe-4f7b-85de-34d267a1280a admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:04:54.983539 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d971a15-38fe-4f7b-85de-34d267a1280a admin admin] PATH_INFO: `/v3/users/d66a790ca51f45dcb16812011445f31b` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:04:54.984919 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d971a15-38fe-4f7b-85de-34d267a1280a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d66a790ca51f45dcb16812011445f31b)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:04:54.986973 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d971a15-38fe-4f7b-85de-34d267a1280a admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:04:55.033285 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-6d971a15-38fe-4f7b-85de-34d267a1280a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd66a790ca51f45dcb16812011445f31b'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:04:55.040704 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-6d971a15-38fe-4f7b-85de-34d267a1280a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd66a790ca51f45dcb16812011445f31b'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:04:55.053211 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-6d971a15-38fe-4f7b-85de-34d267a1280a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd66a790ca51f45dcb16812011445f31b'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:04:55.053885 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-6d971a15-38fe-4f7b-85de-34d267a1280a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd66a790ca51f45dcb16812011445f31b'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:04:55.054490 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-6d971a15-38fe-4f7b-85de-34d267a1280a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd66a790ca51f45dcb16812011445f31b'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:04:55.067912 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1247/2493] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 14 18:04:54 2022] DELETE /identity/v3/users/d66a790ca51f45dcb16812011445f31b => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:04:55.253225 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b7fd4e-3e19-44b8-be13-1e19e87e7a05 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:04:55.254780 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-34b7fd4e-3e19-44b8-be13-1e19e87e7a05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:04:55.271701 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b7fd4e-3e19-44b8-be13-1e19e87e7a05 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:04:55.326485 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e5d91c-356c-4b19-8a5e-3d92795a6095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:04:55.327277 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e5d91c-356c-4b19-8a5e-3d92795a6095 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:04:55.327558 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e5d91c-356c-4b19-8a5e-3d92795a6095 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:04:55.327833 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e5d91c-356c-4b19-8a5e-3d92795a6095 admin admin] PATH_INFO: `/v3/projects/cb388fad852f435bb3d451ee421726ab` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:04:55.329008 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e5d91c-356c-4b19-8a5e-3d92795a6095 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb388fad852f435bb3d451ee421726ab)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:04:55.330951 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e5d91c-356c-4b19-8a5e-3d92795a6095 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:04:55.381388 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-c2e5d91c-356c-4b19-8a5e-3d92795a6095 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb388fad852f435bb3d451ee421726ab', 'request_id': 'req-c2e5d91c-356c-4b19-8a5e-3d92795a6095'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:04:55.387075 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-c2e5d91c-356c-4b19-8a5e-3d92795a6095 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb388fad852f435bb3d451ee421726ab', 'request_id': 'req-c2e5d91c-356c-4b19-8a5e-3d92795a6095'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:04:55.396063 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-c2e5d91c-356c-4b19-8a5e-3d92795a6095 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb388fad852f435bb3d451ee421726ab', 'request_id': 'req-c2e5d91c-356c-4b19-8a5e-3d92795a6095'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:04:55.408783 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-c2e5d91c-356c-4b19-8a5e-3d92795a6095 admin admin] The token cache is being invalidate because project cb388fad852f435bb3d451ee421726ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86772) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 18:04:55.409140 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-c2e5d91c-356c-4b19-8a5e-3d92795a6095 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:04:55.409838 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-c2e5d91c-356c-4b19-8a5e-3d92795a6095 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:04:55.411406 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1247/2494] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 14 18:04:55 2022] DELETE /identity/v3/projects/cb388fad852f435bb3d451ee421726ab => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:04:55.417923 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a320c3db-0d71-430a-b5da-40dbeb61865b None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:04:55.418211 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a320c3db-0d71-430a-b5da-40dbeb61865b None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:04:55.418515 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a320c3db-0d71-430a-b5da-40dbeb61865b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:04:55.441890 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-a320c3db-0d71-430a-b5da-40dbeb61865b None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:04:55.443217 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-a320c3db-0d71-430a-b5da-40dbeb61865b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:04:55.500652 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:04:55.514874 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1248/2495] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 18:04:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 18:04:55.523296 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19b3f8d-a65e-4f89-9808-6870dbf5ade2 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:04:55.523678 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19b3f8d-a65e-4f89-9808-6870dbf5ade2 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:04:55.524031 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19b3f8d-a65e-4f89-9808-6870dbf5ade2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:04:55.544607 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-d19b3f8d-a65e-4f89-9808-6870dbf5ade2 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:04:55.545870 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-d19b3f8d-a65e-4f89-9808-6870dbf5ade2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:04:55.554285 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1248/2496] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 18:04:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 18:04:55.558648 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a320c3db-0d71-430a-b5da-40dbeb61865b None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:04:55.568545 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a320c3db-0d71-430a-b5da-40dbeb61865b None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:04:55.573437 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006cc4d4-e09b-44a1-abd1-2a698f7b8d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:04:55.574220 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006cc4d4-e09b-44a1-abd1-2a698f7b8d1e admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:04:55.574598 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006cc4d4-e09b-44a1-abd1-2a698f7b8d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:04:55.574951 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006cc4d4-e09b-44a1-abd1-2a698f7b8d1e admin admin] PATH_INFO: `/v3/domains` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:04:55.575775 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006cc4d4-e09b-44a1-abd1-2a698f7b8d1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:04:55.576126 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006cc4d4-e09b-44a1-abd1-2a698f7b8d1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:04:55.578343 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006cc4d4-e09b-44a1-abd1-2a698f7b8d1e admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:04:55.591552 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1249/2497] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 14 18:04:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 18:04:55.595709 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19b3f8d-a65e-4f89-9808-6870dbf5ade2 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:04:55.605632 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19b3f8d-a65e-4f89-9808-6870dbf5ade2 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:04:55.610294 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4410aabb-1484-43cd-b704-dfaaa5eb117e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:04:55.610950 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4410aabb-1484-43cd-b704-dfaaa5eb117e admin admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:04:55.611254 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4410aabb-1484-43cd-b704-dfaaa5eb117e admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:04:55.611525 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4410aabb-1484-43cd-b704-dfaaa5eb117e admin admin] PATH_INFO: `/v3/projects` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:04:55.612221 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4410aabb-1484-43cd-b704-dfaaa5eb117e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:04:55.614161 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4410aabb-1484-43cd-b704-dfaaa5eb117e admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:04:55.629227 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:04:55.643049 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1249/2498] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 14 18:04:55 2022] POST /identity/v3/projects => generated 369 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 18:04:55.647313 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006cc4d4-e09b-44a1-abd1-2a698f7b8d1e admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:04:55.658358 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006cc4d4-e09b-44a1-abd1-2a698f7b8d1e admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:04:55.715408 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b8fd8f-db1d-45ef-baa8-bb36f66d5f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:04:55.716079 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b8fd8f-db1d-45ef-baa8-bb36f66d5f40 admin admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:04:55.716367 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b8fd8f-db1d-45ef-baa8-bb36f66d5f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:04:55.716646 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b8fd8f-db1d-45ef-baa8-bb36f66d5f40 admin admin] PATH_INFO: `/v3/users` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:04:55.717328 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b8fd8f-db1d-45ef-baa8-bb36f66d5f40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:04:55.719284 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b8fd8f-db1d-45ef-baa8-bb36f66d5f40 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:04:55.741905 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1250/2499] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 14 18:04:55 2022] POST /identity/v3/users => generated 285 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 18:04:55.746442 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4410aabb-1484-43cd-b704-dfaaa5eb117e admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:04:55.758868 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4410aabb-1484-43cd-b704-dfaaa5eb117e admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:04:55.764079 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3d7a8e-7d1b-43e7-b1ae-9dd2275bece8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:04:55.764746 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3d7a8e-7d1b-43e7-b1ae-9dd2275bece8 admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:04:55.765129 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3d7a8e-7d1b-43e7-b1ae-9dd2275bece8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:04:55.765596 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3d7a8e-7d1b-43e7-b1ae-9dd2275bece8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:04:55.766324 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3d7a8e-7d1b-43e7-b1ae-9dd2275bece8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:04:55.767908 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3d7a8e-7d1b-43e7-b1ae-9dd2275bece8 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:04:55.779664 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1250/2500] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 18:04:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 18:04:55.783763 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b8fd8f-db1d-45ef-baa8-bb36f66d5f40 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:04:55.793726 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b8fd8f-db1d-45ef-baa8-bb36f66d5f40 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:04:55.798411 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03bde6c-360d-4f69-a57a-25bece2bf23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:04:55.799073 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03bde6c-360d-4f69-a57a-25bece2bf23e admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:04:55.799359 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03bde6c-360d-4f69-a57a-25bece2bf23e admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:04:55.799640 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03bde6c-360d-4f69-a57a-25bece2bf23e admin admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:04:55.800368 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03bde6c-360d-4f69-a57a-25bece2bf23e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:04:55.801999 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03bde6c-360d-4f69-a57a-25bece2bf23e admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:04:55.812014 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1251/2501] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 18:04:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 18:04:55.816156 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3d7a8e-7d1b-43e7-b1ae-9dd2275bece8 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:04:55.826719 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3d7a8e-7d1b-43e7-b1ae-9dd2275bece8 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:04:55.831572 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a35905-54ec-47a0-8c9f-3549c6ed30de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:04:55.832390 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a35905-54ec-47a0-8c9f-3549c6ed30de admin admin] REQUEST_METHOD: `PUT` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:04:55.832672 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a35905-54ec-47a0-8c9f-3549c6ed30de admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:04:55.832945 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a35905-54ec-47a0-8c9f-3549c6ed30de admin admin] PATH_INFO: `/v3/projects/4da540a2b468483cb34b9c7fe8a68cb2/users/d10e3d8cc231452db3696a37134781db/roles/95d753870f97426cb1ce32e078621a4c` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:04:55.849096 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a35905-54ec-47a0-8c9f-3549c6ed30de admin admin] RBAC: Authorizing `identity:create_grant(project_id=4da540a2b468483cb34b9c7fe8a68cb2, user_id=d10e3d8cc231452db3696a37134781db, role_id=95d753870f97426cb1ce32e078621a4c)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:04:55.851798 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a35905-54ec-47a0-8c9f-3549c6ed30de admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:04:55.864625 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1251/2502] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 18:04:55 2022] PUT /identity/v3/projects/4da540a2b468483cb34b9c7fe8a68cb2/users/d10e3d8cc231452db3696a37134781db/roles/95d753870f97426cb1ce32e078621a4c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:04:55.875222 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56297c80-0671-4b3c-b496-2de4c1302c11 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:04:55.875530 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56297c80-0671-4b3c-b496-2de4c1302c11 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:04:55.876065 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56297c80-0671-4b3c-b496-2de4c1302c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:04:55.904305 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-56297c80-0671-4b3c-b496-2de4c1302c11 None None] MFA Rules not processed for user `d10e3d8cc231452db3696a37134781db`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:04:55.905521 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-56297c80-0671-4b3c-b496-2de4c1302c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:04:55.969795 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1252/2503] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 18:04:55 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 18:04:55.974237 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a35905-54ec-47a0-8c9f-3549c6ed30de admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:04:56.039088 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a35905-54ec-47a0-8c9f-3549c6ed30de admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:04:56.043901 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf23b6e-59a3-4a1c-b0c2-8350146cdd53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:04:56.044556 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf23b6e-59a3-4a1c-b0c2-8350146cdd53 admin admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:04:56.044838 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf23b6e-59a3-4a1c-b0c2-8350146cdd53 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:04:56.045111 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf23b6e-59a3-4a1c-b0c2-8350146cdd53 admin admin] PATH_INFO: `/v3/projects` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:04:56.045848 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf23b6e-59a3-4a1c-b0c2-8350146cdd53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:04:56.047729 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf23b6e-59a3-4a1c-b0c2-8350146cdd53 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:04:56.071557 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1252/2504] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 14 18:04:55 2022] POST /identity/v3/projects => generated 367 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 18:04:56.076217 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56297c80-0671-4b3c-b496-2de4c1302c11 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:04:56.086873 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56297c80-0671-4b3c-b496-2de4c1302c11 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:04:56.133930 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:04:56.144590 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8934d5c9-7f6e-4705-a4bc-a927fc1d084b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:04:56.145278 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8934d5c9-7f6e-4705-a4bc-a927fc1d084b admin admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:04:56.145593 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8934d5c9-7f6e-4705-a4bc-a927fc1d084b admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:04:56.145874 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8934d5c9-7f6e-4705-a4bc-a927fc1d084b admin admin] PATH_INFO: `/v3/users` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:04:56.146563 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8934d5c9-7f6e-4705-a4bc-a927fc1d084b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:04:56.148492 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8934d5c9-7f6e-4705-a4bc-a927fc1d084b admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:04:56.168122 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1253/2505] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 14 18:04:56 2022] POST /identity/v3/users => generated 290 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 18:04:56.172332 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf23b6e-59a3-4a1c-b0c2-8350146cdd53 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:04:56.184051 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf23b6e-59a3-4a1c-b0c2-8350146cdd53 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:04:56.189369 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53deae9-29a5-4314-8f51-a5c1df53cd67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:04:56.190066 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53deae9-29a5-4314-8f51-a5c1df53cd67 admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:04:56.190351 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53deae9-29a5-4314-8f51-a5c1df53cd67 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:04:56.190630 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53deae9-29a5-4314-8f51-a5c1df53cd67 admin admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:04:56.191371 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53deae9-29a5-4314-8f51-a5c1df53cd67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:04:56.192970 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53deae9-29a5-4314-8f51-a5c1df53cd67 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:04:56.204664 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1253/2506] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 18:04:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 18:04:56.208877 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8934d5c9-7f6e-4705-a4bc-a927fc1d084b admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:04:56.218947 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8934d5c9-7f6e-4705-a4bc-a927fc1d084b admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:04:56.223554 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e653db7e-7c1a-4956-9795-5c47120ff65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:04:56.224430 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e653db7e-7c1a-4956-9795-5c47120ff65a admin admin] REQUEST_METHOD: `PUT` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:04:56.224707 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e653db7e-7c1a-4956-9795-5c47120ff65a admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:04:56.224979 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e653db7e-7c1a-4956-9795-5c47120ff65a admin admin] PATH_INFO: `/v3/projects/988cb1313e20453abf6771b27c7b6517/users/c6acdff164164dfeab12ab20d57571fd/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:04:56.239567 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e653db7e-7c1a-4956-9795-5c47120ff65a admin admin] RBAC: Authorizing `identity:create_grant(project_id=988cb1313e20453abf6771b27c7b6517, user_id=c6acdff164164dfeab12ab20d57571fd, role_id=4651a1cc7b4d4ab7a7a9ca1e77e58e71)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:04:56.242242 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e653db7e-7c1a-4956-9795-5c47120ff65a admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:04:56.256331 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1254/2507] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 18:04:56 2022] PUT /identity/v3/projects/988cb1313e20453abf6771b27c7b6517/users/c6acdff164164dfeab12ab20d57571fd/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:04:56.260453 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53deae9-29a5-4314-8f51-a5c1df53cd67 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:04:56.271047 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53deae9-29a5-4314-8f51-a5c1df53cd67 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:04:56.326047 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a24c38d-80cb-4816-a2d6-12066562aba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:04:56.326709 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a24c38d-80cb-4816-a2d6-12066562aba0 admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:04:56.326993 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a24c38d-80cb-4816-a2d6-12066562aba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:04:56.327271 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a24c38d-80cb-4816-a2d6-12066562aba0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:04:56.327990 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a24c38d-80cb-4816-a2d6-12066562aba0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:04:56.329590 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a24c38d-80cb-4816-a2d6-12066562aba0 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:04:56.339277 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1254/2508] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 18:04:56 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 18:04:56.343515 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e653db7e-7c1a-4956-9795-5c47120ff65a admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:04:56.353688 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e653db7e-7c1a-4956-9795-5c47120ff65a admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:04:56.358329 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda65a92-7c1a-4b26-8eb6-fa8cef7c61a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:04:56.359216 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda65a92-7c1a-4b26-8eb6-fa8cef7c61a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:04:56.359496 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda65a92-7c1a-4b26-8eb6-fa8cef7c61a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:04:56.359772 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda65a92-7c1a-4b26-8eb6-fa8cef7c61a8 admin admin] PATH_INFO: `/v3/projects/988cb1313e20453abf6771b27c7b6517/users/c6acdff164164dfeab12ab20d57571fd/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:04:56.361781 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda65a92-7c1a-4b26-8eb6-fa8cef7c61a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=988cb1313e20453abf6771b27c7b6517, user_id=c6acdff164164dfeab12ab20d57571fd, role_id=4651a1cc7b4d4ab7a7a9ca1e77e58e71)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:04:56.364391 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda65a92-7c1a-4b26-8eb6-fa8cef7c61a8 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:04:56.374805 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1255/2509] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 18:04:56 2022] PUT /identity/v3/projects/988cb1313e20453abf6771b27c7b6517/users/c6acdff164164dfeab12ab20d57571fd/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:04:56.385087 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b365490-a127-4d91-9647-7299a76c57c6 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:04:56.385374 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b365490-a127-4d91-9647-7299a76c57c6 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:04:56.386236 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b365490-a127-4d91-9647-7299a76c57c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:04:56.411823 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-0b365490-a127-4d91-9647-7299a76c57c6 None None] MFA Rules not processed for user `c6acdff164164dfeab12ab20d57571fd`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:04:56.413035 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-0b365490-a127-4d91-9647-7299a76c57c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:04:56.430777 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:04:56.485913 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1255/2510] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 18:04:56 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:04:56.499165 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda65a92-7c1a-4b26-8eb6-fa8cef7c61a8 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:04:56.501182 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-fda65a92-7c1a-4b26-8eb6-fa8cef7c61a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:04:56.580647 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda65a92-7c1a-4b26-8eb6-fa8cef7c61a8 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:04:56.584275 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a2a7cb-bb61-4021-8dd8-269eff8f6b05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de55cae1600841889668e36402861203', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:04:56.584917 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a2a7cb-bb61-4021-8dd8-269eff8f6b05 service cinder] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:04:56.585199 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a2a7cb-bb61-4021-8dd8-269eff8f6b05 service cinder] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:04:56.585473 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a2a7cb-bb61-4021-8dd8-269eff8f6b05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:04:56.594423 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a2a7cb-bb61-4021-8dd8-269eff8f6b05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:04:56.595770 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a2a7cb-bb61-4021-8dd8-269eff8f6b05 service cinder] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:04:56.605484 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1256/2511] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 18:04:56 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:04:56.648168 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b365490-a127-4d91-9647-7299a76c57c6 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:04:56.649574 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-0b365490-a127-4d91-9647-7299a76c57c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:04:56.661285 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b365490-a127-4d91-9647-7299a76c57c6 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:04:56.665632 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b73fdf-61cc-46fd-96b3-f135b4816e33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de55cae1600841889668e36402861203', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:04:56.666311 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b73fdf-61cc-46fd-96b3-f135b4816e33 service cinder] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:04:56.666595 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b73fdf-61cc-46fd-96b3-f135b4816e33 service cinder] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:04:56.667389 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b73fdf-61cc-46fd-96b3-f135b4816e33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:04:56.722107 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b73fdf-61cc-46fd-96b3-f135b4816e33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:04:56.723532 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b73fdf-61cc-46fd-96b3-f135b4816e33 service cinder] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:04:56.732696 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1256/2512] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 18:04:56 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:05:00.189440 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a2a7cb-bb61-4021-8dd8-269eff8f6b05 service cinder] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:00.257925 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a2a7cb-bb61-4021-8dd8-269eff8f6b05 service cinder] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:00.262323 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc70e79a-6df7-4298-847f-de7e00410abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:00.263195 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc70e79a-6df7-4298-847f-de7e00410abf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:00.263479 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc70e79a-6df7-4298-847f-de7e00410abf admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:00.263755 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc70e79a-6df7-4298-847f-de7e00410abf admin admin] PATH_INFO: `/v3/users/d10e3d8cc231452db3696a37134781db` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:00.264947 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc70e79a-6df7-4298-847f-de7e00410abf admin admin] RBAC: Authorizing `identity:delete_user(user_id=d10e3d8cc231452db3696a37134781db)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:00.266902 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc70e79a-6df7-4298-847f-de7e00410abf admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:00.301540 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:05:00.317630 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-cc70e79a-6df7-4298-847f-de7e00410abf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd10e3d8cc231452db3696a37134781db'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:05:00.325749 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-cc70e79a-6df7-4298-847f-de7e00410abf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd10e3d8cc231452db3696a37134781db'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:05:00.337998 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-cc70e79a-6df7-4298-847f-de7e00410abf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd10e3d8cc231452db3696a37134781db'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:05:00.338703 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-cc70e79a-6df7-4298-847f-de7e00410abf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd10e3d8cc231452db3696a37134781db'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:05:00.339302 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-cc70e79a-6df7-4298-847f-de7e00410abf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd10e3d8cc231452db3696a37134781db'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:05:00.352483 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1257/2513] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 14 18:05:00 2022] DELETE /identity/v3/users/d10e3d8cc231452db3696a37134781db => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:05:00.359383 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc36d6d-7cd8-448b-9cab-62749183fd33 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:00.359912 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc36d6d-7cd8-448b-9cab-62749183fd33 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:00.360230 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc36d6d-7cd8-448b-9cab-62749183fd33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:00.381295 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-2cc36d6d-7cd8-448b-9cab-62749183fd33 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:05:00.382554 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-2cc36d6d-7cd8-448b-9cab-62749183fd33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:05:00.439646 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1257/2514] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 18:05:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:05:00.449374 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc70e79a-6df7-4298-847f-de7e00410abf admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:00.450796 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-cc70e79a-6df7-4298-847f-de7e00410abf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:05:00.508754 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc70e79a-6df7-4298-847f-de7e00410abf admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:00.512268 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b09ddad-e4b3-4cad-9097-c3ff4337ca6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:00.512911 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b09ddad-e4b3-4cad-9097-c3ff4337ca6f service neutron] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:00.513192 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b09ddad-e4b3-4cad-9097-c3ff4337ca6f service neutron] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:00.513461 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b09ddad-e4b3-4cad-9097-c3ff4337ca6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:00.522348 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b09ddad-e4b3-4cad-9097-c3ff4337ca6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:00.523760 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b09ddad-e4b3-4cad-9097-c3ff4337ca6f service neutron] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:00.533007 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1258/2515] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 18:05:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:05:00.808210 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc36d6d-7cd8-448b-9cab-62749183fd33 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:00.809748 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-2cc36d6d-7cd8-448b-9cab-62749183fd33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:05:00.822158 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc36d6d-7cd8-448b-9cab-62749183fd33 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:00.826797 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00e75be-a880-4df4-8dc4-9892a6d41fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:00.827761 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e75be-a880-4df4-8dc4-9892a6d41fa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:00.828108 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e75be-a880-4df4-8dc4-9892a6d41fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:00.828453 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e75be-a880-4df4-8dc4-9892a6d41fa3 admin admin] PATH_INFO: `/v3/projects/4da540a2b468483cb34b9c7fe8a68cb2` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:00.829754 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00e75be-a880-4df4-8dc4-9892a6d41fa3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4da540a2b468483cb34b9c7fe8a68cb2)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:00.831736 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00e75be-a880-4df4-8dc4-9892a6d41fa3 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:00.879203 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-b00e75be-a880-4df4-8dc4-9892a6d41fa3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4da540a2b468483cb34b9c7fe8a68cb2', 'request_id': 'req-b00e75be-a880-4df4-8dc4-9892a6d41fa3'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:05:00.880390 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:05:00.887111 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-b00e75be-a880-4df4-8dc4-9892a6d41fa3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4da540a2b468483cb34b9c7fe8a68cb2', 'request_id': 'req-b00e75be-a880-4df4-8dc4-9892a6d41fa3'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:05:00.895399 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-b00e75be-a880-4df4-8dc4-9892a6d41fa3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4da540a2b468483cb34b9c7fe8a68cb2', 'request_id': 'req-b00e75be-a880-4df4-8dc4-9892a6d41fa3'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:05:00.907453 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-b00e75be-a880-4df4-8dc4-9892a6d41fa3 admin admin] The token cache is being invalidate because project 4da540a2b468483cb34b9c7fe8a68cb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86772) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 18:05:00.907737 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-b00e75be-a880-4df4-8dc4-9892a6d41fa3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:05:00.908399 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-b00e75be-a880-4df4-8dc4-9892a6d41fa3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:05:00.909987 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1258/2516] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 14 18:05:00 2022] DELETE /identity/v3/projects/4da540a2b468483cb34b9c7fe8a68cb2 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:05:00.914094 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b09ddad-e4b3-4cad-9097-c3ff4337ca6f service neutron] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:00.924281 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b09ddad-e4b3-4cad-9097-c3ff4337ca6f service neutron] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:00.980506 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a6aa0d-56f5-4e48-b7de-cf9909840782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:00.981425 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a6aa0d-56f5-4e48-b7de-cf9909840782 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:00.981737 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a6aa0d-56f5-4e48-b7de-cf9909840782 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:00.982007 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a6aa0d-56f5-4e48-b7de-cf9909840782 admin admin] PATH_INFO: `/v3/users/c6acdff164164dfeab12ab20d57571fd` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:00.983206 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a6aa0d-56f5-4e48-b7de-cf9909840782 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6acdff164164dfeab12ab20d57571fd)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:00.985109 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a6aa0d-56f5-4e48-b7de-cf9909840782 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:01.035991 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-c4a6aa0d-56f5-4e48-b7de-cf9909840782 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6acdff164164dfeab12ab20d57571fd'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:05:01.039968 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:05:01.046692 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-c4a6aa0d-56f5-4e48-b7de-cf9909840782 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6acdff164164dfeab12ab20d57571fd'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:05:01.060490 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-c4a6aa0d-56f5-4e48-b7de-cf9909840782 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6acdff164164dfeab12ab20d57571fd'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:05:01.061088 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-c4a6aa0d-56f5-4e48-b7de-cf9909840782 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6acdff164164dfeab12ab20d57571fd'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:05:01.061743 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-c4a6aa0d-56f5-4e48-b7de-cf9909840782 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6acdff164164dfeab12ab20d57571fd'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:05:01.075804 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1259/2517] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 14 18:05:00 2022] DELETE /identity/v3/users/c6acdff164164dfeab12ab20d57571fd => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:05:01.360196 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00e75be-a880-4df4-8dc4-9892a6d41fa3 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:01.362008 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-b00e75be-a880-4df4-8dc4-9892a6d41fa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:05:01.378255 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00e75be-a880-4df4-8dc4-9892a6d41fa3 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:01.439273 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4873a31-c7a4-4b76-9fc8-56f0527b58a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:01.440147 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4873a31-c7a4-4b76-9fc8-56f0527b58a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:01.440429 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4873a31-c7a4-4b76-9fc8-56f0527b58a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:01.440750 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4873a31-c7a4-4b76-9fc8-56f0527b58a8 admin admin] PATH_INFO: `/v3/projects/988cb1313e20453abf6771b27c7b6517` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:01.441971 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4873a31-c7a4-4b76-9fc8-56f0527b58a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=988cb1313e20453abf6771b27c7b6517)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:01.443896 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4873a31-c7a4-4b76-9fc8-56f0527b58a8 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:01.494812 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-f4873a31-c7a4-4b76-9fc8-56f0527b58a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '988cb1313e20453abf6771b27c7b6517', 'request_id': 'req-f4873a31-c7a4-4b76-9fc8-56f0527b58a8'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:05:01.500485 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-f4873a31-c7a4-4b76-9fc8-56f0527b58a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '988cb1313e20453abf6771b27c7b6517', 'request_id': 'req-f4873a31-c7a4-4b76-9fc8-56f0527b58a8'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:05:01.507745 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-f4873a31-c7a4-4b76-9fc8-56f0527b58a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '988cb1313e20453abf6771b27c7b6517', 'request_id': 'req-f4873a31-c7a4-4b76-9fc8-56f0527b58a8'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:05:01.519265 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-f4873a31-c7a4-4b76-9fc8-56f0527b58a8 admin admin] The token cache is being invalidate because project 988cb1313e20453abf6771b27c7b6517 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86772) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 18:05:01.519550 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-f4873a31-c7a4-4b76-9fc8-56f0527b58a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:05:01.520175 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-f4873a31-c7a4-4b76-9fc8-56f0527b58a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:05:01.521726 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1259/2518] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 14 18:05:01 2022] DELETE /identity/v3/projects/988cb1313e20453abf6771b27c7b6517 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:05:01.526536 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9823a659-c00f-42fd-a20f-d30e524084dd None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:01.526997 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9823a659-c00f-42fd-a20f-d30e524084dd None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:01.527093 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9823a659-c00f-42fd-a20f-d30e524084dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:01.544283 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-9823a659-c00f-42fd-a20f-d30e524084dd None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:05:01.545495 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-9823a659-c00f-42fd-a20f-d30e524084dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:05:01.605342 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1260/2519] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 18:05:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:05:01.613309 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf243a-120f-44a1-b024-035545721d57 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:01.613597 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf243a-120f-44a1-b024-035545721d57 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:01.613879 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf243a-120f-44a1-b024-035545721d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:01.634417 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-a9bf243a-120f-44a1-b024-035545721d57 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:05:01.636161 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-a9bf243a-120f-44a1-b024-035545721d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:05:01.644107 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1260/2520] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 18:05:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:05:01.648311 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9823a659-c00f-42fd-a20f-d30e524084dd None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:01.658063 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9823a659-c00f-42fd-a20f-d30e524084dd None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:01.662714 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6fc2a3-6f6b-4164-9c2a-6155c9f59ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:01.663375 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6fc2a3-6f6b-4164-9c2a-6155c9f59ffc admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:01.663658 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6fc2a3-6f6b-4164-9c2a-6155c9f59ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:01.663937 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6fc2a3-6f6b-4164-9c2a-6155c9f59ffc admin admin] PATH_INFO: `/v3/domains` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:01.664667 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6fc2a3-6f6b-4164-9c2a-6155c9f59ffc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:05:01.664976 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6fc2a3-6f6b-4164-9c2a-6155c9f59ffc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:01.666643 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6fc2a3-6f6b-4164-9c2a-6155c9f59ffc admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:01.678479 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1261/2521] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 14 18:05:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:05:01.683367 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bf243a-120f-44a1-b024-035545721d57 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:01.699851 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bf243a-120f-44a1-b024-035545721d57 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:01.704573 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a74af3-dfe4-4ade-91d5-0839324b2faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:01.705233 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a74af3-dfe4-4ade-91d5-0839324b2faf admin admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:01.705604 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a74af3-dfe4-4ade-91d5-0839324b2faf admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:01.706097 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a74af3-dfe4-4ade-91d5-0839324b2faf admin admin] PATH_INFO: `/v3/projects` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:01.706902 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a74af3-dfe4-4ade-91d5-0839324b2faf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:01.709205 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a74af3-dfe4-4ade-91d5-0839324b2faf admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:01.736059 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1261/2522] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 14 18:05:01 2022] POST /identity/v3/projects => generated 383 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 18:05:01.740401 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6fc2a3-6f6b-4164-9c2a-6155c9f59ffc admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:01.752466 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6fc2a3-6f6b-4164-9c2a-6155c9f59ffc admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:01.811242 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b32e71-2e2c-4962-af1f-c7945d1fb308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:01.811921 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b32e71-2e2c-4962-af1f-c7945d1fb308 admin admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:01.812204 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b32e71-2e2c-4962-af1f-c7945d1fb308 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:01.812477 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b32e71-2e2c-4962-af1f-c7945d1fb308 admin admin] PATH_INFO: `/v3/users` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:01.813203 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b32e71-2e2c-4962-af1f-c7945d1fb308 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:01.815168 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b32e71-2e2c-4962-af1f-c7945d1fb308 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:01.834833 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1262/2523] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 14 18:05:01 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 18:05:01.838991 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a74af3-dfe4-4ade-91d5-0839324b2faf admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:01.851004 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a74af3-dfe4-4ade-91d5-0839324b2faf admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:01.856228 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d6aa96-a803-4836-a38c-4a2877e715f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:01.856862 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d6aa96-a803-4836-a38c-4a2877e715f0 admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:01.857143 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d6aa96-a803-4836-a38c-4a2877e715f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:01.857419 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d6aa96-a803-4836-a38c-4a2877e715f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:01.858183 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d6aa96-a803-4836-a38c-4a2877e715f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:01.859774 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d6aa96-a803-4836-a38c-4a2877e715f0 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:01.871079 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1262/2524] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 18:05:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 18:05:01.875314 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b32e71-2e2c-4962-af1f-c7945d1fb308 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:01.885384 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b32e71-2e2c-4962-af1f-c7945d1fb308 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:01.890583 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c54ca39-146a-489e-8fbd-a4f3fd0f0b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:01.891269 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c54ca39-146a-489e-8fbd-a4f3fd0f0b3e admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:01.891553 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c54ca39-146a-489e-8fbd-a4f3fd0f0b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:01.891829 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c54ca39-146a-489e-8fbd-a4f3fd0f0b3e admin admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:01.892562 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c54ca39-146a-489e-8fbd-a4f3fd0f0b3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:01.894206 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c54ca39-146a-489e-8fbd-a4f3fd0f0b3e admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:01.904653 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1263/2525] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 18:05:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 18:05:01.908967 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d6aa96-a803-4836-a38c-4a2877e715f0 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:01.919599 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d6aa96-a803-4836-a38c-4a2877e715f0 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:01.924166 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8e54df-2a35-4fae-8015-b214b16a9b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:01.925046 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8e54df-2a35-4fae-8015-b214b16a9b17 admin admin] REQUEST_METHOD: `PUT` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:01.925326 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8e54df-2a35-4fae-8015-b214b16a9b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:01.925641 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8e54df-2a35-4fae-8015-b214b16a9b17 admin admin] PATH_INFO: `/v3/projects/bcdd5fe883b64e3091bfdd8f303415b0/users/22503abb9dfe44caa1632c8ae81cc677/roles/95d753870f97426cb1ce32e078621a4c` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:01.942323 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8e54df-2a35-4fae-8015-b214b16a9b17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcdd5fe883b64e3091bfdd8f303415b0, user_id=22503abb9dfe44caa1632c8ae81cc677, role_id=95d753870f97426cb1ce32e078621a4c)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:01.944949 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8e54df-2a35-4fae-8015-b214b16a9b17 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:01.959106 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1263/2526] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 18:05:01 2022] PUT /identity/v3/projects/bcdd5fe883b64e3091bfdd8f303415b0/users/22503abb9dfe44caa1632c8ae81cc677/roles/95d753870f97426cb1ce32e078621a4c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:05:01.970218 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abbb2b8-e0f8-4104-a1c1-185ec766250d None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:01.970510 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abbb2b8-e0f8-4104-a1c1-185ec766250d None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:01.970791 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abbb2b8-e0f8-4104-a1c1-185ec766250d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:01.999306 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-8abbb2b8-e0f8-4104-a1c1-185ec766250d None None] MFA Rules not processed for user `22503abb9dfe44caa1632c8ae81cc677`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:05:02.000809 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-8abbb2b8-e0f8-4104-a1c1-185ec766250d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:05:02.023639 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:05:02.065608 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1264/2527] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 18:05:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:05:02.070191 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8e54df-2a35-4fae-8015-b214b16a9b17 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:02.075809 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:05:02.133441 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8e54df-2a35-4fae-8015-b214b16a9b17 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:02.137997 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14192692-cb5b-43ec-9801-1e1fb4712835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:02.138656 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14192692-cb5b-43ec-9801-1e1fb4712835 admin admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:02.138938 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14192692-cb5b-43ec-9801-1e1fb4712835 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:02.139214 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14192692-cb5b-43ec-9801-1e1fb4712835 admin admin] PATH_INFO: `/v3/projects` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:02.139905 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14192692-cb5b-43ec-9801-1e1fb4712835 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:02.141813 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14192692-cb5b-43ec-9801-1e1fb4712835 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:02.171601 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1264/2528] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 14 18:05:02 2022] POST /identity/v3/projects => generated 381 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 18:05:02.173086 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abbb2b8-e0f8-4104-a1c1-185ec766250d None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:02.184437 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abbb2b8-e0f8-4104-a1c1-185ec766250d None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:02.242964 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9038adf9-afc2-4e3a-a627-7cd734cccbee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:02.243675 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9038adf9-afc2-4e3a-a627-7cd734cccbee admin admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:02.244030 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9038adf9-afc2-4e3a-a627-7cd734cccbee admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:02.244308 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9038adf9-afc2-4e3a-a627-7cd734cccbee admin admin] PATH_INFO: `/v3/users` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:02.245010 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9038adf9-afc2-4e3a-a627-7cd734cccbee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:02.246983 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9038adf9-afc2-4e3a-a627-7cd734cccbee admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:02.267533 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1265/2529] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 14 18:05:02 2022] POST /identity/v3/users => generated 297 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 18:05:02.272383 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14192692-cb5b-43ec-9801-1e1fb4712835 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:02.283943 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14192692-cb5b-43ec-9801-1e1fb4712835 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:02.288609 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26f7c77-828e-4afd-bbd8-0e53a1ae9e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:02.289270 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f7c77-828e-4afd-bbd8-0e53a1ae9e76 admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:02.289586 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f7c77-828e-4afd-bbd8-0e53a1ae9e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:02.289870 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f7c77-828e-4afd-bbd8-0e53a1ae9e76 admin admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:02.290602 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26f7c77-828e-4afd-bbd8-0e53a1ae9e76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:02.292736 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26f7c77-828e-4afd-bbd8-0e53a1ae9e76 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:02.303665 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1265/2530] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 18:05:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 18:05:02.308564 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9038adf9-afc2-4e3a-a627-7cd734cccbee admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:02.319768 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9038adf9-afc2-4e3a-a627-7cd734cccbee admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:02.324548 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754a775f-7875-4c2c-8705-bb7eff7bd0f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:02.325450 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a775f-7875-4c2c-8705-bb7eff7bd0f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:02.325759 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a775f-7875-4c2c-8705-bb7eff7bd0f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:02.326037 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a775f-7875-4c2c-8705-bb7eff7bd0f7 admin admin] PATH_INFO: `/v3/projects/e431a3132c714e08978f7751b5cbcdf9/users/d97600f822ec4dbb99867f8834350591/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:02.341783 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754a775f-7875-4c2c-8705-bb7eff7bd0f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e431a3132c714e08978f7751b5cbcdf9, user_id=d97600f822ec4dbb99867f8834350591, role_id=4651a1cc7b4d4ab7a7a9ca1e77e58e71)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:02.344452 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754a775f-7875-4c2c-8705-bb7eff7bd0f7 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:02.360220 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1266/2531] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 18:05:02 2022] PUT /identity/v3/projects/e431a3132c714e08978f7751b5cbcdf9/users/d97600f822ec4dbb99867f8834350591/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:05:02.364168 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26f7c77-828e-4afd-bbd8-0e53a1ae9e76 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:02.374262 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26f7c77-828e-4afd-bbd8-0e53a1ae9e76 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:02.430661 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e7d119-7760-4f24-b66f-36d44a18a9f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:02.431273 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e7d119-7760-4f24-b66f-36d44a18a9f4 admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:02.431557 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e7d119-7760-4f24-b66f-36d44a18a9f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:02.431835 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e7d119-7760-4f24-b66f-36d44a18a9f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:02.432564 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e7d119-7760-4f24-b66f-36d44a18a9f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:02.434201 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e7d119-7760-4f24-b66f-36d44a18a9f4 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:02.444048 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1266/2532] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 18:05:02 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 18:05:02.448337 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754a775f-7875-4c2c-8705-bb7eff7bd0f7 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:02.461199 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754a775f-7875-4c2c-8705-bb7eff7bd0f7 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:02.466529 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c90cf2-8f6d-417c-8daf-19b537caeef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:02.467425 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c90cf2-8f6d-417c-8daf-19b537caeef1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:02.467710 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c90cf2-8f6d-417c-8daf-19b537caeef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:02.467988 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c90cf2-8f6d-417c-8daf-19b537caeef1 admin admin] PATH_INFO: `/v3/projects/e431a3132c714e08978f7751b5cbcdf9/users/d97600f822ec4dbb99867f8834350591/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:02.470005 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c90cf2-8f6d-417c-8daf-19b537caeef1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e431a3132c714e08978f7751b5cbcdf9, user_id=d97600f822ec4dbb99867f8834350591, role_id=4651a1cc7b4d4ab7a7a9ca1e77e58e71)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:02.472695 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c90cf2-8f6d-417c-8daf-19b537caeef1 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:02.486357 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1267/2533] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 18:05:02 2022] PUT /identity/v3/projects/e431a3132c714e08978f7751b5cbcdf9/users/d97600f822ec4dbb99867f8834350591/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:05:02.497874 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db964706-e459-4f8b-bb0d-f80d98a0cdca None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:02.498165 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db964706-e459-4f8b-bb0d-f80d98a0cdca None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:02.498444 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db964706-e459-4f8b-bb0d-f80d98a0cdca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:02.527751 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-db964706-e459-4f8b-bb0d-f80d98a0cdca None None] MFA Rules not processed for user `d97600f822ec4dbb99867f8834350591`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:05:02.528991 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-db964706-e459-4f8b-bb0d-f80d98a0cdca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:05:02.601439 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:05:02.605999 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1267/2534] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 18:05:02 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:05:02.616268 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c90cf2-8f6d-417c-8daf-19b537caeef1 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:02.618225 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-86c90cf2-8f6d-417c-8daf-19b537caeef1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:05:02.682624 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c90cf2-8f6d-417c-8daf-19b537caeef1 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:02.686211 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891708ae-ad12-4e94-80fc-f74589e9f6c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de55cae1600841889668e36402861203', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:02.686861 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891708ae-ad12-4e94-80fc-f74589e9f6c5 service cinder] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:02.687144 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891708ae-ad12-4e94-80fc-f74589e9f6c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:02.687421 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891708ae-ad12-4e94-80fc-f74589e9f6c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:02.698754 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891708ae-ad12-4e94-80fc-f74589e9f6c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:02.700408 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891708ae-ad12-4e94-80fc-f74589e9f6c5 service cinder] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:02.710574 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1268/2535] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 18:05:02 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:05:02.811864 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db964706-e459-4f8b-bb0d-f80d98a0cdca None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:02.822638 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db964706-e459-4f8b-bb0d-f80d98a0cdca None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:02.826278 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70a0aa7-9362-42ab-9617-5b3d465ebb57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de55cae1600841889668e36402861203', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:02.826934 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a0aa7-9362-42ab-9617-5b3d465ebb57 service cinder] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:02.827216 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a0aa7-9362-42ab-9617-5b3d465ebb57 service cinder] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:02.827718 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a0aa7-9362-42ab-9617-5b3d465ebb57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:02.888568 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70a0aa7-9362-42ab-9617-5b3d465ebb57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:02.890236 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70a0aa7-9362-42ab-9617-5b3d465ebb57 service cinder] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:02.900673 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1268/2536] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 18:05:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:05:05.536826 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891708ae-ad12-4e94-80fc-f74589e9f6c5 service cinder] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:05.558524 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:05:05.605446 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891708ae-ad12-4e94-80fc-f74589e9f6c5 service cinder] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:05.611041 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7300cd-8802-47c3-a360-4c831987386c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:05.611927 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7300cd-8802-47c3-a360-4c831987386c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:05.612212 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7300cd-8802-47c3-a360-4c831987386c admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:05.612490 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7300cd-8802-47c3-a360-4c831987386c admin admin] PATH_INFO: `/v3/users/22503abb9dfe44caa1632c8ae81cc677` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:05.613782 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7300cd-8802-47c3-a360-4c831987386c admin admin] RBAC: Authorizing `identity:delete_user(user_id=22503abb9dfe44caa1632c8ae81cc677)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:05.615731 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7300cd-8802-47c3-a360-4c831987386c admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:05.670386 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-bc7300cd-8802-47c3-a360-4c831987386c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22503abb9dfe44caa1632c8ae81cc677'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:05:05.682506 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-bc7300cd-8802-47c3-a360-4c831987386c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22503abb9dfe44caa1632c8ae81cc677'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:05:05.697207 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-bc7300cd-8802-47c3-a360-4c831987386c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22503abb9dfe44caa1632c8ae81cc677'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:05:05.697976 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-bc7300cd-8802-47c3-a360-4c831987386c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22503abb9dfe44caa1632c8ae81cc677'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:05:05.698588 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-bc7300cd-8802-47c3-a360-4c831987386c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22503abb9dfe44caa1632c8ae81cc677'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:05:05.721016 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1269/2537] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 14 18:05:05 2022] DELETE /identity/v3/users/22503abb9dfe44caa1632c8ae81cc677 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:05:05.725738 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a35a9-603d-4a6b-97bc-04dcaea62a3d None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:05.726363 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a35a9-603d-4a6b-97bc-04dcaea62a3d None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:05.726363 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a35a9-603d-4a6b-97bc-04dcaea62a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:05.746051 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-163a35a9-603d-4a6b-97bc-04dcaea62a3d None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:05:05.747286 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-163a35a9-603d-4a6b-97bc-04dcaea62a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:05:05.814581 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1269/2538] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 18:05:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 18:05:05.825060 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7300cd-8802-47c3-a360-4c831987386c admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:05.826748 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-bc7300cd-8802-47c3-a360-4c831987386c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:05:05.890903 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7300cd-8802-47c3-a360-4c831987386c admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:05.894607 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55855546-2950-4966-9af4-74c43f9b66c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:05.895264 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55855546-2950-4966-9af4-74c43f9b66c9 service neutron] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:05.895552 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55855546-2950-4966-9af4-74c43f9b66c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:05.895826 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55855546-2950-4966-9af4-74c43f9b66c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:05.906001 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55855546-2950-4966-9af4-74c43f9b66c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:05.907447 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55855546-2950-4966-9af4-74c43f9b66c9 service neutron] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:05.918560 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1270/2539] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 18:05:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:05:06.216911 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163a35a9-603d-4a6b-97bc-04dcaea62a3d None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:06.218587 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-163a35a9-603d-4a6b-97bc-04dcaea62a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:05:06.232307 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163a35a9-603d-4a6b-97bc-04dcaea62a3d None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:06.237589 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d30b4e-2eec-43fd-b0ae-48530b22399d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:06.238658 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d30b4e-2eec-43fd-b0ae-48530b22399d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:06.238926 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d30b4e-2eec-43fd-b0ae-48530b22399d admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:06.239208 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d30b4e-2eec-43fd-b0ae-48530b22399d admin admin] PATH_INFO: `/v3/projects/bcdd5fe883b64e3091bfdd8f303415b0` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:06.240482 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d30b4e-2eec-43fd-b0ae-48530b22399d admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcdd5fe883b64e3091bfdd8f303415b0)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:06.242466 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d30b4e-2eec-43fd-b0ae-48530b22399d admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:06.293187 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-29d30b4e-2eec-43fd-b0ae-48530b22399d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcdd5fe883b64e3091bfdd8f303415b0', 'request_id': 'req-29d30b4e-2eec-43fd-b0ae-48530b22399d'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:05:06.298468 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-29d30b4e-2eec-43fd-b0ae-48530b22399d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcdd5fe883b64e3091bfdd8f303415b0', 'request_id': 'req-29d30b4e-2eec-43fd-b0ae-48530b22399d'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:05:06.306273 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-29d30b4e-2eec-43fd-b0ae-48530b22399d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcdd5fe883b64e3091bfdd8f303415b0', 'request_id': 'req-29d30b4e-2eec-43fd-b0ae-48530b22399d'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:05:06.317721 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-29d30b4e-2eec-43fd-b0ae-48530b22399d admin admin] The token cache is being invalidate because project bcdd5fe883b64e3091bfdd8f303415b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86772) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 18:05:06.318008 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-29d30b4e-2eec-43fd-b0ae-48530b22399d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:05:06.318661 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-29d30b4e-2eec-43fd-b0ae-48530b22399d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:05:06.320203 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1270/2540] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 14 18:05:06 2022] DELETE /identity/v3/projects/bcdd5fe883b64e3091bfdd8f303415b0 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:05:06.324439 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55855546-2950-4966-9af4-74c43f9b66c9 service neutron] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:06.334293 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55855546-2950-4966-9af4-74c43f9b66c9 service neutron] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:06.375475 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:05:06.395859 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1b914e-4b85-41e2-9c7f-92e6031630b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:06.396658 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1b914e-4b85-41e2-9c7f-92e6031630b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:06.396936 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1b914e-4b85-41e2-9c7f-92e6031630b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:06.397222 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1b914e-4b85-41e2-9c7f-92e6031630b1 admin admin] PATH_INFO: `/v3/users/d97600f822ec4dbb99867f8834350591` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:06.398436 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1b914e-4b85-41e2-9c7f-92e6031630b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d97600f822ec4dbb99867f8834350591)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:06.400855 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1b914e-4b85-41e2-9c7f-92e6031630b1 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:06.450309 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-2f1b914e-4b85-41e2-9c7f-92e6031630b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd97600f822ec4dbb99867f8834350591'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:05:06.461123 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-2f1b914e-4b85-41e2-9c7f-92e6031630b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd97600f822ec4dbb99867f8834350591'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:05:06.475119 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-2f1b914e-4b85-41e2-9c7f-92e6031630b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd97600f822ec4dbb99867f8834350591'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:05:06.475856 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-2f1b914e-4b85-41e2-9c7f-92e6031630b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd97600f822ec4dbb99867f8834350591'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:05:06.476455 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-2f1b914e-4b85-41e2-9c7f-92e6031630b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd97600f822ec4dbb99867f8834350591'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:05:06.489989 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1271/2541] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 14 18:05:06 2022] DELETE /identity/v3/users/d97600f822ec4dbb99867f8834350591 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:05:06.769826 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d30b4e-2eec-43fd-b0ae-48530b22399d admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:06.771270 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-29d30b4e-2eec-43fd-b0ae-48530b22399d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:05:06.785620 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d30b4e-2eec-43fd-b0ae-48530b22399d admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:06.806613 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:05:06.848345 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162da173-09d5-45bc-b359-557d717e272e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:06.849112 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162da173-09d5-45bc-b359-557d717e272e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:06.849391 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162da173-09d5-45bc-b359-557d717e272e admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:06.849689 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162da173-09d5-45bc-b359-557d717e272e admin admin] PATH_INFO: `/v3/projects/e431a3132c714e08978f7751b5cbcdf9` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:06.850858 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162da173-09d5-45bc-b359-557d717e272e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e431a3132c714e08978f7751b5cbcdf9)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:06.852760 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162da173-09d5-45bc-b359-557d717e272e admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:06.899671 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-162da173-09d5-45bc-b359-557d717e272e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e431a3132c714e08978f7751b5cbcdf9', 'request_id': 'req-162da173-09d5-45bc-b359-557d717e272e'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:05:06.905714 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-162da173-09d5-45bc-b359-557d717e272e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e431a3132c714e08978f7751b5cbcdf9', 'request_id': 'req-162da173-09d5-45bc-b359-557d717e272e'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:05:06.912916 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-162da173-09d5-45bc-b359-557d717e272e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e431a3132c714e08978f7751b5cbcdf9', 'request_id': 'req-162da173-09d5-45bc-b359-557d717e272e'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:05:06.923862 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-162da173-09d5-45bc-b359-557d717e272e admin admin] The token cache is being invalidate because project e431a3132c714e08978f7751b5cbcdf9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86772) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 18:05:06.924145 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-162da173-09d5-45bc-b359-557d717e272e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:05:06.924770 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-162da173-09d5-45bc-b359-557d717e272e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:05:06.926321 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1271/2542] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 14 18:05:06 2022] DELETE /identity/v3/projects/e431a3132c714e08978f7751b5cbcdf9 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:05:06.931257 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5302e4-8273-4b5e-b19c-6201668f7048 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:06.931727 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5302e4-8273-4b5e-b19c-6201668f7048 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:06.931846 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5302e4-8273-4b5e-b19c-6201668f7048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:06.949666 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-2c5302e4-8273-4b5e-b19c-6201668f7048 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:05:06.950875 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-2c5302e4-8273-4b5e-b19c-6201668f7048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:05:07.010415 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1272/2543] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 18:05:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:05:07.017838 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e3202-616a-4e01-90e8-004158992d07 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:07.018123 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e3202-616a-4e01-90e8-004158992d07 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:07.018399 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e3202-616a-4e01-90e8-004158992d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:07.036990 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-3c0e3202-616a-4e01-90e8-004158992d07 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:05:07.038221 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-3c0e3202-616a-4e01-90e8-004158992d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:05:07.046688 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1272/2544] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 18:05:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:05:07.050770 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5302e4-8273-4b5e-b19c-6201668f7048 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:07.060479 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5302e4-8273-4b5e-b19c-6201668f7048 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:07.065034 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d953ab9e-9e17-47c7-a388-e765c365f90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:07.065727 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953ab9e-9e17-47c7-a388-e765c365f90d admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:07.066013 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953ab9e-9e17-47c7-a388-e765c365f90d admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:07.066291 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953ab9e-9e17-47c7-a388-e765c365f90d admin admin] PATH_INFO: `/v3/domains` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:07.067024 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d953ab9e-9e17-47c7-a388-e765c365f90d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:05:07.067333 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d953ab9e-9e17-47c7-a388-e765c365f90d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:07.068919 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d953ab9e-9e17-47c7-a388-e765c365f90d admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:07.080407 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1273/2545] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 14 18:05:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:05:07.084756 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0e3202-616a-4e01-90e8-004158992d07 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:07.094464 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0e3202-616a-4e01-90e8-004158992d07 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:07.099107 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f7be94-6112-40ea-b942-50874e7cc280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:07.099690 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f7be94-6112-40ea-b942-50874e7cc280 admin admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:07.099969 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f7be94-6112-40ea-b942-50874e7cc280 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:07.100239 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f7be94-6112-40ea-b942-50874e7cc280 admin admin] PATH_INFO: `/v3/projects` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:07.100923 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f7be94-6112-40ea-b942-50874e7cc280 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:07.102828 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f7be94-6112-40ea-b942-50874e7cc280 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:07.129054 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1273/2546] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 14 18:05:07 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 18:05:07.133167 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d953ab9e-9e17-47c7-a388-e765c365f90d admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:07.143401 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d953ab9e-9e17-47c7-a388-e765c365f90d admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:07.189656 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:05:07.202592 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6781618d-d5ae-471e-b572-d2f778520c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:07.203295 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6781618d-d5ae-471e-b572-d2f778520c52 admin admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:07.203579 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6781618d-d5ae-471e-b572-d2f778520c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:07.203862 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6781618d-d5ae-471e-b572-d2f778520c52 admin admin] PATH_INFO: `/v3/users` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:07.204565 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6781618d-d5ae-471e-b572-d2f778520c52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:07.206490 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6781618d-d5ae-471e-b572-d2f778520c52 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:07.226665 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1274/2547] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 14 18:05:07 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 18:05:07.231474 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f7be94-6112-40ea-b942-50874e7cc280 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:07.241808 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f7be94-6112-40ea-b942-50874e7cc280 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:07.246372 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a978d743-86a1-4d2d-8316-dd2e6d0cb1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:07.247025 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a978d743-86a1-4d2d-8316-dd2e6d0cb1c4 admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:07.247310 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a978d743-86a1-4d2d-8316-dd2e6d0cb1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:07.247584 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a978d743-86a1-4d2d-8316-dd2e6d0cb1c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:07.248308 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a978d743-86a1-4d2d-8316-dd2e6d0cb1c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:07.250172 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a978d743-86a1-4d2d-8316-dd2e6d0cb1c4 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:07.260557 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1274/2548] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 18:05:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 18:05:07.264367 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6781618d-d5ae-471e-b572-d2f778520c52 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:07.274063 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6781618d-d5ae-471e-b572-d2f778520c52 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:07.279195 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5723d47-1c2b-4470-9c4c-5c444a052743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:07.279902 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5723d47-1c2b-4470-9c4c-5c444a052743 admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:07.280190 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5723d47-1c2b-4470-9c4c-5c444a052743 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:07.280500 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5723d47-1c2b-4470-9c4c-5c444a052743 admin admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:07.281239 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5723d47-1c2b-4470-9c4c-5c444a052743 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:07.282900 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5723d47-1c2b-4470-9c4c-5c444a052743 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:07.293425 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1275/2549] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 18:05:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 18:05:07.297451 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a978d743-86a1-4d2d-8316-dd2e6d0cb1c4 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:07.307685 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a978d743-86a1-4d2d-8316-dd2e6d0cb1c4 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:07.312269 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5908f486-51d7-40da-8736-34e3f136f372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:07.313176 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5908f486-51d7-40da-8736-34e3f136f372 admin admin] REQUEST_METHOD: `PUT` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:07.313456 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5908f486-51d7-40da-8736-34e3f136f372 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:07.313758 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5908f486-51d7-40da-8736-34e3f136f372 admin admin] PATH_INFO: `/v3/projects/50f720e24eb24dcb9f0e19e9e9eaef6d/users/0f57b41267204f8fa1516907d37a9ab5/roles/95d753870f97426cb1ce32e078621a4c` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:07.328190 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5908f486-51d7-40da-8736-34e3f136f372 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50f720e24eb24dcb9f0e19e9e9eaef6d, user_id=0f57b41267204f8fa1516907d37a9ab5, role_id=95d753870f97426cb1ce32e078621a4c)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:07.330848 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5908f486-51d7-40da-8736-34e3f136f372 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:07.344280 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1275/2550] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 18:05:07 2022] PUT /identity/v3/projects/50f720e24eb24dcb9f0e19e9e9eaef6d/users/0f57b41267204f8fa1516907d37a9ab5/roles/95d753870f97426cb1ce32e078621a4c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:05:07.355376 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d50d2a-c970-4361-a351-19e6f9fb7afd None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:07.355670 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d50d2a-c970-4361-a351-19e6f9fb7afd None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:07.355947 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d50d2a-c970-4361-a351-19e6f9fb7afd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:07.382889 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-a4d50d2a-c970-4361-a351-19e6f9fb7afd None None] MFA Rules not processed for user `0f57b41267204f8fa1516907d37a9ab5`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:05:07.384957 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-a4d50d2a-c970-4361-a351-19e6f9fb7afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:05:07.451661 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1276/2551] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 18:05:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:05:07.463601 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5908f486-51d7-40da-8736-34e3f136f372 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:07.465300 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-5908f486-51d7-40da-8736-34e3f136f372 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:05:07.518029 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:05:07.521911 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5908f486-51d7-40da-8736-34e3f136f372 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:07.527072 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbca1e64-f553-4422-922f-d0eed7e8cf3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de55cae1600841889668e36402861203', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:07.528104 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca1e64-f553-4422-922f-d0eed7e8cf3e service cinder] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:07.528458 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca1e64-f553-4422-922f-d0eed7e8cf3e service cinder] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:07.528811 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca1e64-f553-4422-922f-d0eed7e8cf3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:07.537384 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbca1e64-f553-4422-922f-d0eed7e8cf3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:07.538840 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbca1e64-f553-4422-922f-d0eed7e8cf3e service cinder] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:07.547765 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1276/2552] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 18:05:07 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:05:07.566636 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d50d2a-c970-4361-a351-19e6f9fb7afd None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:07.629301 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d50d2a-c970-4361-a351-19e6f9fb7afd None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:07.633919 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454d23f1-7921-41ec-9158-55eb4074aa46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:07.635293 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d23f1-7921-41ec-9158-55eb4074aa46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:07.635574 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d23f1-7921-41ec-9158-55eb4074aa46 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:07.635852 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d23f1-7921-41ec-9158-55eb4074aa46 admin admin] PATH_INFO: `/v3/users/0f57b41267204f8fa1516907d37a9ab5` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:07.637068 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454d23f1-7921-41ec-9158-55eb4074aa46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f57b41267204f8fa1516907d37a9ab5)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:07.639046 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454d23f1-7921-41ec-9158-55eb4074aa46 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:07.689241 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-454d23f1-7921-41ec-9158-55eb4074aa46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f57b41267204f8fa1516907d37a9ab5'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:05:07.697341 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-454d23f1-7921-41ec-9158-55eb4074aa46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f57b41267204f8fa1516907d37a9ab5'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:05:07.705463 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:05:07.716674 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-454d23f1-7921-41ec-9158-55eb4074aa46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f57b41267204f8fa1516907d37a9ab5'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:05:07.717425 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-454d23f1-7921-41ec-9158-55eb4074aa46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f57b41267204f8fa1516907d37a9ab5'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:05:07.718119 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-454d23f1-7921-41ec-9158-55eb4074aa46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f57b41267204f8fa1516907d37a9ab5'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:05:07.730325 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1277/2553] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 14 18:05:07 2022] DELETE /identity/v3/users/0f57b41267204f8fa1516907d37a9ab5 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:05:07.735134 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b9abab-702e-4e1c-9a8d-9a99d3d1c7b7 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:07.735593 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b9abab-702e-4e1c-9a8d-9a99d3d1c7b7 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:07.735953 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b9abab-702e-4e1c-9a8d-9a99d3d1c7b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:07.757314 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-e9b9abab-702e-4e1c-9a8d-9a99d3d1c7b7 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:05:07.759169 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-e9b9abab-702e-4e1c-9a8d-9a99d3d1c7b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:05:07.824870 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1277/2554] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 18:05:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:05:07.834681 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454d23f1-7921-41ec-9158-55eb4074aa46 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:07.836080 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-454d23f1-7921-41ec-9158-55eb4074aa46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:05:07.898479 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454d23f1-7921-41ec-9158-55eb4074aa46 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:07.902664 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34ac27a-a28d-4c4d-b818-f6892db73488 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:07.903313 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ac27a-a28d-4c4d-b818-f6892db73488 service neutron] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:07.903593 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ac27a-a28d-4c4d-b818-f6892db73488 service neutron] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:07.903868 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ac27a-a28d-4c4d-b818-f6892db73488 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:07.913075 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34ac27a-a28d-4c4d-b818-f6892db73488 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:07.914609 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34ac27a-a28d-4c4d-b818-f6892db73488 service neutron] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:07.924162 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1278/2555] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 18:05:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 18:05:08.204290 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b9abab-702e-4e1c-9a8d-9a99d3d1c7b7 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:08.205782 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-e9b9abab-702e-4e1c-9a8d-9a99d3d1c7b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:05:08.219899 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b9abab-702e-4e1c-9a8d-9a99d3d1c7b7 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:08.224559 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68c4276-3a5a-47fc-bd88-11200743522e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:08.226182 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c4276-3a5a-47fc-bd88-11200743522e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:08.226473 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c4276-3a5a-47fc-bd88-11200743522e admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:08.226776 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c4276-3a5a-47fc-bd88-11200743522e admin admin] PATH_INFO: `/v3/projects/50f720e24eb24dcb9f0e19e9e9eaef6d` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:08.228022 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68c4276-3a5a-47fc-bd88-11200743522e admin admin] RBAC: Authorizing `identity:delete_project(project_id=50f720e24eb24dcb9f0e19e9e9eaef6d)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:08.229980 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68c4276-3a5a-47fc-bd88-11200743522e admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:08.278129 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-b68c4276-3a5a-47fc-bd88-11200743522e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50f720e24eb24dcb9f0e19e9e9eaef6d', 'request_id': 'req-b68c4276-3a5a-47fc-bd88-11200743522e'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:05:08.283488 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-b68c4276-3a5a-47fc-bd88-11200743522e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50f720e24eb24dcb9f0e19e9e9eaef6d', 'request_id': 'req-b68c4276-3a5a-47fc-bd88-11200743522e'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:05:08.290203 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-b68c4276-3a5a-47fc-bd88-11200743522e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50f720e24eb24dcb9f0e19e9e9eaef6d', 'request_id': 'req-b68c4276-3a5a-47fc-bd88-11200743522e'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:05:08.301233 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-b68c4276-3a5a-47fc-bd88-11200743522e admin admin] The token cache is being invalidate because project 50f720e24eb24dcb9f0e19e9e9eaef6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86772) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 18:05:08.301518 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-b68c4276-3a5a-47fc-bd88-11200743522e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:05:08.302180 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-b68c4276-3a5a-47fc-bd88-11200743522e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:05:08.303698 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1278/2556] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 14 18:05:08 2022] DELETE /identity/v3/projects/50f720e24eb24dcb9f0e19e9e9eaef6d => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:05:08.309065 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d024b-276e-49f1-94b3-75f760352baf None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:08.309548 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d024b-276e-49f1-94b3-75f760352baf None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:08.309680 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d024b-276e-49f1-94b3-75f760352baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:08.327395 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-cf1d024b-276e-49f1-94b3-75f760352baf None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:05:08.328603 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-cf1d024b-276e-49f1-94b3-75f760352baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:05:08.387076 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1279/2557] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 18:05:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:05:08.395998 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49773527-7307-41f9-9794-3e7fe7591594 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:08.396288 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49773527-7307-41f9-9794-3e7fe7591594 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:08.396569 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49773527-7307-41f9-9794-3e7fe7591594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:08.414903 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-49773527-7307-41f9-9794-3e7fe7591594 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:05:08.416105 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-49773527-7307-41f9-9794-3e7fe7591594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:05:08.424406 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1279/2558] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 18:05:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:05:08.428605 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1d024b-276e-49f1-94b3-75f760352baf None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:08.438795 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1d024b-276e-49f1-94b3-75f760352baf None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:08.443353 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac1c74b-36fd-4b27-a2dc-6131f3f7e203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:08.444008 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac1c74b-36fd-4b27-a2dc-6131f3f7e203 admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:08.444293 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac1c74b-36fd-4b27-a2dc-6131f3f7e203 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:08.444574 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac1c74b-36fd-4b27-a2dc-6131f3f7e203 admin admin] PATH_INFO: `/v3/domains` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:08.445304 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac1c74b-36fd-4b27-a2dc-6131f3f7e203 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:05:08.445717 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac1c74b-36fd-4b27-a2dc-6131f3f7e203 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:08.448035 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac1c74b-36fd-4b27-a2dc-6131f3f7e203 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:08.459616 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1280/2559] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 14 18:05:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:05:08.463956 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49773527-7307-41f9-9794-3e7fe7591594 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:08.473389 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49773527-7307-41f9-9794-3e7fe7591594 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:08.478183 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797d2f96-78d2-43aa-a792-54c4a6d66abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:08.478837 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d2f96-78d2-43aa-a792-54c4a6d66abf admin admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:08.479122 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d2f96-78d2-43aa-a792-54c4a6d66abf admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:08.479394 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d2f96-78d2-43aa-a792-54c4a6d66abf admin admin] PATH_INFO: `/v3/projects` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:08.480124 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797d2f96-78d2-43aa-a792-54c4a6d66abf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:08.482070 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797d2f96-78d2-43aa-a792-54c4a6d66abf admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:08.507642 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1280/2560] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 14 18:05:08 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 18:05:08.512291 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac1c74b-36fd-4b27-a2dc-6131f3f7e203 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:08.522457 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac1c74b-36fd-4b27-a2dc-6131f3f7e203 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:08.577446 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d3cc37-5d81-4791-ada1-15ee756d48bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:08.578147 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d3cc37-5d81-4791-ada1-15ee756d48bf admin admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:08.578425 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d3cc37-5d81-4791-ada1-15ee756d48bf admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:08.578698 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d3cc37-5d81-4791-ada1-15ee756d48bf admin admin] PATH_INFO: `/v3/users` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:08.579387 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d3cc37-5d81-4791-ada1-15ee756d48bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:08.581302 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d3cc37-5d81-4791-ada1-15ee756d48bf admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:08.590688 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:05:08.602876 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1281/2561] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 14 18:05:08 2022] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 18:05:08.607648 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797d2f96-78d2-43aa-a792-54c4a6d66abf admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:08.617996 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797d2f96-78d2-43aa-a792-54c4a6d66abf admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:08.623296 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d56f354-7a3d-43fb-a0ae-5da73732d3cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:08.624216 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d56f354-7a3d-43fb-a0ae-5da73732d3cf admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:08.624502 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d56f354-7a3d-43fb-a0ae-5da73732d3cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:08.624776 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d56f354-7a3d-43fb-a0ae-5da73732d3cf admin admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:08.625503 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d56f354-7a3d-43fb-a0ae-5da73732d3cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:08.627123 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d56f354-7a3d-43fb-a0ae-5da73732d3cf admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:08.637474 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1281/2562] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 18:05:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 18:05:08.641357 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d3cc37-5d81-4791-ada1-15ee756d48bf admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:08.651260 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d3cc37-5d81-4791-ada1-15ee756d48bf admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:08.655895 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859a25fc-c90c-4efa-9379-8f9af9337c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:08.656548 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859a25fc-c90c-4efa-9379-8f9af9337c06 admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:08.656834 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859a25fc-c90c-4efa-9379-8f9af9337c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:08.657110 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859a25fc-c90c-4efa-9379-8f9af9337c06 admin admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:08.657875 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859a25fc-c90c-4efa-9379-8f9af9337c06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:08.659446 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859a25fc-c90c-4efa-9379-8f9af9337c06 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:08.669957 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1282/2563] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 18:05:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 18:05:08.673872 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d56f354-7a3d-43fb-a0ae-5da73732d3cf admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:08.684361 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d56f354-7a3d-43fb-a0ae-5da73732d3cf admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:08.689257 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26ae4d0-6016-49a6-800d-16fc81e4634e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:08.690211 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ae4d0-6016-49a6-800d-16fc81e4634e admin admin] REQUEST_METHOD: `PUT` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:08.690498 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ae4d0-6016-49a6-800d-16fc81e4634e admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:08.690777 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ae4d0-6016-49a6-800d-16fc81e4634e admin admin] PATH_INFO: `/v3/projects/8bd6c99d04d24592999bb9c152f7926e/users/65f02801b12a489d85f74730ae4249a0/roles/95d753870f97426cb1ce32e078621a4c` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:08.705390 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26ae4d0-6016-49a6-800d-16fc81e4634e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bd6c99d04d24592999bb9c152f7926e, user_id=65f02801b12a489d85f74730ae4249a0, role_id=95d753870f97426cb1ce32e078621a4c)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:08.707993 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26ae4d0-6016-49a6-800d-16fc81e4634e admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:08.720298 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1282/2564] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 18:05:08 2022] PUT /identity/v3/projects/8bd6c99d04d24592999bb9c152f7926e/users/65f02801b12a489d85f74730ae4249a0/roles/95d753870f97426cb1ce32e078621a4c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:05:08.731231 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f8d91-ec01-4fb1-a12d-984f4ad5f0ac None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:08.731528 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f8d91-ec01-4fb1-a12d-984f4ad5f0ac None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:08.731811 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f8d91-ec01-4fb1-a12d-984f4ad5f0ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:08.758607 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-a20f8d91-ec01-4fb1-a12d-984f4ad5f0ac None None] MFA Rules not processed for user `65f02801b12a489d85f74730ae4249a0`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:05:08.759891 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-a20f8d91-ec01-4fb1-a12d-984f4ad5f0ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:05:08.823216 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1283/2565] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 18:05:08 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 18:05:08.834166 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26ae4d0-6016-49a6-800d-16fc81e4634e admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:08.835990 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-e26ae4d0-6016-49a6-800d-16fc81e4634e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:05:08.849580 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:05:08.898365 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26ae4d0-6016-49a6-800d-16fc81e4634e admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:08.902619 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9106af2-5d9f-4354-8121-d876b0097ac1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de55cae1600841889668e36402861203', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:08.903267 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9106af2-5d9f-4354-8121-d876b0097ac1 service cinder] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:08.903551 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9106af2-5d9f-4354-8121-d876b0097ac1 service cinder] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:08.903826 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9106af2-5d9f-4354-8121-d876b0097ac1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:08.912808 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9106af2-5d9f-4354-8121-d876b0097ac1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:08.914269 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9106af2-5d9f-4354-8121-d876b0097ac1 service cinder] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:08.924096 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1283/2566] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 18:05:08 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:05:18.820819 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=39 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:05:18.899464 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20f8d91-ec01-4fb1-a12d-984f4ad5f0ac None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:18.919725 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=21 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:05:18.961774 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20f8d91-ec01-4fb1-a12d-984f4ad5f0ac None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:18.966286 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d75b8f-6f9b-4719-a16b-79f7c224d77d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:18.967183 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d75b8f-6f9b-4719-a16b-79f7c224d77d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:18.967456 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d75b8f-6f9b-4719-a16b-79f7c224d77d admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:18.967726 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d75b8f-6f9b-4719-a16b-79f7c224d77d admin admin] PATH_INFO: `/v3/users/65f02801b12a489d85f74730ae4249a0` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:18.968893 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d75b8f-6f9b-4719-a16b-79f7c224d77d admin admin] RBAC: Authorizing `identity:delete_user(user_id=65f02801b12a489d85f74730ae4249a0)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:18.970827 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d75b8f-6f9b-4719-a16b-79f7c224d77d admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:19.016985 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-27d75b8f-6f9b-4719-a16b-79f7c224d77d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65f02801b12a489d85f74730ae4249a0'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:05:19.024531 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-27d75b8f-6f9b-4719-a16b-79f7c224d77d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65f02801b12a489d85f74730ae4249a0'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:05:19.036270 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-27d75b8f-6f9b-4719-a16b-79f7c224d77d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65f02801b12a489d85f74730ae4249a0'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:05:19.036947 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-27d75b8f-6f9b-4719-a16b-79f7c224d77d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65f02801b12a489d85f74730ae4249a0'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:05:19.037576 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-27d75b8f-6f9b-4719-a16b-79f7c224d77d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65f02801b12a489d85f74730ae4249a0'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:05:19.049519 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1284/2567] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 14 18:05:18 2022] DELETE /identity/v3/users/65f02801b12a489d85f74730ae4249a0 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:05:19.054008 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a4c8fc-639e-41e7-973d-04fb080fa614 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:19.054793 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a4c8fc-639e-41e7-973d-04fb080fa614 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:19.055070 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a4c8fc-639e-41e7-973d-04fb080fa614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:19.072748 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-c1a4c8fc-639e-41e7-973d-04fb080fa614 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:05:19.073933 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-c1a4c8fc-639e-41e7-973d-04fb080fa614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:05:19.131075 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1284/2568] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 18:05:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:05:19.141268 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d75b8f-6f9b-4719-a16b-79f7c224d77d admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:19.142703 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-27d75b8f-6f9b-4719-a16b-79f7c224d77d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:05:19.200956 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d75b8f-6f9b-4719-a16b-79f7c224d77d admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:19.204631 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2d0618-6410-4f46-976e-f7701e337c9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:19.205279 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d0618-6410-4f46-976e-f7701e337c9d service neutron] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:19.205588 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d0618-6410-4f46-976e-f7701e337c9d service neutron] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:19.205870 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d0618-6410-4f46-976e-f7701e337c9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:19.214935 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2d0618-6410-4f46-976e-f7701e337c9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:19.216359 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2d0618-6410-4f46-976e-f7701e337c9d service neutron] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:19.226183 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1285/2569] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 18:05:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:05:19.488782 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a4c8fc-639e-41e7-973d-04fb080fa614 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:19.490317 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-c1a4c8fc-639e-41e7-973d-04fb080fa614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:05:19.505672 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a4c8fc-639e-41e7-973d-04fb080fa614 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:19.510417 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9448dbca-09b9-4d84-855e-5f9e0217a2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:19.511280 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9448dbca-09b9-4d84-855e-5f9e0217a2f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:19.511557 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9448dbca-09b9-4d84-855e-5f9e0217a2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:19.511831 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9448dbca-09b9-4d84-855e-5f9e0217a2f8 admin admin] PATH_INFO: `/v3/projects/8bd6c99d04d24592999bb9c152f7926e` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:19.513012 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9448dbca-09b9-4d84-855e-5f9e0217a2f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bd6c99d04d24592999bb9c152f7926e)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:19.514961 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9448dbca-09b9-4d84-855e-5f9e0217a2f8 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:19.562051 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-9448dbca-09b9-4d84-855e-5f9e0217a2f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bd6c99d04d24592999bb9c152f7926e', 'request_id': 'req-9448dbca-09b9-4d84-855e-5f9e0217a2f8'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:05:19.567567 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-9448dbca-09b9-4d84-855e-5f9e0217a2f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bd6c99d04d24592999bb9c152f7926e', 'request_id': 'req-9448dbca-09b9-4d84-855e-5f9e0217a2f8'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:05:19.574809 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-9448dbca-09b9-4d84-855e-5f9e0217a2f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bd6c99d04d24592999bb9c152f7926e', 'request_id': 'req-9448dbca-09b9-4d84-855e-5f9e0217a2f8'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:05:19.585721 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-9448dbca-09b9-4d84-855e-5f9e0217a2f8 admin admin] The token cache is being invalidate because project 8bd6c99d04d24592999bb9c152f7926e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86772) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 18:05:19.586007 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-9448dbca-09b9-4d84-855e-5f9e0217a2f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:05:19.586659 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-9448dbca-09b9-4d84-855e-5f9e0217a2f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:05:19.588243 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1285/2570] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 14 18:05:19 2022] DELETE /identity/v3/projects/8bd6c99d04d24592999bb9c152f7926e => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:05:19.593126 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0854667-7ba7-436f-b94d-3bd8ec311294 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:19.593576 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0854667-7ba7-436f-b94d-3bd8ec311294 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:19.593882 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0854667-7ba7-436f-b94d-3bd8ec311294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:19.611983 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-f0854667-7ba7-436f-b94d-3bd8ec311294 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:05:19.613141 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-f0854667-7ba7-436f-b94d-3bd8ec311294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:05:19.630425 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:05:19.674281 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1286/2571] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 18:05:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:05:19.682796 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a8c0b2-1adc-4000-a61c-7a5debd5c597 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:19.683086 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a8c0b2-1adc-4000-a61c-7a5debd5c597 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:19.683365 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a8c0b2-1adc-4000-a61c-7a5debd5c597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:19.701169 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-32a8c0b2-1adc-4000-a61c-7a5debd5c597 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:05:19.702380 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-32a8c0b2-1adc-4000-a61c-7a5debd5c597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:05:19.710164 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1286/2572] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 18:05:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:05:19.715649 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0854667-7ba7-436f-b94d-3bd8ec311294 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:19.725217 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0854667-7ba7-436f-b94d-3bd8ec311294 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:19.730256 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59961c64-caeb-492a-a6b0-7b5ca2209c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:19.730910 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59961c64-caeb-492a-a6b0-7b5ca2209c09 admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:19.731194 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59961c64-caeb-492a-a6b0-7b5ca2209c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:19.731471 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59961c64-caeb-492a-a6b0-7b5ca2209c09 admin admin] PATH_INFO: `/v3/domains` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:19.732203 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59961c64-caeb-492a-a6b0-7b5ca2209c09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:05:19.732512 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59961c64-caeb-492a-a6b0-7b5ca2209c09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:19.734141 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59961c64-caeb-492a-a6b0-7b5ca2209c09 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:19.746233 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1287/2573] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 14 18:05:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:05:19.751100 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a8c0b2-1adc-4000-a61c-7a5debd5c597 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:19.760835 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a8c0b2-1adc-4000-a61c-7a5debd5c597 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:19.765822 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2dc36c-4ab9-45d3-9189-a3c55209129a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:19.766489 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2dc36c-4ab9-45d3-9189-a3c55209129a admin admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:19.766768 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2dc36c-4ab9-45d3-9189-a3c55209129a admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:19.767110 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2dc36c-4ab9-45d3-9189-a3c55209129a admin admin] PATH_INFO: `/v3/projects` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:19.767736 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2dc36c-4ab9-45d3-9189-a3c55209129a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:19.769645 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2dc36c-4ab9-45d3-9189-a3c55209129a admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:19.800103 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1287/2574] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 14 18:05:19 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 18:05:19.804916 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59961c64-caeb-492a-a6b0-7b5ca2209c09 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:19.816124 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59961c64-caeb-492a-a6b0-7b5ca2209c09 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:19.875521 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6e77d2-0315-40e5-86ec-067adb7fd118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:19.876198 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e77d2-0315-40e5-86ec-067adb7fd118 admin admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:19.876383 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e77d2-0315-40e5-86ec-067adb7fd118 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:19.876657 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e77d2-0315-40e5-86ec-067adb7fd118 admin admin] PATH_INFO: `/v3/users` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:19.877402 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6e77d2-0315-40e5-86ec-067adb7fd118 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:19.879440 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6e77d2-0315-40e5-86ec-067adb7fd118 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:19.902158 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1288/2575] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 14 18:05:19 2022] POST /identity/v3/users => generated 287 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 18:05:19.906847 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2dc36c-4ab9-45d3-9189-a3c55209129a admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:19.917201 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2dc36c-4ab9-45d3-9189-a3c55209129a admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:19.921867 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad1a2b3-f129-4145-a48a-89357721e717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:19.922548 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad1a2b3-f129-4145-a48a-89357721e717 admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:19.922837 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad1a2b3-f129-4145-a48a-89357721e717 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:19.923121 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad1a2b3-f129-4145-a48a-89357721e717 admin admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:19.923893 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad1a2b3-f129-4145-a48a-89357721e717 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:19.925502 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad1a2b3-f129-4145-a48a-89357721e717 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:19.936763 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1288/2576] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 18:05:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 18:05:19.940858 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6e77d2-0315-40e5-86ec-067adb7fd118 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:19.951576 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6e77d2-0315-40e5-86ec-067adb7fd118 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:19.956243 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2fbdd3-e124-45c6-8e83-7d5814c2cf6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:19.956910 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2fbdd3-e124-45c6-8e83-7d5814c2cf6a admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:19.957191 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2fbdd3-e124-45c6-8e83-7d5814c2cf6a admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:19.957465 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2fbdd3-e124-45c6-8e83-7d5814c2cf6a admin admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:19.958240 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2fbdd3-e124-45c6-8e83-7d5814c2cf6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:19.959831 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2fbdd3-e124-45c6-8e83-7d5814c2cf6a admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:19.971317 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1289/2577] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 18:05:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 18:05:19.975544 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad1a2b3-f129-4145-a48a-89357721e717 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:19.986098 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad1a2b3-f129-4145-a48a-89357721e717 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:19.990868 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94675860-0d96-4bfc-b5f4-0aeb43faf177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:19.991755 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94675860-0d96-4bfc-b5f4-0aeb43faf177 admin admin] REQUEST_METHOD: `PUT` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:19.992064 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94675860-0d96-4bfc-b5f4-0aeb43faf177 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:19.992340 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94675860-0d96-4bfc-b5f4-0aeb43faf177 admin admin] PATH_INFO: `/v3/projects/db88faff6e694df88ae1a0432d79493a/users/4598a718f88d4f0685817b145e5ffb58/roles/95d753870f97426cb1ce32e078621a4c` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:20.008163 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94675860-0d96-4bfc-b5f4-0aeb43faf177 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db88faff6e694df88ae1a0432d79493a, user_id=4598a718f88d4f0685817b145e5ffb58, role_id=95d753870f97426cb1ce32e078621a4c)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:20.010845 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94675860-0d96-4bfc-b5f4-0aeb43faf177 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:20.025476 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1289/2578] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 18:05:19 2022] PUT /identity/v3/projects/db88faff6e694df88ae1a0432d79493a/users/4598a718f88d4f0685817b145e5ffb58/roles/95d753870f97426cb1ce32e078621a4c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:05:20.035752 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd933077-0596-45b4-a8ac-ee90c88b9336 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:20.036042 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd933077-0596-45b4-a8ac-ee90c88b9336 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:20.036322 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd933077-0596-45b4-a8ac-ee90c88b9336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:20.065175 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-cd933077-0596-45b4-a8ac-ee90c88b9336 None None] MFA Rules not processed for user `4598a718f88d4f0685817b145e5ffb58`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:05:20.066418 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-cd933077-0596-45b4-a8ac-ee90c88b9336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:05:20.141646 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1290/2579] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 18:05:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:05:20.154398 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94675860-0d96-4bfc-b5f4-0aeb43faf177 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:20.156792 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-94675860-0d96-4bfc-b5f4-0aeb43faf177 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:05:20.181414 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:05:20.226566 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94675860-0d96-4bfc-b5f4-0aeb43faf177 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:20.230353 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cdd2b3-ee3e-4f78-bb6a-027475799e5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de55cae1600841889668e36402861203', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:20.231018 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cdd2b3-ee3e-4f78-bb6a-027475799e5a service cinder] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:20.231301 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cdd2b3-ee3e-4f78-bb6a-027475799e5a service cinder] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:20.231582 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cdd2b3-ee3e-4f78-bb6a-027475799e5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:20.240398 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cdd2b3-ee3e-4f78-bb6a-027475799e5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:20.242554 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cdd2b3-ee3e-4f78-bb6a-027475799e5a service cinder] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:20.252352 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1290/2580] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 18:05:20 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:05:21.603632 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55280e4-885e-4e98-8e22-628908660836 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:21.604158 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55280e4-885e-4e98-8e22-628908660836 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:21.604255 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55280e4-885e-4e98-8e22-628908660836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:21.623022 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-a55280e4-885e-4e98-8e22-628908660836 None None] MFA Rules not processed for user `4598a718f88d4f0685817b145e5ffb58`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:05:21.624209 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-a55280e4-885e-4e98-8e22-628908660836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:05:21.631092 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1291/2581] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 18:05:21 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:05:21.667448 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cdd2b3-ee3e-4f78-bb6a-027475799e5a service cinder] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:21.668836 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-38cdd2b3-ee3e-4f78-bb6a-027475799e5a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:05:21.729138 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cdd2b3-ee3e-4f78-bb6a-027475799e5a service cinder] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:21.733025 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4174416-0be3-4455-bb8e-fa6a677d60b3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eb7180aab4541b4aab6cf8648eac1f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:21.733700 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4174416-0be3-4455-bb8e-fa6a677d60b3 service glance] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:21.733983 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4174416-0be3-4455-bb8e-fa6a677d60b3 service glance] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:21.734258 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4174416-0be3-4455-bb8e-fa6a677d60b3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:21.736195 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-e4174416-0be3-4455-bb8e-fa6a677d60b3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:05:21.817888 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4174416-0be3-4455-bb8e-fa6a677d60b3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:21.819320 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4174416-0be3-4455-bb8e-fa6a677d60b3 service glance] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:21.831386 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1291/2582] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 18:05:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:05:23.291884 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55280e4-885e-4e98-8e22-628908660836 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:23.293298 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-a55280e4-885e-4e98-8e22-628908660836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:05:23.306744 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:05:23.354972 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55280e4-885e-4e98-8e22-628908660836 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:23.358483 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3ec7d3-9d8c-48f6-a90e-8534bec8fffe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:23.359164 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3ec7d3-9d8c-48f6-a90e-8534bec8fffe service neutron] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:23.359445 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3ec7d3-9d8c-48f6-a90e-8534bec8fffe service neutron] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:23.359724 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3ec7d3-9d8c-48f6-a90e-8534bec8fffe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:23.361706 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-7e3ec7d3-9d8c-48f6-a90e-8534bec8fffe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:05:23.377280 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3ec7d3-9d8c-48f6-a90e-8534bec8fffe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:23.378762 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3ec7d3-9d8c-48f6-a90e-8534bec8fffe service neutron] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:23.391081 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1292/2583] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 18:05:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 18:05:31.826197 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=71 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:05:33.386235 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=21 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:05:36.086576 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4174416-0be3-4455-bb8e-fa6a677d60b3 service glance] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:36.095935 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4174416-0be3-4455-bb8e-fa6a677d60b3 service glance] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:36.100212 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7800ecb1-b831-4372-a86f-f500b75f7af1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:36.100840 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7800ecb1-b831-4372-a86f-f500b75f7af1 service neutron] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:36.101120 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7800ecb1-b831-4372-a86f-f500b75f7af1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:36.101392 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7800ecb1-b831-4372-a86f-f500b75f7af1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:36.103170 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-7800ecb1-b831-4372-a86f-f500b75f7af1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:05:36.168471 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7800ecb1-b831-4372-a86f-f500b75f7af1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:36.169935 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7800ecb1-b831-4372-a86f-f500b75f7af1 service neutron] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:36.179986 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1292/2584] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 18:05:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:05:39.909039 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3ec7d3-9d8c-48f6-a90e-8534bec8fffe service neutron] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:39.910579 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-7e3ec7d3-9d8c-48f6-a90e-8534bec8fffe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:05:39.996848 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3ec7d3-9d8c-48f6-a90e-8534bec8fffe service neutron] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:39.999652 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7800ecb1-b831-4372-a86f-f500b75f7af1 service neutron] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:40.001169 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-7800ecb1-b831-4372-a86f-f500b75f7af1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:05:40.002849 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab1ba6d-5a14-43e0-946d-038a1c07a429 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5324ab45f4a4449980dad920278f5034', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:40.003506 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab1ba6d-5a14-43e0-946d-038a1c07a429 service placement] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:40.003791 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab1ba6d-5a14-43e0-946d-038a1c07a429 service placement] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:40.004597 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab1ba6d-5a14-43e0-946d-038a1c07a429 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:40.006391 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-3ab1ba6d-5a14-43e0-946d-038a1c07a429 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:05:40.018975 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab1ba6d-5a14-43e0-946d-038a1c07a429 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:40.021222 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab1ba6d-5a14-43e0-946d-038a1c07a429 service placement] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:40.022088 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7800ecb1-b831-4372-a86f-f500b75f7af1 service neutron] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:40.027075 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daaeca4-457a-449b-ac83-85e2ef548e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:40.028049 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daaeca4-457a-449b-ac83-85e2ef548e90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:40.028338 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daaeca4-457a-449b-ac83-85e2ef548e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:40.028615 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daaeca4-457a-449b-ac83-85e2ef548e90 admin admin] PATH_INFO: `/v3/users/dc2eceb8989543d4bdbbcd706ddbe676` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:40.032328 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1293/2585] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 18:05:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:05:40.043777 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daaeca4-457a-449b-ac83-85e2ef548e90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc2eceb8989543d4bdbbcd706ddbe676)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:40.045758 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daaeca4-457a-449b-ac83-85e2ef548e90 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:40.091995 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-3daaeca4-457a-449b-ac83-85e2ef548e90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc2eceb8989543d4bdbbcd706ddbe676'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:05:40.100120 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-3daaeca4-457a-449b-ac83-85e2ef548e90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc2eceb8989543d4bdbbcd706ddbe676'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:05:40.107383 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-3daaeca4-457a-449b-ac83-85e2ef548e90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc2eceb8989543d4bdbbcd706ddbe676'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:05:40.108023 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-3daaeca4-457a-449b-ac83-85e2ef548e90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc2eceb8989543d4bdbbcd706ddbe676'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:05:40.120998 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-3daaeca4-457a-449b-ac83-85e2ef548e90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc2eceb8989543d4bdbbcd706ddbe676'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:05:40.126910 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1293/2586] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 14 18:05:39 2022] DELETE /identity/v3/users/dc2eceb8989543d4bdbbcd706ddbe676 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:05:40.307525 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab1ba6d-5a14-43e0-946d-038a1c07a429 service placement] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:40.319453 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab1ba6d-5a14-43e0-946d-038a1c07a429 service placement] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:40.376987 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278d2ca0-99af-42b5-8f71-0062e255d2fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:40.377889 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d2ca0-99af-42b5-8f71-0062e255d2fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:40.378172 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d2ca0-99af-42b5-8f71-0062e255d2fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:40.378451 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d2ca0-99af-42b5-8f71-0062e255d2fc admin admin] PATH_INFO: `/v3/projects/3690dbb8683244128e547bf65677c776` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:40.388871 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278d2ca0-99af-42b5-8f71-0062e255d2fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=3690dbb8683244128e547bf65677c776)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:40.390815 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278d2ca0-99af-42b5-8f71-0062e255d2fc admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:40.436750 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-278d2ca0-99af-42b5-8f71-0062e255d2fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3690dbb8683244128e547bf65677c776', 'request_id': 'req-278d2ca0-99af-42b5-8f71-0062e255d2fc'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:05:40.443251 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-278d2ca0-99af-42b5-8f71-0062e255d2fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3690dbb8683244128e547bf65677c776', 'request_id': 'req-278d2ca0-99af-42b5-8f71-0062e255d2fc'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:05:40.448649 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-278d2ca0-99af-42b5-8f71-0062e255d2fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3690dbb8683244128e547bf65677c776', 'request_id': 'req-278d2ca0-99af-42b5-8f71-0062e255d2fc'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:05:40.466198 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-278d2ca0-99af-42b5-8f71-0062e255d2fc admin admin] The token cache is being invalidate because project 3690dbb8683244128e547bf65677c776 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86773) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 18:05:40.466489 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-278d2ca0-99af-42b5-8f71-0062e255d2fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:05:40.467121 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-278d2ca0-99af-42b5-8f71-0062e255d2fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:05:40.468675 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1294/2587] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 14 18:05:40 2022] DELETE /identity/v3/projects/3690dbb8683244128e547bf65677c776 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:05:40.474456 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9067f9-a171-45a9-8586-728b1870e700 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:40.474745 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9067f9-a171-45a9-8586-728b1870e700 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:40.475066 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9067f9-a171-45a9-8586-728b1870e700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:40.493861 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-4a9067f9-a171-45a9-8586-728b1870e700 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:05:40.495329 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-4a9067f9-a171-45a9-8586-728b1870e700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:05:40.545497 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:05:40.558288 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1294/2588] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 18:05:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:05:40.566865 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1428b707-0cbd-4b4b-99aa-d4a03b1bd94f None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:40.567150 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1428b707-0cbd-4b4b-99aa-d4a03b1bd94f None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:40.567429 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1428b707-0cbd-4b4b-99aa-d4a03b1bd94f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:40.585127 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-1428b707-0cbd-4b4b-99aa-d4a03b1bd94f None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:05:40.586371 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-1428b707-0cbd-4b4b-99aa-d4a03b1bd94f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:05:40.594250 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1295/2589] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 18:05:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:05:40.598934 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9067f9-a171-45a9-8586-728b1870e700 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:40.608667 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9067f9-a171-45a9-8586-728b1870e700 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:40.613232 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f87b8d7-30ea-4693-b5fa-98ea1ba7a63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:40.613925 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f87b8d7-30ea-4693-b5fa-98ea1ba7a63f admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:40.614211 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f87b8d7-30ea-4693-b5fa-98ea1ba7a63f admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:40.614487 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f87b8d7-30ea-4693-b5fa-98ea1ba7a63f admin admin] PATH_INFO: `/v3/domains` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:40.615216 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f87b8d7-30ea-4693-b5fa-98ea1ba7a63f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:05:40.615521 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f87b8d7-30ea-4693-b5fa-98ea1ba7a63f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:40.617108 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f87b8d7-30ea-4693-b5fa-98ea1ba7a63f admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:40.628759 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1295/2590] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 14 18:05:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:05:40.633254 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1428b707-0cbd-4b4b-99aa-d4a03b1bd94f None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:40.638972 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:05:40.643287 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1428b707-0cbd-4b4b-99aa-d4a03b1bd94f None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:40.649473 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd523692-5d11-43cc-b7f9-8b2eb6f81229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:40.650216 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd523692-5d11-43cc-b7f9-8b2eb6f81229 admin admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:40.650590 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd523692-5d11-43cc-b7f9-8b2eb6f81229 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:40.651053 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd523692-5d11-43cc-b7f9-8b2eb6f81229 admin admin] PATH_INFO: `/v3/projects` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:40.652137 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd523692-5d11-43cc-b7f9-8b2eb6f81229 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:40.654070 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd523692-5d11-43cc-b7f9-8b2eb6f81229 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:40.679501 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1296/2591] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 14 18:05:40 2022] POST /identity/v3/projects => generated 379 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 18:05:40.683694 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f87b8d7-30ea-4693-b5fa-98ea1ba7a63f admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:40.693740 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f87b8d7-30ea-4693-b5fa-98ea1ba7a63f admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:40.750148 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e7ee51-8a43-4f75-99cf-d7f1b1afcde2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:40.750818 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e7ee51-8a43-4f75-99cf-d7f1b1afcde2 admin admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:40.751133 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e7ee51-8a43-4f75-99cf-d7f1b1afcde2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:40.751410 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e7ee51-8a43-4f75-99cf-d7f1b1afcde2 admin admin] PATH_INFO: `/v3/users` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:40.752125 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e7ee51-8a43-4f75-99cf-d7f1b1afcde2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:40.754169 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e7ee51-8a43-4f75-99cf-d7f1b1afcde2 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:40.773994 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1296/2592] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 14 18:05:40 2022] POST /identity/v3/users => generated 290 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 18:05:40.778275 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd523692-5d11-43cc-b7f9-8b2eb6f81229 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:40.789044 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd523692-5d11-43cc-b7f9-8b2eb6f81229 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:40.793618 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7fce98-535b-4837-9c3e-2fd936df975a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:40.794277 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7fce98-535b-4837-9c3e-2fd936df975a admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:40.794556 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7fce98-535b-4837-9c3e-2fd936df975a admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:40.794830 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7fce98-535b-4837-9c3e-2fd936df975a admin admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:40.795550 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7fce98-535b-4837-9c3e-2fd936df975a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:40.797123 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7fce98-535b-4837-9c3e-2fd936df975a admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:40.807757 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1297/2593] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 18:05:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 18:05:40.811814 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e7ee51-8a43-4f75-99cf-d7f1b1afcde2 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:40.823361 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e7ee51-8a43-4f75-99cf-d7f1b1afcde2 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:40.827991 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a0e796-1565-4618-a024-e362553ff081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:40.828673 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a0e796-1565-4618-a024-e362553ff081 admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:40.828962 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a0e796-1565-4618-a024-e362553ff081 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:40.829241 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a0e796-1565-4618-a024-e362553ff081 admin admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:40.830040 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a0e796-1565-4618-a024-e362553ff081 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:40.831673 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a0e796-1565-4618-a024-e362553ff081 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:40.842453 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1297/2594] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 18:05:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 18:05:40.846730 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7fce98-535b-4837-9c3e-2fd936df975a admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:40.856901 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7fce98-535b-4837-9c3e-2fd936df975a admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:40.861502 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf94de4c-d7fa-4254-be93-d58617ee84ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:40.862426 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf94de4c-d7fa-4254-be93-d58617ee84ac admin admin] REQUEST_METHOD: `PUT` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:40.862705 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf94de4c-d7fa-4254-be93-d58617ee84ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:40.862976 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf94de4c-d7fa-4254-be93-d58617ee84ac admin admin] PATH_INFO: `/v3/projects/4d1669a8d7dc4130ac0624401ca30f4a/users/ead19f46598c45fe949cdf7e935bc4ba/roles/95d753870f97426cb1ce32e078621a4c` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:40.877961 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf94de4c-d7fa-4254-be93-d58617ee84ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d1669a8d7dc4130ac0624401ca30f4a, user_id=ead19f46598c45fe949cdf7e935bc4ba, role_id=95d753870f97426cb1ce32e078621a4c)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:40.881060 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf94de4c-d7fa-4254-be93-d58617ee84ac admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:40.895959 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1298/2595] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 18:05:40 2022] PUT /identity/v3/projects/4d1669a8d7dc4130ac0624401ca30f4a/users/ead19f46598c45fe949cdf7e935bc4ba/roles/95d753870f97426cb1ce32e078621a4c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:05:40.905908 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72509436-fe90-4e36-8180-0b3aabf27c16 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:40.906218 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72509436-fe90-4e36-8180-0b3aabf27c16 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:40.906496 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72509436-fe90-4e36-8180-0b3aabf27c16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:40.932966 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-72509436-fe90-4e36-8180-0b3aabf27c16 None None] MFA Rules not processed for user `ead19f46598c45fe949cdf7e935bc4ba`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:05:40.934202 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-72509436-fe90-4e36-8180-0b3aabf27c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:05:40.998650 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1298/2596] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 18:05:40 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:05:41.008658 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf94de4c-d7fa-4254-be93-d58617ee84ac admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:41.074048 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf94de4c-d7fa-4254-be93-d58617ee84ac admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:41.079129 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96357360-7a90-4463-9b99-3139c8ea0e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:41.079820 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96357360-7a90-4463-9b99-3139c8ea0e80 admin admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:41.080099 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96357360-7a90-4463-9b99-3139c8ea0e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:41.080371 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96357360-7a90-4463-9b99-3139c8ea0e80 admin admin] PATH_INFO: `/v3/projects` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:41.081086 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96357360-7a90-4463-9b99-3139c8ea0e80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:41.083746 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96357360-7a90-4463-9b99-3139c8ea0e80 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:41.108035 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e290d85-5397-4f84-9ddd-184c13038c5e None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:41.108542 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e290d85-5397-4f84-9ddd-184c13038c5e None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:41.108768 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e290d85-5397-4f84-9ddd-184c13038c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:41.111099 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1299/2597] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 14 18:05:41 2022] POST /identity/v3/projects => generated 379 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 18:05:41.115038 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96357360-7a90-4463-9b99-3139c8ea0e80 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:41.159913 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-0e290d85-5397-4f84-9ddd-184c13038c5e None None] MFA Rules not processed for user `45542602225b452fa323f5499c1843ec`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:05:41.161170 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-0e290d85-5397-4f84-9ddd-184c13038c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:05:41.179053 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96357360-7a90-4463-9b99-3139c8ea0e80 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:41.184894 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:05:41.185197 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd89e67f-afa5-48c9-8780-42238643d220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:41.185906 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd89e67f-afa5-48c9-8780-42238643d220 admin admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:41.186188 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd89e67f-afa5-48c9-8780-42238643d220 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:41.186454 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd89e67f-afa5-48c9-8780-42238643d220 admin admin] PATH_INFO: `/v3/users` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:41.187158 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd89e67f-afa5-48c9-8780-42238643d220 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:41.189060 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd89e67f-afa5-48c9-8780-42238643d220 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:41.209596 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1300/2598] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 14 18:05:41 2022] POST /identity/v3/users => generated 296 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 18:05:41.213606 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd89e67f-afa5-48c9-8780-42238643d220 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:41.223543 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd89e67f-afa5-48c9-8780-42238643d220 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:41.228316 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c24d48e-c82a-49fe-a77b-b6ce6d674ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:41.229009 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c24d48e-c82a-49fe-a77b-b6ce6d674ee7 admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:41.229355 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c24d48e-c82a-49fe-a77b-b6ce6d674ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:41.229702 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c24d48e-c82a-49fe-a77b-b6ce6d674ee7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:41.230460 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c24d48e-c82a-49fe-a77b-b6ce6d674ee7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:41.232202 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c24d48e-c82a-49fe-a77b-b6ce6d674ee7 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:41.232736 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1299/2599] 10.222.0.67 () {58 vars in 1009 bytes} [Thu Jul 14 18:05:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 18:05:41.247736 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1301/2600] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 18:05:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 18:05:41.251956 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e290d85-5397-4f84-9ddd-184c13038c5e None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:41.264334 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e290d85-5397-4f84-9ddd-184c13038c5e None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:41.268899 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3a3b14-4dde-46bc-8873-5079370ffd7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:41.269901 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3a3b14-4dde-46bc-8873-5079370ffd7b admin admin] REQUEST_METHOD: `PUT` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:41.270232 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3a3b14-4dde-46bc-8873-5079370ffd7b admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:41.270550 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3a3b14-4dde-46bc-8873-5079370ffd7b admin admin] PATH_INFO: `/v3/projects/b2f77f2b1bf74ea7be2e2b9b12a60ac8/users/b86b6dcaba4b42cd8aae32cfc9c77e8a/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:41.282266 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c24d48e-c82a-49fe-a77b-b6ce6d674ee7 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:41.283991 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-7c24d48e-c82a-49fe-a77b-b6ce6d674ee7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:05:41.286937 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3a3b14-4dde-46bc-8873-5079370ffd7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2f77f2b1bf74ea7be2e2b9b12a60ac8, user_id=b86b6dcaba4b42cd8aae32cfc9c77e8a, role_id=4651a1cc7b4d4ab7a7a9ca1e77e58e71)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:41.289681 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3a3b14-4dde-46bc-8873-5079370ffd7b admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:41.298269 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:05:41.304320 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1300/2601] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 18:05:41 2022] PUT /identity/v3/projects/b2f77f2b1bf74ea7be2e2b9b12a60ac8/users/b86b6dcaba4b42cd8aae32cfc9c77e8a/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:05:41.308654 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3a3b14-4dde-46bc-8873-5079370ffd7b admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:41.371951 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3a3b14-4dde-46bc-8873-5079370ffd7b admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:41.376609 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2421c53b-40c7-4397-a65a-1fabd2925765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:41.377281 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2421c53b-40c7-4397-a65a-1fabd2925765 admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:41.377689 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2421c53b-40c7-4397-a65a-1fabd2925765 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:41.377978 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2421c53b-40c7-4397-a65a-1fabd2925765 admin admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:41.378744 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2421c53b-40c7-4397-a65a-1fabd2925765 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:41.380892 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2421c53b-40c7-4397-a65a-1fabd2925765 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:41.385629 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c24d48e-c82a-49fe-a77b-b6ce6d674ee7 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:41.395722 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1301/2602] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 18:05:41 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 18:05:41.397161 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2421c53b-40c7-4397-a65a-1fabd2925765 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:41.406675 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2421c53b-40c7-4397-a65a-1fabd2925765 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:41.411912 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5d20a0-3895-47e1-8572-b3ff7833d7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:41.412771 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5d20a0-3895-47e1-8572-b3ff7833d7da admin admin] REQUEST_METHOD: `PUT` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:41.413228 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5d20a0-3895-47e1-8572-b3ff7833d7da admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:41.413404 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5d20a0-3895-47e1-8572-b3ff7833d7da admin admin] PATH_INFO: `/v3/projects/b2f77f2b1bf74ea7be2e2b9b12a60ac8/users/b86b6dcaba4b42cd8aae32cfc9c77e8a/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:41.415569 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5d20a0-3895-47e1-8572-b3ff7833d7da admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2f77f2b1bf74ea7be2e2b9b12a60ac8, user_id=b86b6dcaba4b42cd8aae32cfc9c77e8a, role_id=4651a1cc7b4d4ab7a7a9ca1e77e58e71)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:41.418273 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5d20a0-3895-47e1-8572-b3ff7833d7da admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:41.428988 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1302/2603] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 18:05:41 2022] PUT /identity/v3/projects/b2f77f2b1bf74ea7be2e2b9b12a60ac8/users/b86b6dcaba4b42cd8aae32cfc9c77e8a/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 18:05:41.440139 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fe2bab-b1c6-4574-81fe-4d9f7ac0c00d None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:41.440421 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fe2bab-b1c6-4574-81fe-4d9f7ac0c00d None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:41.440696 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fe2bab-b1c6-4574-81fe-4d9f7ac0c00d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:41.450229 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dfd2bf-841b-4992-a486-b0db9d3a9e4e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c65607a396474192a43c374d306ef5ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:41.450963 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dfd2bf-841b-4992-a486-b0db9d3a9e4e service swift] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:41.451316 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dfd2bf-841b-4992-a486-b0db9d3a9e4e service swift] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:41.451657 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dfd2bf-841b-4992-a486-b0db9d3a9e4e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:41.473668 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-a3fe2bab-b1c6-4574-81fe-4d9f7ac0c00d None None] MFA Rules not processed for user `b86b6dcaba4b42cd8aae32cfc9c77e8a`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:05:41.474887 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-a3fe2bab-b1c6-4574-81fe-4d9f7ac0c00d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:05:41.509872 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dfd2bf-841b-4992-a486-b0db9d3a9e4e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:41.511545 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dfd2bf-841b-4992-a486-b0db9d3a9e4e service swift] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:41.520417 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1302/2604] 10.222.0.67 () {60 vars in 1384 bytes} [Thu Jul 14 18:05:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 18:05:41.550293 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1303/2605] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 18:05:41 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 18:05:41.562653 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dfd2bf-841b-4992-a486-b0db9d3a9e4e service swift] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:41.564095 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-28dfd2bf-841b-4992-a486-b0db9d3a9e4e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:05:41.606391 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:05:41.625512 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dfd2bf-841b-4992-a486-b0db9d3a9e4e service swift] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:41.675758 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73806edf-2a75-4180-b922-fbe9a41b7a4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de55cae1600841889668e36402861203', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:41.676452 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73806edf-2a75-4180-b922-fbe9a41b7a4f service cinder] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:41.677000 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73806edf-2a75-4180-b922-fbe9a41b7a4f service cinder] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:41.677000 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73806edf-2a75-4180-b922-fbe9a41b7a4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:41.686702 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73806edf-2a75-4180-b922-fbe9a41b7a4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:41.688287 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73806edf-2a75-4180-b922-fbe9a41b7a4f service cinder] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:41.698524 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1303/2606] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 18:05:41 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:05:41.771613 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fe2bab-b1c6-4574-81fe-4d9f7ac0c00d None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:41.773065 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-a3fe2bab-b1c6-4574-81fe-4d9f7ac0c00d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:05:41.785133 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fe2bab-b1c6-4574-81fe-4d9f7ac0c00d None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:41.788732 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b8ed46-6e52-44c1-b1c2-df8c6f1ec8d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de55cae1600841889668e36402861203', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:41.789372 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b8ed46-6e52-44c1-b1c2-df8c6f1ec8d4 service cinder] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:41.789712 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b8ed46-6e52-44c1-b1c2-df8c6f1ec8d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:41.789993 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b8ed46-6e52-44c1-b1c2-df8c6f1ec8d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:41.794305 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:05:41.861995 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b8ed46-6e52-44c1-b1c2-df8c6f1ec8d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:41.863476 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b8ed46-6e52-44c1-b1c2-df8c6f1ec8d4 service cinder] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:41.872866 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1304/2607] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 18:05:41 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:05:42.071072 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478511da-a11b-482e-8269-32d52d78606d None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:42.071665 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478511da-a11b-482e-8269-32d52d78606d None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:42.071665 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478511da-a11b-482e-8269-32d52d78606d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:42.089083 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-478511da-a11b-482e-8269-32d52d78606d None None] MFA Rules not processed for user `45542602225b452fa323f5499c1843ec`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:05:42.090326 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-478511da-a11b-482e-8269-32d52d78606d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:05:42.145165 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1304/2608] 10.222.0.67 () {58 vars in 967 bytes} [Thu Jul 14 18:05:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 18:05:42.157113 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b8ed46-6e52-44c1-b1c2-df8c6f1ec8d4 service cinder] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:42.224184 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b8ed46-6e52-44c1-b1c2-df8c6f1ec8d4 service cinder] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:42.229127 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a544d4-2c50-404d-91f5-3736ecfe1e72 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c65607a396474192a43c374d306ef5ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:42.229799 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a544d4-2c50-404d-91f5-3736ecfe1e72 service swift] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:42.230084 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a544d4-2c50-404d-91f5-3736ecfe1e72 service swift] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:42.230359 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a544d4-2c50-404d-91f5-3736ecfe1e72 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:42.239508 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a544d4-2c50-404d-91f5-3736ecfe1e72 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:42.241296 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a544d4-2c50-404d-91f5-3736ecfe1e72 service swift] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:42.249901 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1305/2609] 10.222.0.67 () {60 vars in 1384 bytes} [Thu Jul 14 18:05:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 18:05:42.446187 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d502ec4-1bae-4b76-93d2-d4045493e4a5 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:42.446480 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d502ec4-1bae-4b76-93d2-d4045493e4a5 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:42.446761 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d502ec4-1bae-4b76-93d2-d4045493e4a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:42.465006 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-9d502ec4-1bae-4b76-93d2-d4045493e4a5 None None] MFA Rules not processed for user `45542602225b452fa323f5499c1843ec`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:05:42.466229 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-9d502ec4-1bae-4b76-93d2-d4045493e4a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:05:42.473948 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1305/2610] 10.222.0.67 () {58 vars in 1009 bytes} [Thu Jul 14 18:05:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:05:42.485642 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a544d4-2c50-404d-91f5-3736ecfe1e72 service swift] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:42.496970 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a544d4-2c50-404d-91f5-3736ecfe1e72 service swift] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:42.501965 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f93eb31-bf3d-4f00-888e-72a352916ae0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c65607a396474192a43c374d306ef5ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:42.502626 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f93eb31-bf3d-4f00-888e-72a352916ae0 service swift] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:42.502908 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f93eb31-bf3d-4f00-888e-72a352916ae0 service swift] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:42.503183 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f93eb31-bf3d-4f00-888e-72a352916ae0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:42.511124 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f93eb31-bf3d-4f00-888e-72a352916ae0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:42.512692 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f93eb31-bf3d-4f00-888e-72a352916ae0 service swift] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:42.520903 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1306/2611] 10.222.0.67 () {60 vars in 1384 bytes} [Thu Jul 14 18:05:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 18:05:42.839055 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef3dbf-8c68-4213-ab55-32da10f000dd None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:42.839338 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef3dbf-8c68-4213-ab55-32da10f000dd None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:42.839611 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef3dbf-8c68-4213-ab55-32da10f000dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:42.857692 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-9eef3dbf-8c68-4213-ab55-32da10f000dd None None] MFA Rules not processed for user `45542602225b452fa323f5499c1843ec`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:05:42.858869 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-9eef3dbf-8c68-4213-ab55-32da10f000dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:05:42.866011 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1306/2612] 10.222.0.67 () {58 vars in 967 bytes} [Thu Jul 14 18:05:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:05:42.878448 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f93eb31-bf3d-4f00-888e-72a352916ae0 service swift] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:42.889037 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f93eb31-bf3d-4f00-888e-72a352916ae0 service swift] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:42.895501 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30115ea1-19d3-4326-bdfe-bb247ab31c18 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c65607a396474192a43c374d306ef5ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:42.896135 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30115ea1-19d3-4326-bdfe-bb247ab31c18 service swift] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:42.896414 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30115ea1-19d3-4326-bdfe-bb247ab31c18 service swift] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:42.896685 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30115ea1-19d3-4326-bdfe-bb247ab31c18 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:42.904823 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30115ea1-19d3-4326-bdfe-bb247ab31c18 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:42.906503 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30115ea1-19d3-4326-bdfe-bb247ab31c18 service swift] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:42.914991 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1307/2613] 10.222.0.67 () {60 vars in 1384 bytes} [Thu Jul 14 18:05:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 18:05:44.983283 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eef3dbf-8c68-4213-ab55-32da10f000dd None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:44.984711 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-9eef3dbf-8c68-4213-ab55-32da10f000dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:05:45.050708 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eef3dbf-8c68-4213-ab55-32da10f000dd None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:45.055447 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eb292d-b0af-4bdb-a87e-7cb6e262d090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:45.056378 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb292d-b0af-4bdb-a87e-7cb6e262d090 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:45.056667 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb292d-b0af-4bdb-a87e-7cb6e262d090 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:45.056946 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb292d-b0af-4bdb-a87e-7cb6e262d090 admin admin] PATH_INFO: `/v3/users/4598a718f88d4f0685817b145e5ffb58` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:45.058223 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eb292d-b0af-4bdb-a87e-7cb6e262d090 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4598a718f88d4f0685817b145e5ffb58)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:45.060197 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eb292d-b0af-4bdb-a87e-7cb6e262d090 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:45.089702 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:05:45.108957 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-c6eb292d-b0af-4bdb-a87e-7cb6e262d090 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4598a718f88d4f0685817b145e5ffb58'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:05:45.117253 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-c6eb292d-b0af-4bdb-a87e-7cb6e262d090 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4598a718f88d4f0685817b145e5ffb58'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:05:45.130840 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-c6eb292d-b0af-4bdb-a87e-7cb6e262d090 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4598a718f88d4f0685817b145e5ffb58'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:05:45.131538 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-c6eb292d-b0af-4bdb-a87e-7cb6e262d090 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4598a718f88d4f0685817b145e5ffb58'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:05:45.132237 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-c6eb292d-b0af-4bdb-a87e-7cb6e262d090 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4598a718f88d4f0685817b145e5ffb58'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:05:45.144642 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1307/2614] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 14 18:05:44 2022] DELETE /identity/v3/users/4598a718f88d4f0685817b145e5ffb58 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:05:45.150214 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f878e21-27c9-4d2a-ac11-fe50f857199a None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:45.150717 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f878e21-27c9-4d2a-ac11-fe50f857199a None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:45.150984 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f878e21-27c9-4d2a-ac11-fe50f857199a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:45.168456 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-7f878e21-27c9-4d2a-ac11-fe50f857199a None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:05:45.169710 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-7f878e21-27c9-4d2a-ac11-fe50f857199a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:05:45.228704 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1308/2615] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 18:05:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:05:45.239088 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eb292d-b0af-4bdb-a87e-7cb6e262d090 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:45.240523 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-c6eb292d-b0af-4bdb-a87e-7cb6e262d090 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:05:45.297436 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eb292d-b0af-4bdb-a87e-7cb6e262d090 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:45.301839 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca41e1a-27c5-4036-8ab7-1892a549aa05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:45.302482 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca41e1a-27c5-4036-8ab7-1892a549aa05 service neutron] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:45.302763 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca41e1a-27c5-4036-8ab7-1892a549aa05 service neutron] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:45.303036 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca41e1a-27c5-4036-8ab7-1892a549aa05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:45.311973 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca41e1a-27c5-4036-8ab7-1892a549aa05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:45.313547 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca41e1a-27c5-4036-8ab7-1892a549aa05 service neutron] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:45.323202 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1308/2616] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 18:05:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:05:45.492711 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f878e21-27c9-4d2a-ac11-fe50f857199a None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:45.494426 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-7f878e21-27c9-4d2a-ac11-fe50f857199a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:05:45.507337 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f878e21-27c9-4d2a-ac11-fe50f857199a None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:45.512252 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81415b86-9bdc-484c-89a4-3a6986550852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:45.513261 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81415b86-9bdc-484c-89a4-3a6986550852 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:45.513567 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81415b86-9bdc-484c-89a4-3a6986550852 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:45.513977 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81415b86-9bdc-484c-89a4-3a6986550852 admin admin] PATH_INFO: `/v3/projects/db88faff6e694df88ae1a0432d79493a` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:45.515172 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81415b86-9bdc-484c-89a4-3a6986550852 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db88faff6e694df88ae1a0432d79493a)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:45.517094 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81415b86-9bdc-484c-89a4-3a6986550852 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:45.520222 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:05:45.565178 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-81415b86-9bdc-484c-89a4-3a6986550852 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db88faff6e694df88ae1a0432d79493a', 'request_id': 'req-81415b86-9bdc-484c-89a4-3a6986550852'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:05:45.571033 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-81415b86-9bdc-484c-89a4-3a6986550852 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db88faff6e694df88ae1a0432d79493a', 'request_id': 'req-81415b86-9bdc-484c-89a4-3a6986550852'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:05:45.578668 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-81415b86-9bdc-484c-89a4-3a6986550852 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db88faff6e694df88ae1a0432d79493a', 'request_id': 'req-81415b86-9bdc-484c-89a4-3a6986550852'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:05:45.590831 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-81415b86-9bdc-484c-89a4-3a6986550852 admin admin] The token cache is being invalidate because project db88faff6e694df88ae1a0432d79493a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86772) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 18:05:45.591118 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-81415b86-9bdc-484c-89a4-3a6986550852 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:05:45.591770 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-81415b86-9bdc-484c-89a4-3a6986550852 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:05:45.593317 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1309/2617] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 14 18:05:45 2022] DELETE /identity/v3/projects/db88faff6e694df88ae1a0432d79493a => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:05:45.598858 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99bd0be-67fe-456d-96e9-9cb300725b55 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:45.599146 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99bd0be-67fe-456d-96e9-9cb300725b55 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:45.599428 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99bd0be-67fe-456d-96e9-9cb300725b55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:45.617142 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-a99bd0be-67fe-456d-96e9-9cb300725b55 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:05:45.618626 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-a99bd0be-67fe-456d-96e9-9cb300725b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:05:45.680112 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1309/2618] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 18:05:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 18:05:45.687847 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71370341-4eee-4162-a559-9e6c0b882d22 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:45.688141 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71370341-4eee-4162-a559-9e6c0b882d22 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:45.688692 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71370341-4eee-4162-a559-9e6c0b882d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:45.710347 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-71370341-4eee-4162-a559-9e6c0b882d22 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:05:45.711560 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-71370341-4eee-4162-a559-9e6c0b882d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:05:45.720009 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1310/2619] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 18:05:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:05:45.724096 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99bd0be-67fe-456d-96e9-9cb300725b55 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:45.734804 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99bd0be-67fe-456d-96e9-9cb300725b55 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:45.740081 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740cb5bf-7f52-486f-a503-1c31dffba182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:45.740837 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740cb5bf-7f52-486f-a503-1c31dffba182 admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:45.741196 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740cb5bf-7f52-486f-a503-1c31dffba182 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:45.741574 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740cb5bf-7f52-486f-a503-1c31dffba182 admin admin] PATH_INFO: `/v3/domains` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:45.742398 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740cb5bf-7f52-486f-a503-1c31dffba182 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:05:45.742774 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740cb5bf-7f52-486f-a503-1c31dffba182 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:45.745612 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740cb5bf-7f52-486f-a503-1c31dffba182 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:45.757939 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1310/2620] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 14 18:05:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:05:45.762149 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71370341-4eee-4162-a559-9e6c0b882d22 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:45.772679 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71370341-4eee-4162-a559-9e6c0b882d22 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:45.777434 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4a551b-3a98-469e-bd83-e17f457c0882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:45.778273 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4a551b-3a98-469e-bd83-e17f457c0882 admin admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:45.778621 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4a551b-3a98-469e-bd83-e17f457c0882 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:45.779023 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4a551b-3a98-469e-bd83-e17f457c0882 admin admin] PATH_INFO: `/v3/projects` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:45.779832 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4a551b-3a98-469e-bd83-e17f457c0882 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:45.781883 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4a551b-3a98-469e-bd83-e17f457c0882 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:45.809612 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1311/2621] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 14 18:05:45 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 18:05:45.813476 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740cb5bf-7f52-486f-a503-1c31dffba182 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:45.824397 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740cb5bf-7f52-486f-a503-1c31dffba182 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:45.860143 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:05:45.887302 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9901bb8c-741c-4ad5-a16b-1a97276e6584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:45.887983 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9901bb8c-741c-4ad5-a16b-1a97276e6584 admin admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:45.888267 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9901bb8c-741c-4ad5-a16b-1a97276e6584 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:45.888544 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9901bb8c-741c-4ad5-a16b-1a97276e6584 admin admin] PATH_INFO: `/v3/users` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:45.889230 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9901bb8c-741c-4ad5-a16b-1a97276e6584 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:45.891476 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9901bb8c-741c-4ad5-a16b-1a97276e6584 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:45.920760 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1311/2622] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 14 18:05:45 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 18:05:45.922080 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4a551b-3a98-469e-bd83-e17f457c0882 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:45.933713 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4a551b-3a98-469e-bd83-e17f457c0882 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:45.939494 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93785bb5-4f71-4a6a-a673-59b57957c723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:45.940312 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93785bb5-4f71-4a6a-a673-59b57957c723 admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:45.940582 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93785bb5-4f71-4a6a-a673-59b57957c723 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:45.941203 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93785bb5-4f71-4a6a-a673-59b57957c723 admin admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:45.941686 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93785bb5-4f71-4a6a-a673-59b57957c723 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:45.943282 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93785bb5-4f71-4a6a-a673-59b57957c723 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:45.957130 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1312/2623] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 18:05:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 18:05:45.958415 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9901bb8c-741c-4ad5-a16b-1a97276e6584 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:45.968746 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9901bb8c-741c-4ad5-a16b-1a97276e6584 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:45.974518 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea8f25a-e771-4359-84e4-f9bfca70be94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:45.975210 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea8f25a-e771-4359-84e4-f9bfca70be94 admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:45.975530 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea8f25a-e771-4359-84e4-f9bfca70be94 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:45.975841 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea8f25a-e771-4359-84e4-f9bfca70be94 admin admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:45.976707 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea8f25a-e771-4359-84e4-f9bfca70be94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:45.978258 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea8f25a-e771-4359-84e4-f9bfca70be94 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:45.995237 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1312/2624] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 18:05:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 18:05:45.997326 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93785bb5-4f71-4a6a-a673-59b57957c723 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:46.013542 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93785bb5-4f71-4a6a-a673-59b57957c723 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:46.019685 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a97bf8-c965-4f67-99e9-2c75e52d253d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:46.020673 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a97bf8-c965-4f67-99e9-2c75e52d253d admin admin] REQUEST_METHOD: `PUT` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:46.020957 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a97bf8-c965-4f67-99e9-2c75e52d253d admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:46.021365 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a97bf8-c965-4f67-99e9-2c75e52d253d admin admin] PATH_INFO: `/v3/projects/a3b728f5d30a44afb9f8cdd06bc78df6/users/81328923a1e74bae8a8fa862001fda62/roles/95d753870f97426cb1ce32e078621a4c` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:46.044777 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a97bf8-c965-4f67-99e9-2c75e52d253d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3b728f5d30a44afb9f8cdd06bc78df6, user_id=81328923a1e74bae8a8fa862001fda62, role_id=95d753870f97426cb1ce32e078621a4c)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:46.047960 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a97bf8-c965-4f67-99e9-2c75e52d253d admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:46.063541 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1313/2625] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 18:05:45 2022] PUT /identity/v3/projects/a3b728f5d30a44afb9f8cdd06bc78df6/users/81328923a1e74bae8a8fa862001fda62/roles/95d753870f97426cb1ce32e078621a4c => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:05:46.069235 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39afef04-4778-4193-b5f6-28228df4debd None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:46.069693 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39afef04-4778-4193-b5f6-28228df4debd None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:46.069977 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39afef04-4778-4193-b5f6-28228df4debd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:46.089309 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-39afef04-4778-4193-b5f6-28228df4debd None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:05:46.090568 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-39afef04-4778-4193-b5f6-28228df4debd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:05:46.156723 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1313/2626] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 18:05:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:05:46.167006 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a97bf8-c965-4f67-99e9-2c75e52d253d admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:46.168704 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-03a97bf8-c965-4f67-99e9-2c75e52d253d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:05:46.236556 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a97bf8-c965-4f67-99e9-2c75e52d253d admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:46.241735 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9ef337-1641-4438-a912-03a25140f531 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:46.242315 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9ef337-1641-4438-a912-03a25140f531 service neutron] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:46.242598 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9ef337-1641-4438-a912-03a25140f531 service neutron] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:46.242871 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9ef337-1641-4438-a912-03a25140f531 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:46.255936 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9ef337-1641-4438-a912-03a25140f531 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:46.257417 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9ef337-1641-4438-a912-03a25140f531 service neutron] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:46.267088 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1314/2627] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 18:05:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:05:48.812654 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39afef04-4778-4193-b5f6-28228df4debd None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:48.814272 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-39afef04-4778-4193-b5f6-28228df4debd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:05:48.830732 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39afef04-4778-4193-b5f6-28228df4debd None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:48.836244 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60a0c65-fa2e-44be-abfe-5ca9ad600831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:48.837142 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a0c65-fa2e-44be-abfe-5ca9ad600831 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:48.837422 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a0c65-fa2e-44be-abfe-5ca9ad600831 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:48.837729 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a0c65-fa2e-44be-abfe-5ca9ad600831 admin admin] PATH_INFO: `/v3/users/ead19f46598c45fe949cdf7e935bc4ba` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:48.838951 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60a0c65-fa2e-44be-abfe-5ca9ad600831 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ead19f46598c45fe949cdf7e935bc4ba)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:48.840946 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60a0c65-fa2e-44be-abfe-5ca9ad600831 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:48.918815 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-d60a0c65-fa2e-44be-abfe-5ca9ad600831 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ead19f46598c45fe949cdf7e935bc4ba'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:05:48.935430 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-d60a0c65-fa2e-44be-abfe-5ca9ad600831 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ead19f46598c45fe949cdf7e935bc4ba'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:05:48.954303 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-d60a0c65-fa2e-44be-abfe-5ca9ad600831 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ead19f46598c45fe949cdf7e935bc4ba'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:05:48.955212 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-d60a0c65-fa2e-44be-abfe-5ca9ad600831 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ead19f46598c45fe949cdf7e935bc4ba'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:05:48.957108 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-d60a0c65-fa2e-44be-abfe-5ca9ad600831 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ead19f46598c45fe949cdf7e935bc4ba'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:05:48.973683 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1314/2628] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 14 18:05:48 2022] DELETE /identity/v3/users/ead19f46598c45fe949cdf7e935bc4ba => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:05:48.978020 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd1d08-465b-4ce8-9443-13a2709ccaa6 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:48.978529 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd1d08-465b-4ce8-9443-13a2709ccaa6 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:48.978668 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd1d08-465b-4ce8-9443-13a2709ccaa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:49.005706 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-45fd1d08-465b-4ce8-9443-13a2709ccaa6 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:05:49.006949 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-45fd1d08-465b-4ce8-9443-13a2709ccaa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:05:49.039237 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:05:49.096067 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1315/2629] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 18:05:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:05:49.106680 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60a0c65-fa2e-44be-abfe-5ca9ad600831 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:49.108202 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-d60a0c65-fa2e-44be-abfe-5ca9ad600831 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:05:49.144952 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:05:49.188036 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60a0c65-fa2e-44be-abfe-5ca9ad600831 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:49.194220 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5790ebb-29ac-4b82-9ae2-9cf32a684fa7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:49.195231 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5790ebb-29ac-4b82-9ae2-9cf32a684fa7 service neutron] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:49.195697 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5790ebb-29ac-4b82-9ae2-9cf32a684fa7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:49.196100 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5790ebb-29ac-4b82-9ae2-9cf32a684fa7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:49.207362 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5790ebb-29ac-4b82-9ae2-9cf32a684fa7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:49.208990 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5790ebb-29ac-4b82-9ae2-9cf32a684fa7 service neutron] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:49.221125 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1315/2630] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 18:05:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 18:05:49.911518 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fd1d08-465b-4ce8-9443-13a2709ccaa6 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:49.913031 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-45fd1d08-465b-4ce8-9443-13a2709ccaa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:05:49.939911 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fd1d08-465b-4ce8-9443-13a2709ccaa6 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:49.945436 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89962740-c07b-43d1-b53b-4ce5b0450769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:49.946329 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89962740-c07b-43d1-b53b-4ce5b0450769 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:49.946615 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89962740-c07b-43d1-b53b-4ce5b0450769 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:49.946893 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89962740-c07b-43d1-b53b-4ce5b0450769 admin admin] PATH_INFO: `/v3/projects/4d1669a8d7dc4130ac0624401ca30f4a` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:49.948104 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89962740-c07b-43d1-b53b-4ce5b0450769 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d1669a8d7dc4130ac0624401ca30f4a)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:49.951202 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89962740-c07b-43d1-b53b-4ce5b0450769 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:50.008182 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-89962740-c07b-43d1-b53b-4ce5b0450769 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d1669a8d7dc4130ac0624401ca30f4a', 'request_id': 'req-89962740-c07b-43d1-b53b-4ce5b0450769'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:05:50.019208 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-89962740-c07b-43d1-b53b-4ce5b0450769 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d1669a8d7dc4130ac0624401ca30f4a', 'request_id': 'req-89962740-c07b-43d1-b53b-4ce5b0450769'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:05:50.031517 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-89962740-c07b-43d1-b53b-4ce5b0450769 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d1669a8d7dc4130ac0624401ca30f4a', 'request_id': 'req-89962740-c07b-43d1-b53b-4ce5b0450769'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:05:50.056702 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-89962740-c07b-43d1-b53b-4ce5b0450769 admin admin] The token cache is being invalidate because project 4d1669a8d7dc4130ac0624401ca30f4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86772) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 18:05:50.057144 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-89962740-c07b-43d1-b53b-4ce5b0450769 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:05:50.058053 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-89962740-c07b-43d1-b53b-4ce5b0450769 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:05:50.060339 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1316/2631] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 14 18:05:49 2022] DELETE /identity/v3/projects/4d1669a8d7dc4130ac0624401ca30f4a => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:05:50.065466 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5790ebb-29ac-4b82-9ae2-9cf32a684fa7 service neutron] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:50.075974 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5790ebb-29ac-4b82-9ae2-9cf32a684fa7 service neutron] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:50.137235 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871d77af-7198-403f-80d8-8a1b9de10c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:50.138656 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d77af-7198-403f-80d8-8a1b9de10c02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:50.139169 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d77af-7198-403f-80d8-8a1b9de10c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:50.139667 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d77af-7198-403f-80d8-8a1b9de10c02 admin admin] PATH_INFO: `/v3/users/b86b6dcaba4b42cd8aae32cfc9c77e8a` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:50.141799 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871d77af-7198-403f-80d8-8a1b9de10c02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b86b6dcaba4b42cd8aae32cfc9c77e8a)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:50.144819 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871d77af-7198-403f-80d8-8a1b9de10c02 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:50.207667 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-871d77af-7198-403f-80d8-8a1b9de10c02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b86b6dcaba4b42cd8aae32cfc9c77e8a'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:05:50.215902 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-871d77af-7198-403f-80d8-8a1b9de10c02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b86b6dcaba4b42cd8aae32cfc9c77e8a'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:05:50.233895 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-871d77af-7198-403f-80d8-8a1b9de10c02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b86b6dcaba4b42cd8aae32cfc9c77e8a'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:05:50.234647 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-871d77af-7198-403f-80d8-8a1b9de10c02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b86b6dcaba4b42cd8aae32cfc9c77e8a'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:05:50.235280 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-871d77af-7198-403f-80d8-8a1b9de10c02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b86b6dcaba4b42cd8aae32cfc9c77e8a'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:05:50.256598 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1316/2632] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 14 18:05:50 2022] DELETE /identity/v3/users/b86b6dcaba4b42cd8aae32cfc9c77e8a => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:05:50.577782 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9c70cc-9b4a-4bf5-a95e-d3b87b179df7 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:50.578356 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9c70cc-9b4a-4bf5-a95e-d3b87b179df7 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:50.578829 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9c70cc-9b4a-4bf5-a95e-d3b87b179df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:50.627173 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-ad9c70cc-9b4a-4bf5-a95e-d3b87b179df7 None None] MFA Rules not processed for user `81328923a1e74bae8a8fa862001fda62`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:05:50.628980 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-ad9c70cc-9b4a-4bf5-a95e-d3b87b179df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:05:50.656458 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871d77af-7198-403f-80d8-8a1b9de10c02 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:50.658867 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-871d77af-7198-403f-80d8-8a1b9de10c02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:05:50.739135 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1317/2633] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 18:05:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:05:50.741953 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:05:50.744001 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9c70cc-9b4a-4bf5-a95e-d3b87b179df7 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:50.745566 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-ad9c70cc-9b4a-4bf5-a95e-d3b87b179df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:05:50.765303 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871d77af-7198-403f-80d8-8a1b9de10c02 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:50.771242 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0d5ed1-0919-4797-bf29-4bf847106b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:50.772283 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d5ed1-0919-4797-bf29-4bf847106b69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:50.772656 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d5ed1-0919-4797-bf29-4bf847106b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:50.773047 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d5ed1-0919-4797-bf29-4bf847106b69 admin admin] PATH_INFO: `/v3/projects/b2f77f2b1bf74ea7be2e2b9b12a60ac8` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:50.774441 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0d5ed1-0919-4797-bf29-4bf847106b69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2f77f2b1bf74ea7be2e2b9b12a60ac8)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:50.776415 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0d5ed1-0919-4797-bf29-4bf847106b69 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:50.814543 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:05:50.838229 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-ee0d5ed1-0919-4797-bf29-4bf847106b69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2f77f2b1bf74ea7be2e2b9b12a60ac8', 'request_id': 'req-ee0d5ed1-0919-4797-bf29-4bf847106b69'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:05:50.840083 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9c70cc-9b4a-4bf5-a95e-d3b87b179df7 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:50.846096 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-ee0d5ed1-0919-4797-bf29-4bf847106b69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2f77f2b1bf74ea7be2e2b9b12a60ac8', 'request_id': 'req-ee0d5ed1-0919-4797-bf29-4bf847106b69'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:05:50.852422 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-ee0d5ed1-0919-4797-bf29-4bf847106b69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2f77f2b1bf74ea7be2e2b9b12a60ac8', 'request_id': 'req-ee0d5ed1-0919-4797-bf29-4bf847106b69'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:05:50.867313 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-ee0d5ed1-0919-4797-bf29-4bf847106b69 admin admin] The token cache is being invalidate because project b2f77f2b1bf74ea7be2e2b9b12a60ac8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86773) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 18:05:50.867843 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-ee0d5ed1-0919-4797-bf29-4bf847106b69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:05:50.868518 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-ee0d5ed1-0919-4797-bf29-4bf847106b69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:05:50.870093 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1317/2634] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 14 18:05:50 2022] DELETE /identity/v3/projects/b2f77f2b1bf74ea7be2e2b9b12a60ac8 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:05:50.874981 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a4dd6c-86cb-4ec5-beca-66bfae1a81a6 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:50.875274 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a4dd6c-86cb-4ec5-beca-66bfae1a81a6 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:50.875549 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a4dd6c-86cb-4ec5-beca-66bfae1a81a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:50.898509 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-48a4dd6c-86cb-4ec5-beca-66bfae1a81a6 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:05:50.899891 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-48a4dd6c-86cb-4ec5-beca-66bfae1a81a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:05:50.906370 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468f2159-eb60-461a-81b9-83de670e8b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:50.907048 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f2159-eb60-461a-81b9-83de670e8b85 admin admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:50.907338 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f2159-eb60-461a-81b9-83de670e8b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:50.907657 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f2159-eb60-461a-81b9-83de670e8b85 admin admin] PATH_INFO: `/v3/projects` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:50.908341 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468f2159-eb60-461a-81b9-83de670e8b85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:50.910905 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468f2159-eb60-461a-81b9-83de670e8b85 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:50.942664 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1318/2635] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 14 18:05:50 2022] POST /identity/v3/projects => generated 383 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 18:05:50.944149 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468f2159-eb60-461a-81b9-83de670e8b85 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:50.945903 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-468f2159-eb60-461a-81b9-83de670e8b85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:05:50.968383 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1318/2636] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 18:05:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:05:50.976118 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e796c76-36b2-4b06-9094-41921f59f1b8 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:50.976413 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e796c76-36b2-4b06-9094-41921f59f1b8 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:50.976689 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e796c76-36b2-4b06-9094-41921f59f1b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:50.996698 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-2e796c76-36b2-4b06-9094-41921f59f1b8 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:05:50.998048 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-2e796c76-36b2-4b06-9094-41921f59f1b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:05:51.017325 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468f2159-eb60-461a-81b9-83de670e8b85 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:51.023099 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb28ac8-339b-4162-85da-21c00b0c6319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:51.024009 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb28ac8-339b-4162-85da-21c00b0c6319 admin admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:51.024481 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb28ac8-339b-4162-85da-21c00b0c6319 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:51.024970 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb28ac8-339b-4162-85da-21c00b0c6319 admin admin] PATH_INFO: `/v3/users` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:51.025718 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb28ac8-339b-4162-85da-21c00b0c6319 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:51.027633 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb28ac8-339b-4162-85da-21c00b0c6319 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:51.050260 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1319/2637] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 14 18:05:50 2022] POST /identity/v3/users => generated 298 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 18:05:51.054352 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb28ac8-339b-4162-85da-21c00b0c6319 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:51.062868 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1319/2638] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 18:05:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 18:05:51.067335 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e796c76-36b2-4b06-9094-41921f59f1b8 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:51.068234 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb28ac8-339b-4162-85da-21c00b0c6319 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:51.073471 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c32a2e-065e-4894-8cdb-6065d8b35fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:51.074206 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c32a2e-065e-4894-8cdb-6065d8b35fb0 admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:51.074495 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c32a2e-065e-4894-8cdb-6065d8b35fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:51.074781 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c32a2e-065e-4894-8cdb-6065d8b35fb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:51.075679 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c32a2e-065e-4894-8cdb-6065d8b35fb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:51.077167 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e796c76-36b2-4b06-9094-41921f59f1b8 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:51.077300 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c32a2e-065e-4894-8cdb-6065d8b35fb0 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:51.082848 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e90644-aaa4-4ee5-b3b2-439a741855cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:51.083524 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e90644-aaa4-4ee5-b3b2-439a741855cf admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:51.083811 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e90644-aaa4-4ee5-b3b2-439a741855cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:51.084091 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e90644-aaa4-4ee5-b3b2-439a741855cf admin admin] PATH_INFO: `/v3/domains` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:51.084829 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e90644-aaa4-4ee5-b3b2-439a741855cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:05:51.085139 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e90644-aaa4-4ee5-b3b2-439a741855cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:51.086798 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e90644-aaa4-4ee5-b3b2-439a741855cf admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:51.088844 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1320/2639] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 18:05:51 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 18:05:51.093040 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c32a2e-065e-4894-8cdb-6065d8b35fb0 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:51.103717 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1320/2640] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 14 18:05:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 18:05:51.104499 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e90644-aaa4-4ee5-b3b2-439a741855cf admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:51.105078 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c32a2e-065e-4894-8cdb-6065d8b35fb0 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:51.110189 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b3ac20-ad65-4d52-8841-56b59954576f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:51.111096 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b3ac20-ad65-4d52-8841-56b59954576f admin admin] REQUEST_METHOD: `PUT` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:51.111376 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b3ac20-ad65-4d52-8841-56b59954576f admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:51.112304 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b3ac20-ad65-4d52-8841-56b59954576f admin admin] PATH_INFO: `/v3/projects/54b5df08f5554f6f902cdc38796da3ce/users/be8f86db415743beb1bedf3497fbc322/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:51.115477 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e90644-aaa4-4ee5-b3b2-439a741855cf admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:51.120467 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee246319-ca7c-492b-8653-407ee74e2b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:51.121143 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee246319-ca7c-492b-8653-407ee74e2b3b admin admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:51.121428 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee246319-ca7c-492b-8653-407ee74e2b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:51.121738 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee246319-ca7c-492b-8653-407ee74e2b3b admin admin] PATH_INFO: `/v3/projects` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:51.122443 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee246319-ca7c-492b-8653-407ee74e2b3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:51.124420 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee246319-ca7c-492b-8653-407ee74e2b3b admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:51.128041 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:05:51.130319 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b3ac20-ad65-4d52-8841-56b59954576f admin admin] RBAC: Authorizing `identity:create_grant(project_id=54b5df08f5554f6f902cdc38796da3ce, user_id=be8f86db415743beb1bedf3497fbc322, role_id=4651a1cc7b4d4ab7a7a9ca1e77e58e71)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:51.133503 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b3ac20-ad65-4d52-8841-56b59954576f admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:51.149835 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1321/2641] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 18:05:51 2022] PUT /identity/v3/projects/54b5df08f5554f6f902cdc38796da3ce/users/be8f86db415743beb1bedf3497fbc322/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:05:51.153995 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b3ac20-ad65-4d52-8841-56b59954576f admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:51.157562 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1321/2642] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 14 18:05:51 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 18:05:51.161136 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee246319-ca7c-492b-8653-407ee74e2b3b admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:51.200613 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:05:51.234224 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b3ac20-ad65-4d52-8841-56b59954576f admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:51.236021 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee246319-ca7c-492b-8653-407ee74e2b3b admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:51.239712 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc5bed2-e8c8-4e87-9ef1-858782a677e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:51.240533 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc5bed2-e8c8-4e87-9ef1-858782a677e6 admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:51.240904 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc5bed2-e8c8-4e87-9ef1-858782a677e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:51.241188 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc5bed2-e8c8-4e87-9ef1-858782a677e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:51.241445 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e6f7f-8b41-49cb-88d0-40f99b3eaa9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:51.241960 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc5bed2-e8c8-4e87-9ef1-858782a677e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:51.242152 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e6f7f-8b41-49cb-88d0-40f99b3eaa9e admin admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:51.242440 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e6f7f-8b41-49cb-88d0-40f99b3eaa9e admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:51.242981 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e6f7f-8b41-49cb-88d0-40f99b3eaa9e admin admin] PATH_INFO: `/v3/users` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:51.243710 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777e6f7f-8b41-49cb-88d0-40f99b3eaa9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:51.243884 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc5bed2-e8c8-4e87-9ef1-858782a677e6 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:51.245639 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777e6f7f-8b41-49cb-88d0-40f99b3eaa9e admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:51.255639 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1322/2643] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 18:05:51 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 18:05:51.259965 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc5bed2-e8c8-4e87-9ef1-858782a677e6 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:51.269562 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1322/2644] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 14 18:05:51 2022] POST /identity/v3/users => generated 292 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 18:05:51.273058 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e6f7f-8b41-49cb-88d0-40f99b3eaa9e admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:51.276041 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc5bed2-e8c8-4e87-9ef1-858782a677e6 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:51.280814 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f92c20-c20d-4498-9d14-d82a09df18ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:51.281750 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f92c20-c20d-4498-9d14-d82a09df18ed admin admin] REQUEST_METHOD: `PUT` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:51.282037 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f92c20-c20d-4498-9d14-d82a09df18ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:51.282317 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f92c20-c20d-4498-9d14-d82a09df18ed admin admin] PATH_INFO: `/v3/projects/54b5df08f5554f6f902cdc38796da3ce/users/be8f86db415743beb1bedf3497fbc322/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:51.283399 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e6f7f-8b41-49cb-88d0-40f99b3eaa9e admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:51.284879 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f92c20-c20d-4498-9d14-d82a09df18ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=54b5df08f5554f6f902cdc38796da3ce, user_id=be8f86db415743beb1bedf3497fbc322, role_id=4651a1cc7b4d4ab7a7a9ca1e77e58e71)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:51.287885 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f92c20-c20d-4498-9d14-d82a09df18ed admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:51.288916 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08b0a9b-69a2-421e-808c-43221f985efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:51.289704 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08b0a9b-69a2-421e-808c-43221f985efd admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:51.290062 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08b0a9b-69a2-421e-808c-43221f985efd admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:51.290396 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08b0a9b-69a2-421e-808c-43221f985efd admin admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:51.291409 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08b0a9b-69a2-421e-808c-43221f985efd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:51.292858 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08b0a9b-69a2-421e-808c-43221f985efd admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:51.301565 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1323/2645] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 18:05:51 2022] PUT /identity/v3/projects/54b5df08f5554f6f902cdc38796da3ce/users/be8f86db415743beb1bedf3497fbc322/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 18:05:51.304490 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1323/2646] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 18:05:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 18:05:51.308498 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f92c20-c20d-4498-9d14-d82a09df18ed admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:51.375761 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f92c20-c20d-4498-9d14-d82a09df18ed admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:51.380777 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2562b7-f8d8-45e8-8a75-53865cd92454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:51.381455 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2562b7-f8d8-45e8-8a75-53865cd92454 admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:51.381775 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2562b7-f8d8-45e8-8a75-53865cd92454 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:51.382063 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2562b7-f8d8-45e8-8a75-53865cd92454 admin admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:51.382804 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2562b7-f8d8-45e8-8a75-53865cd92454 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:51.384414 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2562b7-f8d8-45e8-8a75-53865cd92454 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:51.395554 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1324/2647] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 18:05:51 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 18:05:51.399680 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08b0a9b-69a2-421e-808c-43221f985efd admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:51.410249 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08b0a9b-69a2-421e-808c-43221f985efd admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:51.414942 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5936646-a2aa-4362-84f7-9bbdfc2586f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:51.415849 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5936646-a2aa-4362-84f7-9bbdfc2586f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:51.416134 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5936646-a2aa-4362-84f7-9bbdfc2586f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:51.416412 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5936646-a2aa-4362-84f7-9bbdfc2586f4 admin admin] PATH_INFO: `/v3/projects/cf27cc12caa34c90a3d9d9fbaafa7326/users/9700a01772234c80b58826f1bac92304/roles/95d753870f97426cb1ce32e078621a4c` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:51.433732 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5936646-a2aa-4362-84f7-9bbdfc2586f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf27cc12caa34c90a3d9d9fbaafa7326, user_id=9700a01772234c80b58826f1bac92304, role_id=95d753870f97426cb1ce32e078621a4c)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:51.436399 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5936646-a2aa-4362-84f7-9bbdfc2586f4 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:51.449949 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1324/2648] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 18:05:51 2022] PUT /identity/v3/projects/cf27cc12caa34c90a3d9d9fbaafa7326/users/9700a01772234c80b58826f1bac92304/roles/95d753870f97426cb1ce32e078621a4c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:05:51.462408 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa371077-698e-44c9-81e0-9b162c363b79 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:51.462673 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa371077-698e-44c9-81e0-9b162c363b79 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:51.463525 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa371077-698e-44c9-81e0-9b162c363b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:51.494567 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-aa371077-698e-44c9-81e0-9b162c363b79 None None] MFA Rules not processed for user `9700a01772234c80b58826f1bac92304`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:05:51.495807 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-aa371077-698e-44c9-81e0-9b162c363b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:05:51.575657 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1325/2649] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 18:05:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:05:51.581462 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5936646-a2aa-4362-84f7-9bbdfc2586f4 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:51.658090 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5936646-a2aa-4362-84f7-9bbdfc2586f4 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:51.663490 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f605a81f-3549-4539-b251-9f655121cdef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:51.664164 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f605a81f-3549-4539-b251-9f655121cdef admin admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:51.664454 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f605a81f-3549-4539-b251-9f655121cdef admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:51.664734 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f605a81f-3549-4539-b251-9f655121cdef admin admin] PATH_INFO: `/v3/projects` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:51.665508 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f605a81f-3549-4539-b251-9f655121cdef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:51.667605 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f605a81f-3549-4539-b251-9f655121cdef admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:51.710376 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1325/2650] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 14 18:05:51 2022] POST /identity/v3/projects => generated 383 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 18:05:51.711982 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa371077-698e-44c9-81e0-9b162c363b79 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:51.724911 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa371077-698e-44c9-81e0-9b162c363b79 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:51.802917 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:05:51.836795 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aed3748-971a-4971-9725-c4980c647f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:51.837498 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed3748-971a-4971-9725-c4980c647f3e admin admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:51.838049 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed3748-971a-4971-9725-c4980c647f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:51.838049 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed3748-971a-4971-9725-c4980c647f3e admin admin] PATH_INFO: `/v3/users` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:51.838749 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aed3748-971a-4971-9725-c4980c647f3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:51.840699 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aed3748-971a-4971-9725-c4980c647f3e admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:51.869753 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1326/2651] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 14 18:05:51 2022] POST /identity/v3/users => generated 298 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 18:05:51.871104 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f605a81f-3549-4539-b251-9f655121cdef admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:51.883148 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f605a81f-3549-4539-b251-9f655121cdef admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:51.889409 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deba023-6917-481a-80c3-e3a178d4498d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:51.889997 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deba023-6917-481a-80c3-e3a178d4498d admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:51.890116 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deba023-6917-481a-80c3-e3a178d4498d admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:51.890381 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deba023-6917-481a-80c3-e3a178d4498d admin admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:51.891255 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deba023-6917-481a-80c3-e3a178d4498d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:51.894448 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deba023-6917-481a-80c3-e3a178d4498d admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:51.915992 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1326/2652] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 18:05:51 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 18:05:51.916832 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aed3748-971a-4971-9725-c4980c647f3e admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:51.927449 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aed3748-971a-4971-9725-c4980c647f3e admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:51.933109 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc272508-7efd-4840-b24e-4703a584e009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:51.933737 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc272508-7efd-4840-b24e-4703a584e009 admin admin] REQUEST_METHOD: `PUT` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:51.934018 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc272508-7efd-4840-b24e-4703a584e009 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:51.934318 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc272508-7efd-4840-b24e-4703a584e009 admin admin] PATH_INFO: `/v3/projects/3cfedc42934c4257a10ec8f259ea503a/users/14e9f85c342a4261aa6845eda15685dc/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:51.977725 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc272508-7efd-4840-b24e-4703a584e009 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cfedc42934c4257a10ec8f259ea503a, user_id=14e9f85c342a4261aa6845eda15685dc, role_id=4651a1cc7b4d4ab7a7a9ca1e77e58e71)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:51.980484 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc272508-7efd-4840-b24e-4703a584e009 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:52.007578 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1327/2653] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 18:05:51 2022] PUT /identity/v3/projects/3cfedc42934c4257a10ec8f259ea503a/users/14e9f85c342a4261aa6845eda15685dc/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 18:05:52.011574 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deba023-6917-481a-80c3-e3a178d4498d admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:52.022932 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deba023-6917-481a-80c3-e3a178d4498d admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:52.040460 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:05:52.108260 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3184d7-8a53-4a20-924a-4ccea6bbc4a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:52.109824 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3184d7-8a53-4a20-924a-4ccea6bbc4a2 admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:52.110281 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3184d7-8a53-4a20-924a-4ccea6bbc4a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:52.110723 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3184d7-8a53-4a20-924a-4ccea6bbc4a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:52.112166 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3184d7-8a53-4a20-924a-4ccea6bbc4a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:52.114223 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3184d7-8a53-4a20-924a-4ccea6bbc4a2 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:52.128404 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1327/2654] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 18:05:52 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 18:05:52.135029 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc272508-7efd-4840-b24e-4703a584e009 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:52.148186 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc272508-7efd-4840-b24e-4703a584e009 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:52.154390 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3576b0b-d732-4f01-ab12-ce5c75829755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:52.155460 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3576b0b-d732-4f01-ab12-ce5c75829755 admin admin] REQUEST_METHOD: `PUT` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:52.155818 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3576b0b-d732-4f01-ab12-ce5c75829755 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:52.156171 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3576b0b-d732-4f01-ab12-ce5c75829755 admin admin] PATH_INFO: `/v3/projects/3cfedc42934c4257a10ec8f259ea503a/users/14e9f85c342a4261aa6845eda15685dc/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:52.159226 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3576b0b-d732-4f01-ab12-ce5c75829755 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cfedc42934c4257a10ec8f259ea503a, user_id=14e9f85c342a4261aa6845eda15685dc, role_id=4651a1cc7b4d4ab7a7a9ca1e77e58e71)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:52.162070 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3576b0b-d732-4f01-ab12-ce5c75829755 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:52.186411 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1328/2655] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 18:05:52 2022] PUT /identity/v3/projects/3cfedc42934c4257a10ec8f259ea503a/users/14e9f85c342a4261aa6845eda15685dc/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:05:52.187549 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0c3630-7307-49b4-89eb-e01f3cf2405a None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:52.187994 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0c3630-7307-49b4-89eb-e01f3cf2405a None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:52.188281 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0c3630-7307-49b4-89eb-e01f3cf2405a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:52.237238 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-5b0c3630-7307-49b4-89eb-e01f3cf2405a None None] MFA Rules not processed for user `14e9f85c342a4261aa6845eda15685dc`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:05:52.239135 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-5b0c3630-7307-49b4-89eb-e01f3cf2405a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:05:52.341447 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1328/2656] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 18:05:52 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:05:52.356788 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3576b0b-d732-4f01-ab12-ce5c75829755 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:52.358989 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-a3576b0b-d732-4f01-ab12-ce5c75829755 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:05:52.430077 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3576b0b-d732-4f01-ab12-ce5c75829755 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:52.438561 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4347105-819a-4f83-95c7-b91fe6be41c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de55cae1600841889668e36402861203', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:52.439240 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4347105-819a-4f83-95c7-b91fe6be41c8 service cinder] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:52.440061 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4347105-819a-4f83-95c7-b91fe6be41c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:52.440348 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4347105-819a-4f83-95c7-b91fe6be41c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:52.538692 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4347105-819a-4f83-95c7-b91fe6be41c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:52.540354 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4347105-819a-4f83-95c7-b91fe6be41c8 service cinder] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:52.552572 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1329/2657] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 18:05:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 18:05:55.933161 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f31809-5fdd-477c-9116-477b5cb849f0 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:55.933818 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f31809-5fdd-477c-9116-477b5cb849f0 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:55.933818 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f31809-5fdd-477c-9116-477b5cb849f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:55.969819 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-d4f31809-5fdd-477c-9116-477b5cb849f0 None None] MFA Rules not processed for user `be8f86db415743beb1bedf3497fbc322`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:05:55.972512 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-d4f31809-5fdd-477c-9116-477b5cb849f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:05:56.077116 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1329/2658] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 18:05:55 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:05:56.091848 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4347105-819a-4f83-95c7-b91fe6be41c8 service cinder] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:56.094943 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-a4347105-819a-4f83-95c7-b91fe6be41c8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:05:56.168657 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:05:56.176681 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4347105-819a-4f83-95c7-b91fe6be41c8 service cinder] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:56.184284 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adbf4ba-ddcc-4d9e-8ad4-668288dd8aa7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eb7180aab4541b4aab6cf8648eac1f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:56.185303 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adbf4ba-ddcc-4d9e-8ad4-668288dd8aa7 service glance] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:56.185722 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adbf4ba-ddcc-4d9e-8ad4-668288dd8aa7 service glance] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:56.186083 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adbf4ba-ddcc-4d9e-8ad4-668288dd8aa7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:56.191544 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-2adbf4ba-ddcc-4d9e-8ad4-668288dd8aa7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:05:56.260076 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adbf4ba-ddcc-4d9e-8ad4-668288dd8aa7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:56.261647 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adbf4ba-ddcc-4d9e-8ad4-668288dd8aa7 service glance] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:56.271560 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1330/2659] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 18:05:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:05:56.370790 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba042fbb-a824-4098-9a20-bc059a765177 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:56.371084 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba042fbb-a824-4098-9a20-bc059a765177 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:56.371517 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba042fbb-a824-4098-9a20-bc059a765177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:56.389817 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-ba042fbb-a824-4098-9a20-bc059a765177 None None] MFA Rules not processed for user `45542602225b452fa323f5499c1843ec`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:05:56.391035 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-ba042fbb-a824-4098-9a20-bc059a765177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:05:56.410110 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:05:56.466746 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1330/2660] 10.222.0.67 () {58 vars in 1009 bytes} [Thu Jul 14 18:05:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:05:56.479339 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adbf4ba-ddcc-4d9e-8ad4-668288dd8aa7 service glance] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:56.485159 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-2adbf4ba-ddcc-4d9e-8ad4-668288dd8aa7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:05:56.559119 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adbf4ba-ddcc-4d9e-8ad4-668288dd8aa7 service glance] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:56.565250 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d3d99a-33c0-4bc9-bb25-80588b770bf9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c65607a396474192a43c374d306ef5ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:56.565946 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d3d99a-33c0-4bc9-bb25-80588b770bf9 service swift] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:56.566228 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d3d99a-33c0-4bc9-bb25-80588b770bf9 service swift] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:56.566502 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d3d99a-33c0-4bc9-bb25-80588b770bf9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:56.575480 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d3d99a-33c0-4bc9-bb25-80588b770bf9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:56.577056 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d3d99a-33c0-4bc9-bb25-80588b770bf9 service swift] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:56.585978 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1331/2661] 10.222.0.67 () {60 vars in 1384 bytes} [Thu Jul 14 18:05:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 18:05:57.358044 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba042fbb-a824-4098-9a20-bc059a765177 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:05:57.370181 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba042fbb-a824-4098-9a20-bc059a765177 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:05:57.374177 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d119c7f1-77d5-4d8a-b1d3-82dc93da0cd7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de55cae1600841889668e36402861203', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:05:57.374852 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d119c7f1-77d5-4d8a-b1d3-82dc93da0cd7 service cinder] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:05:57.375140 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d119c7f1-77d5-4d8a-b1d3-82dc93da0cd7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:05:57.375421 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d119c7f1-77d5-4d8a-b1d3-82dc93da0cd7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:05:57.387334 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d119c7f1-77d5-4d8a-b1d3-82dc93da0cd7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:05:57.387890 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d119c7f1-77d5-4d8a-b1d3-82dc93da0cd7 service cinder] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:05:57.411240 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1331/2662] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 18:05:57 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:06:02.976401 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d3d99a-33c0-4bc9-bb25-80588b770bf9 service swift] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:06:03.103327 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d3d99a-33c0-4bc9-bb25-80588b770bf9 service swift] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:06:03.108017 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e78acd-703a-4a3a-abdc-bb9cdbc2963c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:06:03.108904 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e78acd-703a-4a3a-abdc-bb9cdbc2963c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:06:03.109327 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e78acd-703a-4a3a-abdc-bb9cdbc2963c admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:06:03.109653 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e78acd-703a-4a3a-abdc-bb9cdbc2963c admin admin] PATH_INFO: `/v3/users/9700a01772234c80b58826f1bac92304` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:06:03.111612 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e78acd-703a-4a3a-abdc-bb9cdbc2963c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9700a01772234c80b58826f1bac92304)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:06:03.116158 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e78acd-703a-4a3a-abdc-bb9cdbc2963c admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:06:03.172193 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:06:03.194892 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-13e78acd-703a-4a3a-abdc-bb9cdbc2963c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9700a01772234c80b58826f1bac92304'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:06:03.206063 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-13e78acd-703a-4a3a-abdc-bb9cdbc2963c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9700a01772234c80b58826f1bac92304'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:06:03.215799 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-13e78acd-703a-4a3a-abdc-bb9cdbc2963c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9700a01772234c80b58826f1bac92304'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:06:03.216860 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-13e78acd-703a-4a3a-abdc-bb9cdbc2963c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9700a01772234c80b58826f1bac92304'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:06:03.231201 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-13e78acd-703a-4a3a-abdc-bb9cdbc2963c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9700a01772234c80b58826f1bac92304'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:06:03.238630 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1332/2663] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 14 18:06:02 2022] DELETE /identity/v3/users/9700a01772234c80b58826f1bac92304 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:06:03.243067 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a4d94-a4ed-4177-a878-7e96eac73aeb None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:06:03.243532 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a4d94-a4ed-4177-a878-7e96eac73aeb None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:06:03.243727 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a4d94-a4ed-4177-a878-7e96eac73aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:06:03.270734 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-838a4d94-a4ed-4177-a878-7e96eac73aeb None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:06:03.273985 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-838a4d94-a4ed-4177-a878-7e96eac73aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:06:03.384780 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1332/2664] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 18:06:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:06:03.396129 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e78acd-703a-4a3a-abdc-bb9cdbc2963c admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:06:03.397774 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-13e78acd-703a-4a3a-abdc-bb9cdbc2963c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:06:03.538566 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e78acd-703a-4a3a-abdc-bb9cdbc2963c admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:06:03.543931 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8809fffe-a509-4927-98df-e67273a96cd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:06:03.545440 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8809fffe-a509-4927-98df-e67273a96cd2 service neutron] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:06:03.546006 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8809fffe-a509-4927-98df-e67273a96cd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:06:03.546512 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8809fffe-a509-4927-98df-e67273a96cd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:06:03.568210 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8809fffe-a509-4927-98df-e67273a96cd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:06:03.573268 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8809fffe-a509-4927-98df-e67273a96cd2 service neutron] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:06:03.591943 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1333/2665] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 18:06:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 18:06:04.003560 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838a4d94-a4ed-4177-a878-7e96eac73aeb None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:06:04.005422 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-838a4d94-a4ed-4177-a878-7e96eac73aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:06:04.032830 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838a4d94-a4ed-4177-a878-7e96eac73aeb None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:06:04.041955 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94d59b2-df40-4be0-a0ef-8f2ae45acb82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:06:04.042850 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d59b2-df40-4be0-a0ef-8f2ae45acb82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:06:04.043193 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d59b2-df40-4be0-a0ef-8f2ae45acb82 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:06:04.043475 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d59b2-df40-4be0-a0ef-8f2ae45acb82 admin admin] PATH_INFO: `/v3/projects/cf27cc12caa34c90a3d9d9fbaafa7326` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:06:04.044739 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94d59b2-df40-4be0-a0ef-8f2ae45acb82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf27cc12caa34c90a3d9d9fbaafa7326)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:06:04.047066 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94d59b2-df40-4be0-a0ef-8f2ae45acb82 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:06:04.124825 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-e94d59b2-df40-4be0-a0ef-8f2ae45acb82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf27cc12caa34c90a3d9d9fbaafa7326', 'request_id': 'req-e94d59b2-df40-4be0-a0ef-8f2ae45acb82'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:06:04.138397 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-e94d59b2-df40-4be0-a0ef-8f2ae45acb82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf27cc12caa34c90a3d9d9fbaafa7326', 'request_id': 'req-e94d59b2-df40-4be0-a0ef-8f2ae45acb82'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:06:04.149857 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-e94d59b2-df40-4be0-a0ef-8f2ae45acb82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf27cc12caa34c90a3d9d9fbaafa7326', 'request_id': 'req-e94d59b2-df40-4be0-a0ef-8f2ae45acb82'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:06:04.175458 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-e94d59b2-df40-4be0-a0ef-8f2ae45acb82 admin admin] The token cache is being invalidate because project cf27cc12caa34c90a3d9d9fbaafa7326 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86773) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 18:06:04.175458 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-e94d59b2-df40-4be0-a0ef-8f2ae45acb82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:06:04.175458 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-e94d59b2-df40-4be0-a0ef-8f2ae45acb82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:06:04.175458 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1333/2666] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 14 18:06:04 2022] DELETE /identity/v3/projects/cf27cc12caa34c90a3d9d9fbaafa7326 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:06:04.181702 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8809fffe-a509-4927-98df-e67273a96cd2 service neutron] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:06:04.194384 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8809fffe-a509-4927-98df-e67273a96cd2 service neutron] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:06:04.285910 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf9d23f-f8aa-4ec9-8ef7-30ee0580b255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:06:04.286720 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf9d23f-f8aa-4ec9-8ef7-30ee0580b255 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:06:04.287004 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf9d23f-f8aa-4ec9-8ef7-30ee0580b255 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:06:04.287279 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf9d23f-f8aa-4ec9-8ef7-30ee0580b255 admin admin] PATH_INFO: `/v3/users/14e9f85c342a4261aa6845eda15685dc` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:06:04.288560 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf9d23f-f8aa-4ec9-8ef7-30ee0580b255 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14e9f85c342a4261aa6845eda15685dc)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:06:04.290564 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf9d23f-f8aa-4ec9-8ef7-30ee0580b255 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:06:04.391994 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-abf9d23f-f8aa-4ec9-8ef7-30ee0580b255 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14e9f85c342a4261aa6845eda15685dc'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:06:04.414685 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-abf9d23f-f8aa-4ec9-8ef7-30ee0580b255 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14e9f85c342a4261aa6845eda15685dc'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:06:04.418453 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:06:04.435957 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-abf9d23f-f8aa-4ec9-8ef7-30ee0580b255 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14e9f85c342a4261aa6845eda15685dc'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:06:04.437061 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-abf9d23f-f8aa-4ec9-8ef7-30ee0580b255 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14e9f85c342a4261aa6845eda15685dc'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:06:04.454539 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-abf9d23f-f8aa-4ec9-8ef7-30ee0580b255 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14e9f85c342a4261aa6845eda15685dc'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:06:04.473572 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1334/2667] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 14 18:06:04 2022] DELETE /identity/v3/users/14e9f85c342a4261aa6845eda15685dc => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:06:04.885498 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94d59b2-df40-4be0-a0ef-8f2ae45acb82 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:06:04.889427 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-e94d59b2-df40-4be0-a0ef-8f2ae45acb82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:06:04.933295 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94d59b2-df40-4be0-a0ef-8f2ae45acb82 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:06:04.980410 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:06:05.034830 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6ba359-1c28-4088-aa79-bba681eccc3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:06:05.036281 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6ba359-1c28-4088-aa79-bba681eccc3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:06:05.036784 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6ba359-1c28-4088-aa79-bba681eccc3e admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:06:05.037874 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6ba359-1c28-4088-aa79-bba681eccc3e admin admin] PATH_INFO: `/v3/projects/3cfedc42934c4257a10ec8f259ea503a` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:06:05.040135 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6ba359-1c28-4088-aa79-bba681eccc3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cfedc42934c4257a10ec8f259ea503a)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:06:05.044813 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6ba359-1c28-4088-aa79-bba681eccc3e admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:06:05.147367 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-1e6ba359-1c28-4088-aa79-bba681eccc3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cfedc42934c4257a10ec8f259ea503a', 'request_id': 'req-1e6ba359-1c28-4088-aa79-bba681eccc3e'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:06:05.167881 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-1e6ba359-1c28-4088-aa79-bba681eccc3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cfedc42934c4257a10ec8f259ea503a', 'request_id': 'req-1e6ba359-1c28-4088-aa79-bba681eccc3e'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:06:05.178468 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-1e6ba359-1c28-4088-aa79-bba681eccc3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cfedc42934c4257a10ec8f259ea503a', 'request_id': 'req-1e6ba359-1c28-4088-aa79-bba681eccc3e'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:06:05.201167 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-1e6ba359-1c28-4088-aa79-bba681eccc3e admin admin] The token cache is being invalidate because project 3cfedc42934c4257a10ec8f259ea503a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86773) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 18:06:05.203422 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-1e6ba359-1c28-4088-aa79-bba681eccc3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:06:05.204518 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-1e6ba359-1c28-4088-aa79-bba681eccc3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:06:05.207970 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1334/2668] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 14 18:06:04 2022] DELETE /identity/v3/projects/3cfedc42934c4257a10ec8f259ea503a => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:06:05.218067 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b7ffe6-0806-459c-9012-64e1da279433 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:06:05.218630 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b7ffe6-0806-459c-9012-64e1da279433 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:06:05.219584 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b7ffe6-0806-459c-9012-64e1da279433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:06:05.278617 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-83b7ffe6-0806-459c-9012-64e1da279433 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:06:05.294813 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-83b7ffe6-0806-459c-9012-64e1da279433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:06:05.443304 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1335/2669] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 18:06:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 18:06:05.464789 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6570946a-deb8-4515-8300-f8cb422838b6 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:06:05.465295 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6570946a-deb8-4515-8300-f8cb422838b6 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:06:05.465828 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6570946a-deb8-4515-8300-f8cb422838b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:06:05.523426 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-6570946a-deb8-4515-8300-f8cb422838b6 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:06:05.528327 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-6570946a-deb8-4515-8300-f8cb422838b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:06:05.555798 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b7ffe6-0806-459c-9012-64e1da279433 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:06:05.564888 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1335/2670] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 18:06:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:06:05.577791 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b7ffe6-0806-459c-9012-64e1da279433 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:06:05.586155 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b658229c-9453-4970-ae7c-228d2d99d73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:06:05.587310 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b658229c-9453-4970-ae7c-228d2d99d73e admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:06:05.587804 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b658229c-9453-4970-ae7c-228d2d99d73e admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:06:05.588297 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b658229c-9453-4970-ae7c-228d2d99d73e admin admin] PATH_INFO: `/v3/domains` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:06:05.592063 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b658229c-9453-4970-ae7c-228d2d99d73e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:06:05.592498 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b658229c-9453-4970-ae7c-228d2d99d73e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:06:05.595328 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b658229c-9453-4970-ae7c-228d2d99d73e admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:06:05.620366 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1336/2671] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 14 18:06:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:06:05.626952 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6570946a-deb8-4515-8300-f8cb422838b6 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:06:05.643576 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6570946a-deb8-4515-8300-f8cb422838b6 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:06:05.649700 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb89a2c-fcec-4666-a6ab-51924c31a5f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:06:05.650384 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb89a2c-fcec-4666-a6ab-51924c31a5f3 admin admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:06:05.650718 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb89a2c-fcec-4666-a6ab-51924c31a5f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:06:05.651000 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb89a2c-fcec-4666-a6ab-51924c31a5f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:06:05.651783 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb89a2c-fcec-4666-a6ab-51924c31a5f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:06:05.653806 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb89a2c-fcec-4666-a6ab-51924c31a5f3 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:06:05.697748 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1336/2672] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 14 18:06:05 2022] POST /identity/v3/projects => generated 385 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 18:06:05.699386 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b658229c-9453-4970-ae7c-228d2d99d73e admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:06:05.719520 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b658229c-9453-4970-ae7c-228d2d99d73e admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:06:05.941281 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42812a9-619c-4f6a-aa08-aa5df7b2d939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:06:05.942144 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42812a9-619c-4f6a-aa08-aa5df7b2d939 admin admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:06:05.942433 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42812a9-619c-4f6a-aa08-aa5df7b2d939 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:06:05.942712 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42812a9-619c-4f6a-aa08-aa5df7b2d939 admin admin] PATH_INFO: `/v3/users` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:06:05.943414 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42812a9-619c-4f6a-aa08-aa5df7b2d939 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:06:05.945488 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42812a9-619c-4f6a-aa08-aa5df7b2d939 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:06:05.992050 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1337/2673] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 14 18:06:05 2022] POST /identity/v3/users => generated 293 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 18:06:05.996478 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb89a2c-fcec-4666-a6ab-51924c31a5f3 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:06:06.010110 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb89a2c-fcec-4666-a6ab-51924c31a5f3 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:06:06.019060 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb36824-b016-412b-b9f6-85f74582dfef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:06:06.019770 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb36824-b016-412b-b9f6-85f74582dfef admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:06:06.020064 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb36824-b016-412b-b9f6-85f74582dfef admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:06:06.020343 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb36824-b016-412b-b9f6-85f74582dfef admin admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:06:06.021094 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb36824-b016-412b-b9f6-85f74582dfef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:06:06.025701 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb36824-b016-412b-b9f6-85f74582dfef admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:06:06.054584 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1337/2674] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 18:06:05 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 18:06:06.060365 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42812a9-619c-4f6a-aa08-aa5df7b2d939 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:06:06.075564 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42812a9-619c-4f6a-aa08-aa5df7b2d939 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:06:06.083433 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd41d5e-450a-4f18-ab81-7e743dac6948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:06:06.084133 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd41d5e-450a-4f18-ab81-7e743dac6948 admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:06:06.084421 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd41d5e-450a-4f18-ab81-7e743dac6948 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:06:06.084703 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd41d5e-450a-4f18-ab81-7e743dac6948 admin admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:06:06.085447 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd41d5e-450a-4f18-ab81-7e743dac6948 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:06:06.087149 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd41d5e-450a-4f18-ab81-7e743dac6948 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:06:06.100764 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1338/2675] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 18:06:06 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 18:06:06.104792 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb36824-b016-412b-b9f6-85f74582dfef admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:06:06.120063 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb36824-b016-412b-b9f6-85f74582dfef admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:06:06.126556 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2032a97c-8c46-448c-803c-c3211e7c20a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:06:06.129245 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2032a97c-8c46-448c-803c-c3211e7c20a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:06:06.129245 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2032a97c-8c46-448c-803c-c3211e7c20a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:06:06.129245 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2032a97c-8c46-448c-803c-c3211e7c20a5 admin admin] PATH_INFO: `/v3/projects/cdecb51884414363891cfe8ae236b7a5/users/176f2812a76a4a738972afb06f56efae/roles/95d753870f97426cb1ce32e078621a4c` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:06:06.146558 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2032a97c-8c46-448c-803c-c3211e7c20a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdecb51884414363891cfe8ae236b7a5, user_id=176f2812a76a4a738972afb06f56efae, role_id=95d753870f97426cb1ce32e078621a4c)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:06:06.150563 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2032a97c-8c46-448c-803c-c3211e7c20a5 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:06:06.168001 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1338/2676] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 18:06:06 2022] PUT /identity/v3/projects/cdecb51884414363891cfe8ae236b7a5/users/176f2812a76a4a738972afb06f56efae/roles/95d753870f97426cb1ce32e078621a4c => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 18:06:06.180946 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50797566-1a86-45e2-94a2-69088ebab96c None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:06:06.181276 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50797566-1a86-45e2-94a2-69088ebab96c None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:06:06.188684 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50797566-1a86-45e2-94a2-69088ebab96c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:06:06.219141 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-50797566-1a86-45e2-94a2-69088ebab96c None None] MFA Rules not processed for user `176f2812a76a4a738972afb06f56efae`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:06:06.220242 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-50797566-1a86-45e2-94a2-69088ebab96c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:06:06.247436 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:06:06.295781 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1339/2677] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 18:06:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:06:06.309682 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2032a97c-8c46-448c-803c-c3211e7c20a5 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:06:06.311546 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-2032a97c-8c46-448c-803c-c3211e7c20a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:06:06.396724 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2032a97c-8c46-448c-803c-c3211e7c20a5 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:06:06.400766 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88f4070-1266-4d0f-883c-e99644ba954f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de55cae1600841889668e36402861203', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:06:06.401424 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f4070-1266-4d0f-883c-e99644ba954f service cinder] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:06:06.401776 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f4070-1266-4d0f-883c-e99644ba954f service cinder] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:06:06.402060 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f4070-1266-4d0f-883c-e99644ba954f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:06:06.412265 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88f4070-1266-4d0f-883c-e99644ba954f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:06:06.415376 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88f4070-1266-4d0f-883c-e99644ba954f service cinder] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:06:06.426808 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1339/2678] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 18:06:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:06:07.807800 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b85dae5-da84-4955-b51a-b21857970145 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:06:07.808312 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b85dae5-da84-4955-b51a-b21857970145 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:06:07.808312 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b85dae5-da84-4955-b51a-b21857970145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:06:07.826092 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-3b85dae5-da84-4955-b51a-b21857970145 None None] MFA Rules not processed for user `81328923a1e74bae8a8fa862001fda62`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:06:07.827306 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-3b85dae5-da84-4955-b51a-b21857970145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:06:07.882867 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1340/2679] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 18:06:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:06:10.682306 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f24cba7-d0cd-4be9-ba71-5b2d438bee95 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:06:10.682865 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f24cba7-d0cd-4be9-ba71-5b2d438bee95 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:06:10.682954 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f24cba7-d0cd-4be9-ba71-5b2d438bee95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:06:10.691961 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:06:10.710912 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-3f24cba7-d0cd-4be9-ba71-5b2d438bee95 None None] MFA Rules not processed for user `45542602225b452fa323f5499c1843ec`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:06:10.712348 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-3f24cba7-d0cd-4be9-ba71-5b2d438bee95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:06:10.782393 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1340/2680] 10.222.0.67 () {58 vars in 1009 bytes} [Thu Jul 14 18:06:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:06:10.796203 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b85dae5-da84-4955-b51a-b21857970145 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:06:10.798320 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-3b85dae5-da84-4955-b51a-b21857970145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:06:10.895092 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b85dae5-da84-4955-b51a-b21857970145 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:06:10.904668 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362cdb4d-8cfb-41fa-a42d-bec7a6f02cde service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c65607a396474192a43c374d306ef5ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:06:10.905343 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362cdb4d-8cfb-41fa-a42d-bec7a6f02cde service swift] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:06:10.905687 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362cdb4d-8cfb-41fa-a42d-bec7a6f02cde service swift] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:06:10.905970 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362cdb4d-8cfb-41fa-a42d-bec7a6f02cde service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:06:10.915554 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362cdb4d-8cfb-41fa-a42d-bec7a6f02cde service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:06:10.917142 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362cdb4d-8cfb-41fa-a42d-bec7a6f02cde service swift] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:06:10.926647 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1341/2681] 10.222.0.67 () {60 vars in 1384 bytes} [Thu Jul 14 18:06:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 18:06:12.205190 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f24cba7-d0cd-4be9-ba71-5b2d438bee95 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:06:12.318373 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f24cba7-d0cd-4be9-ba71-5b2d438bee95 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:06:12.332580 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96467272-6fc9-43b7-a837-e8e6759ccc79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:06:12.334226 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96467272-6fc9-43b7-a837-e8e6759ccc79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:06:12.335664 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96467272-6fc9-43b7-a837-e8e6759ccc79 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:06:12.335935 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96467272-6fc9-43b7-a837-e8e6759ccc79 admin admin] PATH_INFO: `/v3/users/176f2812a76a4a738972afb06f56efae` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:06:12.339387 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96467272-6fc9-43b7-a837-e8e6759ccc79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=176f2812a76a4a738972afb06f56efae)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:06:12.346001 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96467272-6fc9-43b7-a837-e8e6759ccc79 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:06:12.440415 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-96467272-6fc9-43b7-a837-e8e6759ccc79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '176f2812a76a4a738972afb06f56efae'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:06:12.449440 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-96467272-6fc9-43b7-a837-e8e6759ccc79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '176f2812a76a4a738972afb06f56efae'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:06:12.467502 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-96467272-6fc9-43b7-a837-e8e6759ccc79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '176f2812a76a4a738972afb06f56efae'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:06:12.470317 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-96467272-6fc9-43b7-a837-e8e6759ccc79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '176f2812a76a4a738972afb06f56efae'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:06:12.473557 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-96467272-6fc9-43b7-a837-e8e6759ccc79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '176f2812a76a4a738972afb06f56efae'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:06:12.492181 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1341/2682] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 14 18:06:12 2022] DELETE /identity/v3/users/176f2812a76a4a738972afb06f56efae => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:06:12.495446 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29deb3bb-2d78-45fd-a0ab-31464244a45e None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:06:12.495936 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29deb3bb-2d78-45fd-a0ab-31464244a45e None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:06:12.496987 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29deb3bb-2d78-45fd-a0ab-31464244a45e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:06:12.525382 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-29deb3bb-2d78-45fd-a0ab-31464244a45e None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:06:12.527270 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-29deb3bb-2d78-45fd-a0ab-31464244a45e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:06:12.618610 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1342/2683] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 18:06:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:06:12.656752 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96467272-6fc9-43b7-a837-e8e6759ccc79 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:06:12.658259 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-96467272-6fc9-43b7-a837-e8e6759ccc79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:06:12.708263 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:06:12.770273 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96467272-6fc9-43b7-a837-e8e6759ccc79 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:06:12.775795 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c93642-4efb-4c67-b94f-7ac0f1cb07dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:06:12.776542 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c93642-4efb-4c67-b94f-7ac0f1cb07dc service neutron] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:06:12.776887 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c93642-4efb-4c67-b94f-7ac0f1cb07dc service neutron] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:06:12.777163 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c93642-4efb-4c67-b94f-7ac0f1cb07dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:06:12.801014 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c93642-4efb-4c67-b94f-7ac0f1cb07dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:06:12.802689 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c93642-4efb-4c67-b94f-7ac0f1cb07dc service neutron] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:06:12.835820 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1342/2684] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 18:06:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:06:13.467677 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29deb3bb-2d78-45fd-a0ab-31464244a45e None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:06:13.469511 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-29deb3bb-2d78-45fd-a0ab-31464244a45e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:06:13.478261 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:06:13.497419 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29deb3bb-2d78-45fd-a0ab-31464244a45e None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:06:13.512081 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224f82f3-54bb-476e-bb69-0ba1dff1aa61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:06:13.513213 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224f82f3-54bb-476e-bb69-0ba1dff1aa61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:06:13.513495 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224f82f3-54bb-476e-bb69-0ba1dff1aa61 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:06:13.513922 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224f82f3-54bb-476e-bb69-0ba1dff1aa61 admin admin] PATH_INFO: `/v3/projects/cdecb51884414363891cfe8ae236b7a5` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:06:13.516101 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224f82f3-54bb-476e-bb69-0ba1dff1aa61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdecb51884414363891cfe8ae236b7a5)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:06:13.520407 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224f82f3-54bb-476e-bb69-0ba1dff1aa61 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:06:13.612073 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-224f82f3-54bb-476e-bb69-0ba1dff1aa61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdecb51884414363891cfe8ae236b7a5', 'request_id': 'req-224f82f3-54bb-476e-bb69-0ba1dff1aa61'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:06:13.620947 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-224f82f3-54bb-476e-bb69-0ba1dff1aa61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdecb51884414363891cfe8ae236b7a5', 'request_id': 'req-224f82f3-54bb-476e-bb69-0ba1dff1aa61'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:06:13.638746 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-224f82f3-54bb-476e-bb69-0ba1dff1aa61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdecb51884414363891cfe8ae236b7a5', 'request_id': 'req-224f82f3-54bb-476e-bb69-0ba1dff1aa61'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:06:13.662111 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-224f82f3-54bb-476e-bb69-0ba1dff1aa61 admin admin] The token cache is being invalidate because project cdecb51884414363891cfe8ae236b7a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86772) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 18:06:13.662405 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-224f82f3-54bb-476e-bb69-0ba1dff1aa61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:06:13.663641 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-224f82f3-54bb-476e-bb69-0ba1dff1aa61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:06:13.668658 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1343/2685] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 14 18:06:13 2022] DELETE /identity/v3/projects/cdecb51884414363891cfe8ae236b7a5 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 18:06:13.670715 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac3256e-bbd7-49e7-904b-a873098345e4 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:06:13.671847 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac3256e-bbd7-49e7-904b-a873098345e4 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:06:13.672361 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac3256e-bbd7-49e7-904b-a873098345e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:06:13.696530 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-5ac3256e-bbd7-49e7-904b-a873098345e4 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:06:13.697871 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-5ac3256e-bbd7-49e7-904b-a873098345e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:06:13.789489 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1343/2686] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 18:06:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:06:13.793440 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f98d1-9928-446f-aca9-6539f46d9f40 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:06:13.794264 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f98d1-9928-446f-aca9-6539f46d9f40 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:06:13.794739 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f98d1-9928-446f-aca9-6539f46d9f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:06:13.818929 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-7e9f98d1-9928-446f-aca9-6539f46d9f40 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:06:13.820161 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-7e9f98d1-9928-446f-aca9-6539f46d9f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:06:13.831817 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1344/2687] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 18:06:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:06:13.833689 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac3256e-bbd7-49e7-904b-a873098345e4 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:06:13.847453 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac3256e-bbd7-49e7-904b-a873098345e4 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:06:13.852378 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08992dd6-36c8-4fc4-8c8f-2d7eb2b4a70c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:06:13.853043 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08992dd6-36c8-4fc4-8c8f-2d7eb2b4a70c admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:06:13.853347 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08992dd6-36c8-4fc4-8c8f-2d7eb2b4a70c admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:06:13.853790 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08992dd6-36c8-4fc4-8c8f-2d7eb2b4a70c admin admin] PATH_INFO: `/v3/domains` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:06:13.854641 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08992dd6-36c8-4fc4-8c8f-2d7eb2b4a70c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:06:13.855065 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08992dd6-36c8-4fc4-8c8f-2d7eb2b4a70c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:06:13.857194 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08992dd6-36c8-4fc4-8c8f-2d7eb2b4a70c admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:06:13.874998 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1344/2688] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 14 18:06:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:06:13.876491 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9f98d1-9928-446f-aca9-6539f46d9f40 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:06:13.888927 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9f98d1-9928-446f-aca9-6539f46d9f40 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:06:13.903777 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d23483-1f96-4fb2-9b18-02a432b2feac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:06:13.904509 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d23483-1f96-4fb2-9b18-02a432b2feac admin admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:06:13.904795 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d23483-1f96-4fb2-9b18-02a432b2feac admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:06:13.905075 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d23483-1f96-4fb2-9b18-02a432b2feac admin admin] PATH_INFO: `/v3/projects` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:06:13.909773 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d23483-1f96-4fb2-9b18-02a432b2feac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:06:13.911853 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d23483-1f96-4fb2-9b18-02a432b2feac admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:06:13.945785 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1345/2689] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 14 18:06:13 2022] POST /identity/v3/projects => generated 377 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 18:06:13.950278 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08992dd6-36c8-4fc4-8c8f-2d7eb2b4a70c admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:06:13.970359 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08992dd6-36c8-4fc4-8c8f-2d7eb2b4a70c admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:06:14.034568 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15261ef-fa41-4802-aa9c-68dda22b71fa None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:06:14.035246 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15261ef-fa41-4802-aa9c-68dda22b71fa None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:06:14.035533 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15261ef-fa41-4802-aa9c-68dda22b71fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:06:14.054607 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-b15261ef-fa41-4802-aa9c-68dda22b71fa None None] MFA Rules not processed for user `17180b44ab2440f6ae13e674234ae1c4`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:06:14.055739 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-b15261ef-fa41-4802-aa9c-68dda22b71fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:06:14.072433 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276624ec-4847-4bb8-9a35-20d5b92d95db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:06:14.073121 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276624ec-4847-4bb8-9a35-20d5b92d95db admin admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:06:14.073408 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276624ec-4847-4bb8-9a35-20d5b92d95db admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:06:14.073740 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276624ec-4847-4bb8-9a35-20d5b92d95db admin admin] PATH_INFO: `/v3/users` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:06:14.074424 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276624ec-4847-4bb8-9a35-20d5b92d95db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:06:14.076362 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276624ec-4847-4bb8-9a35-20d5b92d95db admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:06:14.117144 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1345/2690] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 14 18:06:13 2022] POST /identity/v3/users => generated 289 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 18:06:14.118594 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276624ec-4847-4bb8-9a35-20d5b92d95db admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:06:14.132055 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276624ec-4847-4bb8-9a35-20d5b92d95db admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:06:14.140220 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1346/2691] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 18:06:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:06:14.143032 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947e767d-6661-4524-bb2d-16bd366021b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:06:14.144326 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e767d-6661-4524-bb2d-16bd366021b4 admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:06:14.144851 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e767d-6661-4524-bb2d-16bd366021b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:06:14.145641 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e767d-6661-4524-bb2d-16bd366021b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:06:14.146673 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947e767d-6661-4524-bb2d-16bd366021b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:06:14.148693 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947e767d-6661-4524-bb2d-16bd366021b4 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:06:14.165926 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1346/2692] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 18:06:14 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 18:06:14.167608 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15261ef-fa41-4802-aa9c-68dda22b71fa None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:06:14.195556 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15261ef-fa41-4802-aa9c-68dda22b71fa None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:06:14.217075 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9167d2fe-f204-4fd2-9417-44ecef6eb225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:06:14.218871 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167d2fe-f204-4fd2-9417-44ecef6eb225 admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:06:14.219326 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167d2fe-f204-4fd2-9417-44ecef6eb225 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:06:14.219696 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167d2fe-f204-4fd2-9417-44ecef6eb225 admin admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:06:14.221050 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9167d2fe-f204-4fd2-9417-44ecef6eb225 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:06:14.223507 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9167d2fe-f204-4fd2-9417-44ecef6eb225 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:06:14.251142 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1347/2693] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 18:06:14 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 18:06:14.257382 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947e767d-6661-4524-bb2d-16bd366021b4 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:06:14.269675 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947e767d-6661-4524-bb2d-16bd366021b4 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:06:14.278445 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1fe385-c8a9-4a99-af37-991cf34e7319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:06:14.279523 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1fe385-c8a9-4a99-af37-991cf34e7319 admin admin] REQUEST_METHOD: `PUT` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:06:14.279912 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1fe385-c8a9-4a99-af37-991cf34e7319 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:06:14.280859 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1fe385-c8a9-4a99-af37-991cf34e7319 admin admin] PATH_INFO: `/v3/projects/060dd3c7fb2c4cf8886c86a33776b660/users/f1263170b3bf41c7911314c3bc564f23/roles/95d753870f97426cb1ce32e078621a4c` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:06:14.315258 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1fe385-c8a9-4a99-af37-991cf34e7319 admin admin] RBAC: Authorizing `identity:create_grant(project_id=060dd3c7fb2c4cf8886c86a33776b660, user_id=f1263170b3bf41c7911314c3bc564f23, role_id=95d753870f97426cb1ce32e078621a4c)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:06:14.318937 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1fe385-c8a9-4a99-af37-991cf34e7319 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:06:14.355365 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1347/2694] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 18:06:14 2022] PUT /identity/v3/projects/060dd3c7fb2c4cf8886c86a33776b660/users/f1263170b3bf41c7911314c3bc564f23/roles/95d753870f97426cb1ce32e078621a4c => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 18:06:14.369036 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33666e9-55c0-41cc-bbdc-8b8a23ee61d4 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:06:14.369036 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33666e9-55c0-41cc-bbdc-8b8a23ee61d4 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:06:14.369371 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33666e9-55c0-41cc-bbdc-8b8a23ee61d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:06:14.423866 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-f33666e9-55c0-41cc-bbdc-8b8a23ee61d4 None None] MFA Rules not processed for user `f1263170b3bf41c7911314c3bc564f23`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:06:14.433728 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-f33666e9-55c0-41cc-bbdc-8b8a23ee61d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:06:14.507030 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:06:14.557686 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1348/2695] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 18:06:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:06:14.576735 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1fe385-c8a9-4a99-af37-991cf34e7319 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:06:14.579270 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-4b1fe385-c8a9-4a99-af37-991cf34e7319 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:06:14.599345 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:06:14.680236 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1fe385-c8a9-4a99-af37-991cf34e7319 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:06:14.684109 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac146fca-f016-457b-8b17-3c101eb3a18d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de55cae1600841889668e36402861203', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:06:14.684788 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac146fca-f016-457b-8b17-3c101eb3a18d service cinder] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:06:14.685074 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac146fca-f016-457b-8b17-3c101eb3a18d service cinder] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:06:14.685354 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac146fca-f016-457b-8b17-3c101eb3a18d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:06:14.697454 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac146fca-f016-457b-8b17-3c101eb3a18d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:06:14.698989 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac146fca-f016-457b-8b17-3c101eb3a18d service cinder] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:06:14.709588 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1348/2696] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 18:06:14 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:06:21.482728 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33666e9-55c0-41cc-bbdc-8b8a23ee61d4 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:06:21.484044 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-f33666e9-55c0-41cc-bbdc-8b8a23ee61d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:06:21.561339 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33666e9-55c0-41cc-bbdc-8b8a23ee61d4 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:06:21.564938 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42e8733-e0e2-41ce-a88d-10ac08123a32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:06:21.565622 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e8733-e0e2-41ce-a88d-10ac08123a32 service neutron] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:06:21.565907 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e8733-e0e2-41ce-a88d-10ac08123a32 service neutron] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:06:21.566183 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e8733-e0e2-41ce-a88d-10ac08123a32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:06:21.568403 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-e42e8733-e0e2-41ce-a88d-10ac08123a32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:06:21.579342 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42e8733-e0e2-41ce-a88d-10ac08123a32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:06:21.580794 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42e8733-e0e2-41ce-a88d-10ac08123a32 service neutron] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:06:21.590310 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1349/2697] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 18:06:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:06:24.704908 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=20 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:06:28.516982 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac146fca-f016-457b-8b17-3c101eb3a18d service cinder] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:06:28.579456 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac146fca-f016-457b-8b17-3c101eb3a18d service cinder] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:06:28.583965 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e12773-58b4-4e49-8bfc-a863846e01c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:06:28.584834 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e12773-58b4-4e49-8bfc-a863846e01c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:06:28.585114 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e12773-58b4-4e49-8bfc-a863846e01c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:06:28.585393 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e12773-58b4-4e49-8bfc-a863846e01c9 admin admin] PATH_INFO: `/v3/users/f1263170b3bf41c7911314c3bc564f23` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:06:28.586608 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e12773-58b4-4e49-8bfc-a863846e01c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1263170b3bf41c7911314c3bc564f23)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:06:28.588510 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e12773-58b4-4e49-8bfc-a863846e01c9 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:06:28.639508 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-57e12773-58b4-4e49-8bfc-a863846e01c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1263170b3bf41c7911314c3bc564f23'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:06:28.648482 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-57e12773-58b4-4e49-8bfc-a863846e01c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1263170b3bf41c7911314c3bc564f23'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:06:28.661089 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-57e12773-58b4-4e49-8bfc-a863846e01c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1263170b3bf41c7911314c3bc564f23'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:06:28.661824 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-57e12773-58b4-4e49-8bfc-a863846e01c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1263170b3bf41c7911314c3bc564f23'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:06:28.662442 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-57e12773-58b4-4e49-8bfc-a863846e01c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1263170b3bf41c7911314c3bc564f23'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:06:28.674588 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1349/2698] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 14 18:06:28 2022] DELETE /identity/v3/users/f1263170b3bf41c7911314c3bc564f23 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:06:28.679172 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c125c8-010c-4ab9-bf3b-425c1f23939a None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:06:28.679691 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c125c8-010c-4ab9-bf3b-425c1f23939a None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:06:28.679809 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c125c8-010c-4ab9-bf3b-425c1f23939a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:06:28.697656 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-91c125c8-010c-4ab9-bf3b-425c1f23939a None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:06:28.698850 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-91c125c8-010c-4ab9-bf3b-425c1f23939a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:06:28.759726 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1350/2699] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 18:06:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:06:28.769474 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e12773-58b4-4e49-8bfc-a863846e01c9 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:06:28.771103 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-57e12773-58b4-4e49-8bfc-a863846e01c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:06:28.835435 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e12773-58b4-4e49-8bfc-a863846e01c9 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:06:28.839381 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e0a703-5659-4acc-a539-54393299ee1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:06:28.840057 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e0a703-5659-4acc-a539-54393299ee1e service neutron] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:06:28.840383 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e0a703-5659-4acc-a539-54393299ee1e service neutron] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:06:28.840695 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e0a703-5659-4acc-a539-54393299ee1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:06:28.850877 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e0a703-5659-4acc-a539-54393299ee1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:06:28.852373 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e0a703-5659-4acc-a539-54393299ee1e service neutron] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:06:28.864291 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1350/2700] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 18:06:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:06:29.537324 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c125c8-010c-4ab9-bf3b-425c1f23939a None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:06:29.538879 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-91c125c8-010c-4ab9-bf3b-425c1f23939a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:06:29.553655 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c125c8-010c-4ab9-bf3b-425c1f23939a None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:06:29.567573 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcf251f-a09a-408d-a9a8-25272dbc16da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:06:29.568468 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcf251f-a09a-408d-a9a8-25272dbc16da admin admin] REQUEST_METHOD: `DELETE` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:06:29.568719 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcf251f-a09a-408d-a9a8-25272dbc16da admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:06:29.569027 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcf251f-a09a-408d-a9a8-25272dbc16da admin admin] PATH_INFO: `/v3/projects/060dd3c7fb2c4cf8886c86a33776b660` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:06:29.570489 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcf251f-a09a-408d-a9a8-25272dbc16da admin admin] RBAC: Authorizing `identity:delete_project(project_id=060dd3c7fb2c4cf8886c86a33776b660)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:06:29.572517 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcf251f-a09a-408d-a9a8-25272dbc16da admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:06:29.621686 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-5bcf251f-a09a-408d-a9a8-25272dbc16da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '060dd3c7fb2c4cf8886c86a33776b660', 'request_id': 'req-5bcf251f-a09a-408d-a9a8-25272dbc16da'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:06:29.627456 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-5bcf251f-a09a-408d-a9a8-25272dbc16da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '060dd3c7fb2c4cf8886c86a33776b660', 'request_id': 'req-5bcf251f-a09a-408d-a9a8-25272dbc16da'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:06:29.634687 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-5bcf251f-a09a-408d-a9a8-25272dbc16da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '060dd3c7fb2c4cf8886c86a33776b660', 'request_id': 'req-5bcf251f-a09a-408d-a9a8-25272dbc16da'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:06:29.647043 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-5bcf251f-a09a-408d-a9a8-25272dbc16da admin admin] The token cache is being invalidate because project 060dd3c7fb2c4cf8886c86a33776b660 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86772) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 18:06:29.647335 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-5bcf251f-a09a-408d-a9a8-25272dbc16da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:06:29.648029 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-5bcf251f-a09a-408d-a9a8-25272dbc16da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:06:29.649781 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1351/2701] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 14 18:06:29 2022] DELETE /identity/v3/projects/060dd3c7fb2c4cf8886c86a33776b660 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:06:29.654932 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09300bba-6d81-4251-b482-cbce3f4d1c5c None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:06:29.655961 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09300bba-6d81-4251-b482-cbce3f4d1c5c None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:06:29.656180 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09300bba-6d81-4251-b482-cbce3f4d1c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:06:29.674035 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-09300bba-6d81-4251-b482-cbce3f4d1c5c None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:06:29.675287 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-09300bba-6d81-4251-b482-cbce3f4d1c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:06:29.697280 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:06:29.744393 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1351/2702] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 18:06:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:06:29.751926 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b272b63e-435d-4123-94af-f3f73e9135cb None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:06:29.752425 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b272b63e-435d-4123-94af-f3f73e9135cb None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:06:29.752525 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b272b63e-435d-4123-94af-f3f73e9135cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:06:29.766045 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:06:29.771806 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-b272b63e-435d-4123-94af-f3f73e9135cb None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:06:29.773829 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-b272b63e-435d-4123-94af-f3f73e9135cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:06:29.782845 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1352/2703] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 18:06:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:06:29.787220 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09300bba-6d81-4251-b482-cbce3f4d1c5c None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:06:29.798218 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09300bba-6d81-4251-b482-cbce3f4d1c5c None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:06:29.802841 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52637c6-37df-47af-9044-3d90d94c210a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:06:29.803508 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52637c6-37df-47af-9044-3d90d94c210a admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:06:29.803794 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52637c6-37df-47af-9044-3d90d94c210a admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:06:29.804073 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52637c6-37df-47af-9044-3d90d94c210a admin admin] PATH_INFO: `/v3/domains` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:06:29.804816 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52637c6-37df-47af-9044-3d90d94c210a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:06:29.805116 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52637c6-37df-47af-9044-3d90d94c210a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:06:29.806776 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52637c6-37df-47af-9044-3d90d94c210a admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:06:29.819071 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1352/2704] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 14 18:06:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 18:06:29.823400 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b272b63e-435d-4123-94af-f3f73e9135cb None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:06:29.833368 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b272b63e-435d-4123-94af-f3f73e9135cb None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:06:29.838510 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f7e605-3d9a-4021-a65d-f5b9186e69f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:06:29.839168 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f7e605-3d9a-4021-a65d-f5b9186e69f8 admin admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:06:29.839446 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f7e605-3d9a-4021-a65d-f5b9186e69f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:06:29.839902 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f7e605-3d9a-4021-a65d-f5b9186e69f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:06:29.840597 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f7e605-3d9a-4021-a65d-f5b9186e69f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:06:29.842600 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f7e605-3d9a-4021-a65d-f5b9186e69f8 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:06:29.871101 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1353/2705] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 14 18:06:29 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 18:06:29.875894 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52637c6-37df-47af-9044-3d90d94c210a admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:06:29.887200 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52637c6-37df-47af-9044-3d90d94c210a admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:06:29.956612 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04860d9b-3d56-48f4-8044-810b32457f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:06:29.957359 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04860d9b-3d56-48f4-8044-810b32457f5b admin admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:06:29.958053 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04860d9b-3d56-48f4-8044-810b32457f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:06:29.958179 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04860d9b-3d56-48f4-8044-810b32457f5b admin admin] PATH_INFO: `/v3/users` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:06:29.958778 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04860d9b-3d56-48f4-8044-810b32457f5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:06:29.960726 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04860d9b-3d56-48f4-8044-810b32457f5b admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:06:29.986554 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1353/2706] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 14 18:06:29 2022] POST /identity/v3/users => generated 293 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 18:06:29.992082 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f7e605-3d9a-4021-a65d-f5b9186e69f8 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:06:30.004364 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f7e605-3d9a-4021-a65d-f5b9186e69f8 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:06:30.010023 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e082087c-617f-472e-92af-ae4682d3db31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:06:30.010939 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e082087c-617f-472e-92af-ae4682d3db31 admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:06:30.011486 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e082087c-617f-472e-92af-ae4682d3db31 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:06:30.011924 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e082087c-617f-472e-92af-ae4682d3db31 admin admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:06:30.012931 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e082087c-617f-472e-92af-ae4682d3db31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:06:30.016280 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e082087c-617f-472e-92af-ae4682d3db31 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:06:30.028225 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1354/2707] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 18:06:29 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 18:06:30.032305 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04860d9b-3d56-48f4-8044-810b32457f5b admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:06:30.042419 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04860d9b-3d56-48f4-8044-810b32457f5b admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:06:30.047644 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ef758b-88e8-4cfd-bf17-0f153d3120c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:06:30.048323 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef758b-88e8-4cfd-bf17-0f153d3120c4 admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:06:30.048611 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef758b-88e8-4cfd-bf17-0f153d3120c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:06:30.048890 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef758b-88e8-4cfd-bf17-0f153d3120c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:06:30.049671 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ef758b-88e8-4cfd-bf17-0f153d3120c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:06:30.051271 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ef758b-88e8-4cfd-bf17-0f153d3120c4 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:06:30.062397 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1354/2708] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 18:06:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 18:06:30.066489 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e082087c-617f-472e-92af-ae4682d3db31 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:06:30.076887 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e082087c-617f-472e-92af-ae4682d3db31 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:06:30.082548 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f40360e-7be1-442d-a994-0f22de491a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:06:30.083571 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f40360e-7be1-442d-a994-0f22de491a82 admin admin] REQUEST_METHOD: `PUT` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:06:30.083859 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f40360e-7be1-442d-a994-0f22de491a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:06:30.084135 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f40360e-7be1-442d-a994-0f22de491a82 admin admin] PATH_INFO: `/v3/projects/5abf3ce84a8d4e969cd29285ba9b00e5/users/8bcbf688c8b44a84b215553d8f4654be/roles/95d753870f97426cb1ce32e078621a4c` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:06:30.099377 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f40360e-7be1-442d-a994-0f22de491a82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5abf3ce84a8d4e969cd29285ba9b00e5, user_id=8bcbf688c8b44a84b215553d8f4654be, role_id=95d753870f97426cb1ce32e078621a4c)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:06:30.102137 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f40360e-7be1-442d-a994-0f22de491a82 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:06:30.116255 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1355/2709] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 18:06:30 2022] PUT /identity/v3/projects/5abf3ce84a8d4e969cd29285ba9b00e5/users/8bcbf688c8b44a84b215553d8f4654be/roles/95d753870f97426cb1ce32e078621a4c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:06:30.127116 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8207d6d4-388a-4f47-bef3-f0c14171c81c None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:06:30.127400 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8207d6d4-388a-4f47-bef3-f0c14171c81c None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:06:30.127699 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8207d6d4-388a-4f47-bef3-f0c14171c81c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:06:30.155994 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-8207d6d4-388a-4f47-bef3-f0c14171c81c None None] MFA Rules not processed for user `8bcbf688c8b44a84b215553d8f4654be`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:06:30.157275 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-8207d6d4-388a-4f47-bef3-f0c14171c81c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:06:30.223176 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1355/2710] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 18:06:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:06:30.227501 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f40360e-7be1-442d-a994-0f22de491a82 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:06:30.287803 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f40360e-7be1-442d-a994-0f22de491a82 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:06:30.292564 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a1a831-d614-4769-9a53-2da10171332c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:06:30.293226 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a1a831-d614-4769-9a53-2da10171332c admin admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:06:30.293726 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a1a831-d614-4769-9a53-2da10171332c admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:06:30.293851 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a1a831-d614-4769-9a53-2da10171332c admin admin] PATH_INFO: `/v3/projects` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:06:30.294591 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a1a831-d614-4769-9a53-2da10171332c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:06:30.296937 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a1a831-d614-4769-9a53-2da10171332c admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:06:30.323403 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1356/2711] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 14 18:06:30 2022] POST /identity/v3/projects => generated 383 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 18:06:30.327305 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8207d6d4-388a-4f47-bef3-f0c14171c81c None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:06:30.338098 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8207d6d4-388a-4f47-bef3-f0c14171c81c None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:06:30.350603 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:06:30.431540 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f592ff9-1839-477d-971c-b27e86486b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:06:30.432236 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f592ff9-1839-477d-971c-b27e86486b16 admin admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:06:30.432718 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f592ff9-1839-477d-971c-b27e86486b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:06:30.433011 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f592ff9-1839-477d-971c-b27e86486b16 admin admin] PATH_INFO: `/v3/users` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:06:30.433749 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f592ff9-1839-477d-971c-b27e86486b16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:06:30.435653 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f592ff9-1839-477d-971c-b27e86486b16 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:06:30.468272 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1356/2712] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 14 18:06:30 2022] POST /identity/v3/users => generated 292 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 18:06:30.471990 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a1a831-d614-4769-9a53-2da10171332c admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:06:30.482442 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a1a831-d614-4769-9a53-2da10171332c admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:06:30.488789 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a7e33b-2196-437b-9317-8cb7b8a01340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:06:30.489351 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a7e33b-2196-437b-9317-8cb7b8a01340 admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:06:30.489672 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a7e33b-2196-437b-9317-8cb7b8a01340 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:06:30.489951 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a7e33b-2196-437b-9317-8cb7b8a01340 admin admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:06:30.490691 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a7e33b-2196-437b-9317-8cb7b8a01340 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:06:30.492287 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a7e33b-2196-437b-9317-8cb7b8a01340 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:06:30.507603 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1357/2713] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 18:06:30 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 18:06:30.511200 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f592ff9-1839-477d-971c-b27e86486b16 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:06:30.522716 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f592ff9-1839-477d-971c-b27e86486b16 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:06:30.527547 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d955ab-178f-459a-b88d-3d8130230e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:06:30.528215 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d955ab-178f-459a-b88d-3d8130230e27 admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:06:30.528497 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d955ab-178f-459a-b88d-3d8130230e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:06:30.528773 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d955ab-178f-459a-b88d-3d8130230e27 admin admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:06:30.529494 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d955ab-178f-459a-b88d-3d8130230e27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:06:30.531557 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d955ab-178f-459a-b88d-3d8130230e27 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:06:30.541919 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1357/2714] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 18:06:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 18:06:30.546850 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a7e33b-2196-437b-9317-8cb7b8a01340 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:06:30.557936 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a7e33b-2196-437b-9317-8cb7b8a01340 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:06:30.571101 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46223a34-a676-4ffc-9a90-0f46723455d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:06:30.572182 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46223a34-a676-4ffc-9a90-0f46723455d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:06:30.572439 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46223a34-a676-4ffc-9a90-0f46723455d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:06:30.572748 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46223a34-a676-4ffc-9a90-0f46723455d7 admin admin] PATH_INFO: `/v3/projects/5d9f648a0548404baa2532f4e5734027/users/ff5500e2e72c4ac994ec72be2f64c9a7/roles/95d753870f97426cb1ce32e078621a4c` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:06:30.590135 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46223a34-a676-4ffc-9a90-0f46723455d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d9f648a0548404baa2532f4e5734027, user_id=ff5500e2e72c4ac994ec72be2f64c9a7, role_id=95d753870f97426cb1ce32e078621a4c)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:06:30.593304 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46223a34-a676-4ffc-9a90-0f46723455d7 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:06:30.607024 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1358/2715] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 18:06:30 2022] PUT /identity/v3/projects/5d9f648a0548404baa2532f4e5734027/users/ff5500e2e72c4ac994ec72be2f64c9a7/roles/95d753870f97426cb1ce32e078621a4c => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:06:30.619236 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6337c367-0f20-4cc0-b608-06a4ff78f588 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:06:30.619533 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6337c367-0f20-4cc0-b608-06a4ff78f588 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:06:30.619817 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6337c367-0f20-4cc0-b608-06a4ff78f588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:06:30.645914 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-6337c367-0f20-4cc0-b608-06a4ff78f588 None None] MFA Rules not processed for user `ff5500e2e72c4ac994ec72be2f64c9a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:06:30.647128 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-6337c367-0f20-4cc0-b608-06a4ff78f588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:06:30.709909 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1358/2716] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 18:06:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:06:30.714559 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46223a34-a676-4ffc-9a90-0f46723455d7 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:06:30.766600 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:06:30.777211 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46223a34-a676-4ffc-9a90-0f46723455d7 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:06:30.782473 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4677d073-8f5f-4506-90ce-f9290d2bc699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:06:30.783128 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4677d073-8f5f-4506-90ce-f9290d2bc699 admin admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:06:30.783409 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4677d073-8f5f-4506-90ce-f9290d2bc699 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:06:30.783684 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4677d073-8f5f-4506-90ce-f9290d2bc699 admin admin] PATH_INFO: `/v3/projects` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:06:30.784373 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4677d073-8f5f-4506-90ce-f9290d2bc699 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:06:30.786302 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4677d073-8f5f-4506-90ce-f9290d2bc699 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:06:30.811845 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1359/2717] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 14 18:06:30 2022] POST /identity/v3/projects => generated 385 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 18:06:30.816054 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6337c367-0f20-4cc0-b608-06a4ff78f588 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:06:30.826859 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6337c367-0f20-4cc0-b608-06a4ff78f588 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:06:30.884303 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efa0d83-e498-4808-8243-c20f8accb252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:06:30.884961 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa0d83-e498-4808-8243-c20f8accb252 admin admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:06:30.885245 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa0d83-e498-4808-8243-c20f8accb252 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:06:30.885522 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa0d83-e498-4808-8243-c20f8accb252 admin admin] PATH_INFO: `/v3/users` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:06:30.886229 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efa0d83-e498-4808-8243-c20f8accb252 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:06:30.888148 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efa0d83-e498-4808-8243-c20f8accb252 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:06:30.908470 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1359/2718] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 14 18:06:30 2022] POST /identity/v3/users => generated 299 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 18:06:30.912509 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4677d073-8f5f-4506-90ce-f9290d2bc699 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:06:30.923366 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4677d073-8f5f-4506-90ce-f9290d2bc699 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:06:30.928294 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f470b6-906e-4d41-8419-7cdd067c4642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:06:30.928960 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f470b6-906e-4d41-8419-7cdd067c4642 admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:06:30.929240 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f470b6-906e-4d41-8419-7cdd067c4642 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:06:30.929512 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f470b6-906e-4d41-8419-7cdd067c4642 admin admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:06:30.930274 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f470b6-906e-4d41-8419-7cdd067c4642 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:06:30.931935 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f470b6-906e-4d41-8419-7cdd067c4642 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:06:30.942734 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1360/2719] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 18:06:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 18:06:30.946937 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efa0d83-e498-4808-8243-c20f8accb252 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:06:30.956701 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efa0d83-e498-4808-8243-c20f8accb252 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:06:30.961227 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89920eff-d153-40c3-91db-d06756d881da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:06:30.962140 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89920eff-d153-40c3-91db-d06756d881da admin admin] REQUEST_METHOD: `PUT` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:06:30.962425 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89920eff-d153-40c3-91db-d06756d881da admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:06:30.962687 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89920eff-d153-40c3-91db-d06756d881da admin admin] PATH_INFO: `/v3/projects/c38107e149354c218865eebc74857055/users/6eeca5d0a6cf4aab8578e04e243d093d/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:06:30.974810 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:06:30.978105 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89920eff-d153-40c3-91db-d06756d881da admin admin] RBAC: Authorizing `identity:create_grant(project_id=c38107e149354c218865eebc74857055, user_id=6eeca5d0a6cf4aab8578e04e243d093d, role_id=4651a1cc7b4d4ab7a7a9ca1e77e58e71)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:06:30.981430 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89920eff-d153-40c3-91db-d06756d881da admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:06:30.994969 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1360/2720] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 18:06:30 2022] PUT /identity/v3/projects/c38107e149354c218865eebc74857055/users/6eeca5d0a6cf4aab8578e04e243d093d/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:06:30.999022 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f470b6-906e-4d41-8419-7cdd067c4642 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:06:31.008789 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f470b6-906e-4d41-8419-7cdd067c4642 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:06:31.063722 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38762b92-73c9-48d5-a027-e0331accffa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:06:31.064309 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38762b92-73c9-48d5-a027-e0331accffa5 admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:06:31.064587 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38762b92-73c9-48d5-a027-e0331accffa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:06:31.064857 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38762b92-73c9-48d5-a027-e0331accffa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:06:31.065604 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38762b92-73c9-48d5-a027-e0331accffa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:06:31.067233 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38762b92-73c9-48d5-a027-e0331accffa5 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:06:31.076884 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1361/2721] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 18:06:30 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 18:06:31.081659 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89920eff-d153-40c3-91db-d06756d881da admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:06:31.091756 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89920eff-d153-40c3-91db-d06756d881da admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:06:31.096840 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b321a8e-f946-4778-94ba-26f51fac7052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:06:31.097740 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b321a8e-f946-4778-94ba-26f51fac7052 admin admin] REQUEST_METHOD: `PUT` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:06:31.098019 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b321a8e-f946-4778-94ba-26f51fac7052 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:06:31.098290 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b321a8e-f946-4778-94ba-26f51fac7052 admin admin] PATH_INFO: `/v3/projects/c38107e149354c218865eebc74857055/users/6eeca5d0a6cf4aab8578e04e243d093d/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:06:31.100241 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b321a8e-f946-4778-94ba-26f51fac7052 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c38107e149354c218865eebc74857055, user_id=6eeca5d0a6cf4aab8578e04e243d093d, role_id=4651a1cc7b4d4ab7a7a9ca1e77e58e71)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:06:31.102899 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b321a8e-f946-4778-94ba-26f51fac7052 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:06:31.113357 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1361/2722] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 18:06:31 2022] PUT /identity/v3/projects/c38107e149354c218865eebc74857055/users/6eeca5d0a6cf4aab8578e04e243d093d/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:06:31.123417 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d44d4-853c-4169-9ab7-9ac1a19b43f6 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:06:31.123701 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d44d4-853c-4169-9ab7-9ac1a19b43f6 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:06:31.124000 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d44d4-853c-4169-9ab7-9ac1a19b43f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:06:31.152341 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-070d44d4-853c-4169-9ab7-9ac1a19b43f6 None None] MFA Rules not processed for user `6eeca5d0a6cf4aab8578e04e243d093d`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:06:31.153594 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-070d44d4-853c-4169-9ab7-9ac1a19b43f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:06:31.223445 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1362/2723] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 18:06:31 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:06:31.234956 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b321a8e-f946-4778-94ba-26f51fac7052 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:06:31.236648 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-0b321a8e-f946-4778-94ba-26f51fac7052 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:06:31.293748 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b321a8e-f946-4778-94ba-26f51fac7052 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:06:31.297326 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c567b84-24cf-4ea4-9a45-3009152d9c65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de55cae1600841889668e36402861203', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:06:31.297991 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c567b84-24cf-4ea4-9a45-3009152d9c65 service cinder] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:06:31.298272 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c567b84-24cf-4ea4-9a45-3009152d9c65 service cinder] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:06:31.298545 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c567b84-24cf-4ea4-9a45-3009152d9c65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:06:31.353895 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c567b84-24cf-4ea4-9a45-3009152d9c65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:06:31.355263 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c567b84-24cf-4ea4-9a45-3009152d9c65 service cinder] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:06:31.364318 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1362/2724] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 18:06:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:06:32.868759 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070d44d4-853c-4169-9ab7-9ac1a19b43f6 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:06:32.870415 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-070d44d4-853c-4169-9ab7-9ac1a19b43f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:06:32.883117 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070d44d4-853c-4169-9ab7-9ac1a19b43f6 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:06:32.887054 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed400f6-33db-4992-b51b-ab8970a64d9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de55cae1600841889668e36402861203', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:06:32.887925 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed400f6-33db-4992-b51b-ab8970a64d9a service cinder] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:06:32.888399 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed400f6-33db-4992-b51b-ab8970a64d9a service cinder] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:06:32.888865 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed400f6-33db-4992-b51b-ab8970a64d9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:06:32.939467 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:06:32.954395 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed400f6-33db-4992-b51b-ab8970a64d9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:06:32.957351 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed400f6-33db-4992-b51b-ab8970a64d9a service cinder] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:06:32.967698 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1363/2725] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 18:06:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:06:33.511474 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c567b84-24cf-4ea4-9a45-3009152d9c65 service cinder] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:06:33.520970 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c567b84-24cf-4ea4-9a45-3009152d9c65 service cinder] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:06:33.524598 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ee610c-cea2-420b-9a46-3144cc7c5c9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de55cae1600841889668e36402861203', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:06:33.525238 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ee610c-cea2-420b-9a46-3144cc7c5c9a service cinder] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:06:33.525518 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ee610c-cea2-420b-9a46-3144cc7c5c9a service cinder] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:06:33.525824 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ee610c-cea2-420b-9a46-3144cc7c5c9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:06:33.535847 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ee610c-cea2-420b-9a46-3144cc7c5c9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:06:33.537315 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ee610c-cea2-420b-9a46-3144cc7c5c9a service cinder] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:06:33.547161 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1363/2726] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 18:06:33 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:06:35.316665 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed400f6-33db-4992-b51b-ab8970a64d9a service cinder] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:06:35.319081 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-4ed400f6-33db-4992-b51b-ab8970a64d9a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:06:35.410348 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed400f6-33db-4992-b51b-ab8970a64d9a service cinder] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:06:35.416155 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0720b566-0828-45e0-8e0a-31cf9661452e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41b893bdf4ec474dbfa819c22fc29ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:06:35.416997 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0720b566-0828-45e0-8e0a-31cf9661452e service nova] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:06:35.417317 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0720b566-0828-45e0-8e0a-31cf9661452e service nova] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:06:35.417663 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0720b566-0828-45e0-8e0a-31cf9661452e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:06:35.419974 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-0720b566-0828-45e0-8e0a-31cf9661452e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:06:35.434915 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0720b566-0828-45e0-8e0a-31cf9661452e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:06:35.437941 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0720b566-0828-45e0-8e0a-31cf9661452e service nova] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:06:35.451320 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1364/2727] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 18:06:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:06:37.397467 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ee610c-cea2-420b-9a46-3144cc7c5c9a service cinder] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:06:37.459541 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ee610c-cea2-420b-9a46-3144cc7c5c9a service cinder] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:06:37.464030 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d78e2d-24a0-4ff2-9eca-8ca7d78ee47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:06:37.464903 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d78e2d-24a0-4ff2-9eca-8ca7d78ee47a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:06:37.465182 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d78e2d-24a0-4ff2-9eca-8ca7d78ee47a admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:06:37.465489 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d78e2d-24a0-4ff2-9eca-8ca7d78ee47a admin admin] PATH_INFO: `/v3/users/8bcbf688c8b44a84b215553d8f4654be` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:06:37.466695 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d78e2d-24a0-4ff2-9eca-8ca7d78ee47a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bcbf688c8b44a84b215553d8f4654be)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:06:37.469122 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d78e2d-24a0-4ff2-9eca-8ca7d78ee47a admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:06:37.491408 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:06:37.516887 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-47d78e2d-24a0-4ff2-9eca-8ca7d78ee47a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bcbf688c8b44a84b215553d8f4654be'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:06:37.524364 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-47d78e2d-24a0-4ff2-9eca-8ca7d78ee47a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bcbf688c8b44a84b215553d8f4654be'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:06:37.537176 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-47d78e2d-24a0-4ff2-9eca-8ca7d78ee47a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bcbf688c8b44a84b215553d8f4654be'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:06:37.537841 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-47d78e2d-24a0-4ff2-9eca-8ca7d78ee47a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bcbf688c8b44a84b215553d8f4654be'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:06:37.538448 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-47d78e2d-24a0-4ff2-9eca-8ca7d78ee47a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bcbf688c8b44a84b215553d8f4654be'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:06:37.551132 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1364/2728] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 14 18:06:37 2022] DELETE /identity/v3/users/8bcbf688c8b44a84b215553d8f4654be => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:06:37.555726 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8cff1a-a984-4492-9bc9-bc85ce64fb37 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:06:37.556197 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8cff1a-a984-4492-9bc9-bc85ce64fb37 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:06:37.556294 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8cff1a-a984-4492-9bc9-bc85ce64fb37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:06:37.573486 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-ea8cff1a-a984-4492-9bc9-bc85ce64fb37 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:06:37.574711 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-ea8cff1a-a984-4492-9bc9-bc85ce64fb37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:06:37.634742 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1365/2729] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 18:06:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:06:37.644461 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d78e2d-24a0-4ff2-9eca-8ca7d78ee47a admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:06:37.645967 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-47d78e2d-24a0-4ff2-9eca-8ca7d78ee47a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:06:37.704688 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d78e2d-24a0-4ff2-9eca-8ca7d78ee47a admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:06:37.708438 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b2c0d1-6cac-4d21-9c4e-53175a90ffc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:06:37.709093 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b2c0d1-6cac-4d21-9c4e-53175a90ffc1 service neutron] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:06:37.709385 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b2c0d1-6cac-4d21-9c4e-53175a90ffc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:06:37.709687 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b2c0d1-6cac-4d21-9c4e-53175a90ffc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:06:37.719767 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b2c0d1-6cac-4d21-9c4e-53175a90ffc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:06:37.721195 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b2c0d1-6cac-4d21-9c4e-53175a90ffc1 service neutron] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:06:37.731069 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1365/2730] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 18:06:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:06:37.953017 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8cff1a-a984-4492-9bc9-bc85ce64fb37 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:06:37.954682 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-ea8cff1a-a984-4492-9bc9-bc85ce64fb37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:06:37.969404 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8cff1a-a984-4492-9bc9-bc85ce64fb37 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:06:37.973107 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd94490-e066-4032-a6ff-02ec5a2343af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:06:37.973908 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd94490-e066-4032-a6ff-02ec5a2343af service neutron] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:06:37.974188 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd94490-e066-4032-a6ff-02ec5a2343af service neutron] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:06:37.974465 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd94490-e066-4032-a6ff-02ec5a2343af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:06:37.976301 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-ddd94490-e066-4032-a6ff-02ec5a2343af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:06:38.042922 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd94490-e066-4032-a6ff-02ec5a2343af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:06:38.044360 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd94490-e066-4032-a6ff-02ec5a2343af service neutron] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:06:38.054186 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1366/2731] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 18:06:37 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:06:38.135657 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b2c0d1-6cac-4d21-9c4e-53175a90ffc1 service neutron] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:06:38.137072 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-b2b2c0d1-6cac-4d21-9c4e-53175a90ffc1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:06:38.150795 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b2c0d1-6cac-4d21-9c4e-53175a90ffc1 service neutron] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:06:38.155727 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3193c2b7-fe7a-455d-9e8d-cf00983ec21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:06:38.156679 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193c2b7-fe7a-455d-9e8d-cf00983ec21a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:06:38.156970 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193c2b7-fe7a-455d-9e8d-cf00983ec21a admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:06:38.157258 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193c2b7-fe7a-455d-9e8d-cf00983ec21a admin admin] PATH_INFO: `/v3/projects/5abf3ce84a8d4e969cd29285ba9b00e5` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:06:38.158538 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3193c2b7-fe7a-455d-9e8d-cf00983ec21a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5abf3ce84a8d4e969cd29285ba9b00e5)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:06:38.160336 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3193c2b7-fe7a-455d-9e8d-cf00983ec21a admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:06:38.219595 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-3193c2b7-fe7a-455d-9e8d-cf00983ec21a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5abf3ce84a8d4e969cd29285ba9b00e5', 'request_id': 'req-3193c2b7-fe7a-455d-9e8d-cf00983ec21a'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:06:38.225851 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-3193c2b7-fe7a-455d-9e8d-cf00983ec21a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5abf3ce84a8d4e969cd29285ba9b00e5', 'request_id': 'req-3193c2b7-fe7a-455d-9e8d-cf00983ec21a'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:06:38.231608 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-3193c2b7-fe7a-455d-9e8d-cf00983ec21a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5abf3ce84a8d4e969cd29285ba9b00e5', 'request_id': 'req-3193c2b7-fe7a-455d-9e8d-cf00983ec21a'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:06:38.248813 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-3193c2b7-fe7a-455d-9e8d-cf00983ec21a admin admin] The token cache is being invalidate because project 5abf3ce84a8d4e969cd29285ba9b00e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86773) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 18:06:38.249100 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-3193c2b7-fe7a-455d-9e8d-cf00983ec21a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:06:38.249832 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-3193c2b7-fe7a-455d-9e8d-cf00983ec21a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:06:38.251357 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1366/2732] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 14 18:06:38 2022] DELETE /identity/v3/projects/5abf3ce84a8d4e969cd29285ba9b00e5 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:06:38.255382 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd94490-e066-4032-a6ff-02ec5a2343af service neutron] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:06:38.266444 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd94490-e066-4032-a6ff-02ec5a2343af service neutron] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:06:38.270044 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=100 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:06:38.323370 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a161dee9-5a9a-41c6-8f09-55df5a1da727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:06:38.324240 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a161dee9-5a9a-41c6-8f09-55df5a1da727 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:06:38.324521 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a161dee9-5a9a-41c6-8f09-55df5a1da727 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:06:38.324791 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a161dee9-5a9a-41c6-8f09-55df5a1da727 admin admin] PATH_INFO: `/v3/users/ff5500e2e72c4ac994ec72be2f64c9a7` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:06:38.326061 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a161dee9-5a9a-41c6-8f09-55df5a1da727 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff5500e2e72c4ac994ec72be2f64c9a7)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:06:38.328533 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a161dee9-5a9a-41c6-8f09-55df5a1da727 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:06:38.378377 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-a161dee9-5a9a-41c6-8f09-55df5a1da727 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff5500e2e72c4ac994ec72be2f64c9a7'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:06:38.387491 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-a161dee9-5a9a-41c6-8f09-55df5a1da727 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff5500e2e72c4ac994ec72be2f64c9a7'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:06:38.395946 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-a161dee9-5a9a-41c6-8f09-55df5a1da727 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff5500e2e72c4ac994ec72be2f64c9a7'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:06:38.396753 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-a161dee9-5a9a-41c6-8f09-55df5a1da727 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff5500e2e72c4ac994ec72be2f64c9a7'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:06:38.411199 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-a161dee9-5a9a-41c6-8f09-55df5a1da727 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff5500e2e72c4ac994ec72be2f64c9a7'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:06:38.417249 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1367/2733] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 14 18:06:38 2022] DELETE /identity/v3/users/ff5500e2e72c4ac994ec72be2f64c9a7 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:06:38.729372 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3193c2b7-fe7a-455d-9e8d-cf00983ec21a admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:06:38.730865 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-3193c2b7-fe7a-455d-9e8d-cf00983ec21a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:06:38.744859 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3193c2b7-fe7a-455d-9e8d-cf00983ec21a admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:06:38.767614 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:06:38.809649 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f23394d-cd60-4c0c-a232-03235ec79714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:06:38.811085 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f23394d-cd60-4c0c-a232-03235ec79714 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:06:38.811367 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f23394d-cd60-4c0c-a232-03235ec79714 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:06:38.811646 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f23394d-cd60-4c0c-a232-03235ec79714 admin admin] PATH_INFO: `/v3/projects/5d9f648a0548404baa2532f4e5734027` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:06:38.812855 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f23394d-cd60-4c0c-a232-03235ec79714 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d9f648a0548404baa2532f4e5734027)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:06:38.814810 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f23394d-cd60-4c0c-a232-03235ec79714 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:06:38.864677 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-1f23394d-cd60-4c0c-a232-03235ec79714 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d9f648a0548404baa2532f4e5734027', 'request_id': 'req-1f23394d-cd60-4c0c-a232-03235ec79714'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:06:38.871169 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-1f23394d-cd60-4c0c-a232-03235ec79714 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d9f648a0548404baa2532f4e5734027', 'request_id': 'req-1f23394d-cd60-4c0c-a232-03235ec79714'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:06:38.876991 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-1f23394d-cd60-4c0c-a232-03235ec79714 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d9f648a0548404baa2532f4e5734027', 'request_id': 'req-1f23394d-cd60-4c0c-a232-03235ec79714'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:06:38.890097 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-1f23394d-cd60-4c0c-a232-03235ec79714 admin admin] The token cache is being invalidate because project 5d9f648a0548404baa2532f4e5734027 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86773) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 18:06:38.890390 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-1f23394d-cd60-4c0c-a232-03235ec79714 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:06:38.891019 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-1f23394d-cd60-4c0c-a232-03235ec79714 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:06:38.892579 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1367/2734] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 14 18:06:38 2022] DELETE /identity/v3/projects/5d9f648a0548404baa2532f4e5734027 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:06:38.896964 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a161dee9-5a9a-41c6-8f09-55df5a1da727 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:06:38.898703 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-a161dee9-5a9a-41c6-8f09-55df5a1da727 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:06:38.911972 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a161dee9-5a9a-41c6-8f09-55df5a1da727 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:06:38.971481 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35284705-9e59-4078-9953-66a9add3c605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:06:38.972353 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35284705-9e59-4078-9953-66a9add3c605 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:06:38.972632 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35284705-9e59-4078-9953-66a9add3c605 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:06:38.972907 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35284705-9e59-4078-9953-66a9add3c605 admin admin] PATH_INFO: `/v3/users/6eeca5d0a6cf4aab8578e04e243d093d` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:06:38.974129 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35284705-9e59-4078-9953-66a9add3c605 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6eeca5d0a6cf4aab8578e04e243d093d)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:06:38.976029 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35284705-9e59-4078-9953-66a9add3c605 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:06:39.005790 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:06:39.025215 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-35284705-9e59-4078-9953-66a9add3c605 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6eeca5d0a6cf4aab8578e04e243d093d'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:06:39.034175 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-35284705-9e59-4078-9953-66a9add3c605 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6eeca5d0a6cf4aab8578e04e243d093d'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:06:39.042412 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-35284705-9e59-4078-9953-66a9add3c605 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6eeca5d0a6cf4aab8578e04e243d093d'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:06:39.043154 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-35284705-9e59-4078-9953-66a9add3c605 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6eeca5d0a6cf4aab8578e04e243d093d'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:06:39.055922 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-35284705-9e59-4078-9953-66a9add3c605 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6eeca5d0a6cf4aab8578e04e243d093d'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:06:39.062728 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1368/2735] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 14 18:06:38 2022] DELETE /identity/v3/users/6eeca5d0a6cf4aab8578e04e243d093d => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:06:39.348154 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f23394d-cd60-4c0c-a232-03235ec79714 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:06:39.349716 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-1f23394d-cd60-4c0c-a232-03235ec79714 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:06:39.366316 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f23394d-cd60-4c0c-a232-03235ec79714 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:06:39.430067 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3753fdd-96a1-410b-b053-76dd37d2b032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:06:39.430963 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3753fdd-96a1-410b-b053-76dd37d2b032 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:06:39.431245 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3753fdd-96a1-410b-b053-76dd37d2b032 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:06:39.431516 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3753fdd-96a1-410b-b053-76dd37d2b032 admin admin] PATH_INFO: `/v3/projects/c38107e149354c218865eebc74857055` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:06:39.432744 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3753fdd-96a1-410b-b053-76dd37d2b032 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c38107e149354c218865eebc74857055)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:06:39.434756 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3753fdd-96a1-410b-b053-76dd37d2b032 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:06:39.487383 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-d3753fdd-96a1-410b-b053-76dd37d2b032 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c38107e149354c218865eebc74857055', 'request_id': 'req-d3753fdd-96a1-410b-b053-76dd37d2b032'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:06:39.493980 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-d3753fdd-96a1-410b-b053-76dd37d2b032 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c38107e149354c218865eebc74857055', 'request_id': 'req-d3753fdd-96a1-410b-b053-76dd37d2b032'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:06:39.496190 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:06:39.502458 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-d3753fdd-96a1-410b-b053-76dd37d2b032 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c38107e149354c218865eebc74857055', 'request_id': 'req-d3753fdd-96a1-410b-b053-76dd37d2b032'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:06:39.517679 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-d3753fdd-96a1-410b-b053-76dd37d2b032 admin admin] The token cache is being invalidate because project c38107e149354c218865eebc74857055 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86773) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 18:06:39.517971 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-d3753fdd-96a1-410b-b053-76dd37d2b032 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:06:39.518633 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-d3753fdd-96a1-410b-b053-76dd37d2b032 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:06:39.520284 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1368/2736] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 14 18:06:39 2022] DELETE /identity/v3/projects/c38107e149354c218865eebc74857055 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:06:39.525593 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279613f-653b-4235-8053-77edcbe682c1 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:06:39.525882 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279613f-653b-4235-8053-77edcbe682c1 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:06:39.526181 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279613f-653b-4235-8053-77edcbe682c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:06:39.545784 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-0279613f-653b-4235-8053-77edcbe682c1 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:06:39.547026 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-0279613f-653b-4235-8053-77edcbe682c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:06:39.608690 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1369/2737] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 18:06:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 18:06:39.617071 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1b4017-dde0-4aac-8a8b-940fd66c126b None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:06:39.617363 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1b4017-dde0-4aac-8a8b-940fd66c126b None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:06:39.617681 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1b4017-dde0-4aac-8a8b-940fd66c126b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:06:39.636591 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-6d1b4017-dde0-4aac-8a8b-940fd66c126b None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:06:39.637870 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-6d1b4017-dde0-4aac-8a8b-940fd66c126b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:06:39.646146 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1369/2738] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 18:06:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:06:39.650667 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0279613f-653b-4235-8053-77edcbe682c1 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:06:39.661248 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0279613f-653b-4235-8053-77edcbe682c1 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:06:39.666092 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aae229-6388-4ccd-a5c5-09d049a4fec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:06:39.666983 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aae229-6388-4ccd-a5c5-09d049a4fec5 admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:06:39.667268 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aae229-6388-4ccd-a5c5-09d049a4fec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:06:39.667546 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aae229-6388-4ccd-a5c5-09d049a4fec5 admin admin] PATH_INFO: `/v3/domains` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:06:39.668286 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aae229-6388-4ccd-a5c5-09d049a4fec5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:06:39.668597 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aae229-6388-4ccd-a5c5-09d049a4fec5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:06:39.670804 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aae229-6388-4ccd-a5c5-09d049a4fec5 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:06:39.682595 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1370/2739] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 14 18:06:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:06:39.687086 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1b4017-dde0-4aac-8a8b-940fd66c126b None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:06:39.696374 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1b4017-dde0-4aac-8a8b-940fd66c126b None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:06:39.701419 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04e66a5-c582-4835-9c02-eb899bab6754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:06:39.702185 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04e66a5-c582-4835-9c02-eb899bab6754 admin admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:06:39.702545 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04e66a5-c582-4835-9c02-eb899bab6754 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:06:39.702899 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04e66a5-c582-4835-9c02-eb899bab6754 admin admin] PATH_INFO: `/v3/projects` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:06:39.703739 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04e66a5-c582-4835-9c02-eb899bab6754 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:06:39.705673 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04e66a5-c582-4835-9c02-eb899bab6754 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:06:39.733537 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1370/2740] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 14 18:06:39 2022] POST /identity/v3/projects => generated 369 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 18:06:39.738128 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aae229-6388-4ccd-a5c5-09d049a4fec5 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:06:39.748278 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aae229-6388-4ccd-a5c5-09d049a4fec5 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:06:39.805865 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb63c48e-e381-4d09-87be-5987acb4938e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:06:39.806539 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63c48e-e381-4d09-87be-5987acb4938e admin admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:06:39.806821 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63c48e-e381-4d09-87be-5987acb4938e admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:06:39.807097 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63c48e-e381-4d09-87be-5987acb4938e admin admin] PATH_INFO: `/v3/users` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:06:39.807785 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb63c48e-e381-4d09-87be-5987acb4938e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:06:39.809717 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb63c48e-e381-4d09-87be-5987acb4938e admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:06:39.835825 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1371/2741] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 14 18:06:39 2022] POST /identity/v3/users => generated 285 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 18:06:39.837383 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04e66a5-c582-4835-9c02-eb899bab6754 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:06:39.848785 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04e66a5-c582-4835-9c02-eb899bab6754 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:06:39.853603 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83636b2f-5fc7-40bf-9dee-04e3619bfcd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:06:39.854292 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83636b2f-5fc7-40bf-9dee-04e3619bfcd2 admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:06:39.854578 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83636b2f-5fc7-40bf-9dee-04e3619bfcd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:06:39.854856 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83636b2f-5fc7-40bf-9dee-04e3619bfcd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:06:39.855599 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83636b2f-5fc7-40bf-9dee-04e3619bfcd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:06:39.857917 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83636b2f-5fc7-40bf-9dee-04e3619bfcd2 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:06:39.872220 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1371/2742] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 18:06:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 18:06:39.873497 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb63c48e-e381-4d09-87be-5987acb4938e admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:06:39.884219 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb63c48e-e381-4d09-87be-5987acb4938e admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:06:39.888980 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21ce4e3-3b1a-4611-9fa7-01b9a65f59a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:06:39.889721 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21ce4e3-3b1a-4611-9fa7-01b9a65f59a6 admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:06:39.890013 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21ce4e3-3b1a-4611-9fa7-01b9a65f59a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:06:39.890290 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21ce4e3-3b1a-4611-9fa7-01b9a65f59a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:06:39.891025 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21ce4e3-3b1a-4611-9fa7-01b9a65f59a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:06:39.892628 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21ce4e3-3b1a-4611-9fa7-01b9a65f59a6 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:06:39.904860 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1372/2743] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 18:06:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 18:06:39.909649 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83636b2f-5fc7-40bf-9dee-04e3619bfcd2 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:06:39.922024 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83636b2f-5fc7-40bf-9dee-04e3619bfcd2 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:06:39.926670 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ddf6ed-8086-4a6e-8d56-4c1bf65e302e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:06:39.927579 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ddf6ed-8086-4a6e-8d56-4c1bf65e302e admin admin] REQUEST_METHOD: `PUT` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:06:39.927971 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ddf6ed-8086-4a6e-8d56-4c1bf65e302e admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:06:39.928259 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ddf6ed-8086-4a6e-8d56-4c1bf65e302e admin admin] PATH_INFO: `/v3/projects/5ddc54ebafaa4ff6872caea512594845/users/cc8a45c9031e4c7e86d04c6eab083544/roles/95d753870f97426cb1ce32e078621a4c` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:06:39.949624 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ddf6ed-8086-4a6e-8d56-4c1bf65e302e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ddc54ebafaa4ff6872caea512594845, user_id=cc8a45c9031e4c7e86d04c6eab083544, role_id=95d753870f97426cb1ce32e078621a4c)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:06:39.953036 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ddf6ed-8086-4a6e-8d56-4c1bf65e302e admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:06:39.972223 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1372/2744] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 18:06:39 2022] PUT /identity/v3/projects/5ddc54ebafaa4ff6872caea512594845/users/cc8a45c9031e4c7e86d04c6eab083544/roles/95d753870f97426cb1ce32e078621a4c => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:06:40.043906 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8af0fa-2350-493e-9362-775769b3d26f None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:06:40.044260 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8af0fa-2350-493e-9362-775769b3d26f None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:06:40.044489 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8af0fa-2350-493e-9362-775769b3d26f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:06:40.066990 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:06:40.077097 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-5e8af0fa-2350-493e-9362-775769b3d26f None None] MFA Rules not processed for user `cc8a45c9031e4c7e86d04c6eab083544`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:06:40.079394 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-5e8af0fa-2350-493e-9362-775769b3d26f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:06:40.171471 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1373/2745] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 18:06:40 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:06:40.184047 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ddf6ed-8086-4a6e-8d56-4c1bf65e302e admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:06:40.186738 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-95ddf6ed-8086-4a6e-8d56-4c1bf65e302e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:06:40.281555 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ddf6ed-8086-4a6e-8d56-4c1bf65e302e admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:06:40.285451 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e28a29-ea19-420d-858e-80c8f2bdf4f9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eb7180aab4541b4aab6cf8648eac1f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:06:40.286290 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e28a29-ea19-420d-858e-80c8f2bdf4f9 service glance] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:06:40.286506 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e28a29-ea19-420d-858e-80c8f2bdf4f9 service glance] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:06:40.287050 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e28a29-ea19-420d-858e-80c8f2bdf4f9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:06:40.297015 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e28a29-ea19-420d-858e-80c8f2bdf4f9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:06:40.299238 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e28a29-ea19-420d-858e-80c8f2bdf4f9 service glance] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:06:40.310595 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1373/2746] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 18:06:40 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:06:50.167456 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=27 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:06:50.306181 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=57,keystone:DELETE=2,keystone:INSERT=3 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:07:09.279899 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8af0fa-2350-493e-9362-775769b3d26f None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:07:09.340610 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8af0fa-2350-493e-9362-775769b3d26f None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:07:09.345278 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c29603a-d690-4f75-b723-70199feeb107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:07:09.346201 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c29603a-d690-4f75-b723-70199feeb107 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:07:09.346481 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c29603a-d690-4f75-b723-70199feeb107 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:07:09.346753 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c29603a-d690-4f75-b723-70199feeb107 admin admin] PATH_INFO: `/v3/users/cc8a45c9031e4c7e86d04c6eab083544` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:07:09.348004 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c29603a-d690-4f75-b723-70199feeb107 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc8a45c9031e4c7e86d04c6eab083544)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:07:09.349944 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c29603a-d690-4f75-b723-70199feeb107 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:07:09.395315 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-1c29603a-d690-4f75-b723-70199feeb107 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc8a45c9031e4c7e86d04c6eab083544'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:07:09.402451 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-1c29603a-d690-4f75-b723-70199feeb107 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc8a45c9031e4c7e86d04c6eab083544'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:07:09.409698 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-1c29603a-d690-4f75-b723-70199feeb107 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc8a45c9031e4c7e86d04c6eab083544'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:07:09.410326 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-1c29603a-d690-4f75-b723-70199feeb107 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc8a45c9031e4c7e86d04c6eab083544'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:07:09.421933 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-1c29603a-d690-4f75-b723-70199feeb107 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc8a45c9031e4c7e86d04c6eab083544'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:07:09.427711 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1374/2747] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 14 18:07:09 2022] DELETE /identity/v3/users/cc8a45c9031e4c7e86d04c6eab083544 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:07:09.432247 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed8a16-e8c0-4fc6-bbd7-be3924138a20 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:07:09.432819 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed8a16-e8c0-4fc6-bbd7-be3924138a20 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:07:09.432819 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed8a16-e8c0-4fc6-bbd7-be3924138a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:07:09.451320 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-baed8a16-e8c0-4fc6-bbd7-be3924138a20 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:07:09.452542 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-baed8a16-e8c0-4fc6-bbd7-be3924138a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:07:09.512702 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1374/2748] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 18:07:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:07:09.522233 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c29603a-d690-4f75-b723-70199feeb107 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:07:09.523726 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-1c29603a-d690-4f75-b723-70199feeb107 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:07:09.580567 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c29603a-d690-4f75-b723-70199feeb107 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:07:09.584221 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe860f8-6498-44d4-bc72-d93ed17974fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:07:09.584866 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe860f8-6498-44d4-bc72-d93ed17974fd service neutron] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:07:09.585145 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe860f8-6498-44d4-bc72-d93ed17974fd service neutron] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:07:09.585420 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe860f8-6498-44d4-bc72-d93ed17974fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:07:09.594504 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe860f8-6498-44d4-bc72-d93ed17974fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:07:09.595924 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe860f8-6498-44d4-bc72-d93ed17974fd service neutron] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:07:09.605250 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1375/2749] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 18:07:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:07:09.878792 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baed8a16-e8c0-4fc6-bbd7-be3924138a20 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:07:09.880416 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-baed8a16-e8c0-4fc6-bbd7-be3924138a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:07:09.893763 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baed8a16-e8c0-4fc6-bbd7-be3924138a20 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:07:09.898662 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5208246c-5732-4db9-b9c2-6229a49363fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:07:09.900359 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5208246c-5732-4db9-b9c2-6229a49363fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:07:09.900715 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5208246c-5732-4db9-b9c2-6229a49363fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:07:09.901226 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5208246c-5732-4db9-b9c2-6229a49363fc admin admin] PATH_INFO: `/v3/projects/5ddc54ebafaa4ff6872caea512594845` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:07:09.902681 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5208246c-5732-4db9-b9c2-6229a49363fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ddc54ebafaa4ff6872caea512594845)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:07:09.904586 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5208246c-5732-4db9-b9c2-6229a49363fc admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:07:09.952066 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-5208246c-5732-4db9-b9c2-6229a49363fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ddc54ebafaa4ff6872caea512594845', 'request_id': 'req-5208246c-5732-4db9-b9c2-6229a49363fc'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:07:09.958316 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-5208246c-5732-4db9-b9c2-6229a49363fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ddc54ebafaa4ff6872caea512594845', 'request_id': 'req-5208246c-5732-4db9-b9c2-6229a49363fc'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:07:09.963753 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-5208246c-5732-4db9-b9c2-6229a49363fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ddc54ebafaa4ff6872caea512594845', 'request_id': 'req-5208246c-5732-4db9-b9c2-6229a49363fc'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:07:09.976507 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-5208246c-5732-4db9-b9c2-6229a49363fc admin admin] The token cache is being invalidate because project 5ddc54ebafaa4ff6872caea512594845 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86773) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 18:07:09.976798 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-5208246c-5732-4db9-b9c2-6229a49363fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:07:09.977418 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-5208246c-5732-4db9-b9c2-6229a49363fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:07:09.978975 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1375/2750] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 14 18:07:09 2022] DELETE /identity/v3/projects/5ddc54ebafaa4ff6872caea512594845 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:07:09.984277 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f4739-8f7a-467a-a143-7668256ae0a5 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:07:09.985179 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f4739-8f7a-467a-a143-7668256ae0a5 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:07:09.985454 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f4739-8f7a-467a-a143-7668256ae0a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:07:10.004353 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-579f4739-8f7a-467a-a143-7668256ae0a5 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:07:10.005576 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-579f4739-8f7a-467a-a143-7668256ae0a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:07:10.021878 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:07:10.065034 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1376/2751] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 18:07:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:07:10.072718 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce857959-b6f9-46bc-b3e5-c9056e8bd884 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:07:10.073008 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce857959-b6f9-46bc-b3e5-c9056e8bd884 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:07:10.073287 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce857959-b6f9-46bc-b3e5-c9056e8bd884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:07:10.091374 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-ce857959-b6f9-46bc-b3e5-c9056e8bd884 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:07:10.092570 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-ce857959-b6f9-46bc-b3e5-c9056e8bd884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:07:10.100983 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1376/2752] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 18:07:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:07:10.105186 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579f4739-8f7a-467a-a143-7668256ae0a5 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:07:10.115696 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579f4739-8f7a-467a-a143-7668256ae0a5 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:07:10.120371 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e36c348-77a8-40b2-b37d-d3a1db276bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:07:10.121014 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e36c348-77a8-40b2-b37d-d3a1db276bbd admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:07:10.121298 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e36c348-77a8-40b2-b37d-d3a1db276bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:07:10.121606 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e36c348-77a8-40b2-b37d-d3a1db276bbd admin admin] PATH_INFO: `/v3/domains` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:07:10.122326 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e36c348-77a8-40b2-b37d-d3a1db276bbd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:07:10.122628 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e36c348-77a8-40b2-b37d-d3a1db276bbd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:07:10.124207 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e36c348-77a8-40b2-b37d-d3a1db276bbd admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:07:10.135601 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1377/2753] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 14 18:07:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:07:10.139841 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce857959-b6f9-46bc-b3e5-c9056e8bd884 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:07:10.149069 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce857959-b6f9-46bc-b3e5-c9056e8bd884 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:07:10.153712 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb1d02b-1f59-4f75-bd1c-400b80d0aa7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:07:10.154369 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb1d02b-1f59-4f75-bd1c-400b80d0aa7a admin admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:07:10.154646 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb1d02b-1f59-4f75-bd1c-400b80d0aa7a admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:07:10.154920 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb1d02b-1f59-4f75-bd1c-400b80d0aa7a admin admin] PATH_INFO: `/v3/projects` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:07:10.155644 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb1d02b-1f59-4f75-bd1c-400b80d0aa7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:07:10.158095 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb1d02b-1f59-4f75-bd1c-400b80d0aa7a admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:07:10.188363 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1377/2754] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 14 18:07:10 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 18:07:10.189519 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e36c348-77a8-40b2-b37d-d3a1db276bbd admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:07:10.199352 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e36c348-77a8-40b2-b37d-d3a1db276bbd admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:07:10.254123 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb082fe-97f3-4fa1-9390-28a70a77c496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:07:10.254772 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb082fe-97f3-4fa1-9390-28a70a77c496 admin admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:07:10.255050 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb082fe-97f3-4fa1-9390-28a70a77c496 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:07:10.255321 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb082fe-97f3-4fa1-9390-28a70a77c496 admin admin] PATH_INFO: `/v3/users` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:07:10.256006 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb082fe-97f3-4fa1-9390-28a70a77c496 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:07:10.257922 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb082fe-97f3-4fa1-9390-28a70a77c496 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:07:10.277732 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1378/2755] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 14 18:07:10 2022] POST /identity/v3/users => generated 286 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 18:07:10.282607 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb1d02b-1f59-4f75-bd1c-400b80d0aa7a admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:07:10.292705 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb1d02b-1f59-4f75-bd1c-400b80d0aa7a admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:07:10.297223 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2b12b3-18d1-4eaf-a985-3779b33e530c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:07:10.297911 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b12b3-18d1-4eaf-a985-3779b33e530c admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:07:10.298192 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b12b3-18d1-4eaf-a985-3779b33e530c admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:07:10.298467 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b12b3-18d1-4eaf-a985-3779b33e530c admin admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:07:10.299191 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2b12b3-18d1-4eaf-a985-3779b33e530c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:07:10.300765 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2b12b3-18d1-4eaf-a985-3779b33e530c admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:07:10.310896 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1378/2756] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 18:07:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 18:07:10.314694 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb082fe-97f3-4fa1-9390-28a70a77c496 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:07:10.324927 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb082fe-97f3-4fa1-9390-28a70a77c496 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:07:10.330055 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df33700a-a168-4358-bc1c-40dfd0c6a0ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:07:10.330716 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df33700a-a168-4358-bc1c-40dfd0c6a0ea admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:07:10.330999 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df33700a-a168-4358-bc1c-40dfd0c6a0ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:07:10.331276 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df33700a-a168-4358-bc1c-40dfd0c6a0ea admin admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:07:10.332010 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df33700a-a168-4358-bc1c-40dfd0c6a0ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:07:10.333695 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df33700a-a168-4358-bc1c-40dfd0c6a0ea admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:07:10.343823 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1379/2757] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 18:07:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 18:07:10.348453 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2b12b3-18d1-4eaf-a985-3779b33e530c admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:07:10.358655 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2b12b3-18d1-4eaf-a985-3779b33e530c admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:07:10.363463 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a6f983-7fc0-4417-b83c-181b3925c09f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:07:10.364377 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a6f983-7fc0-4417-b83c-181b3925c09f admin admin] REQUEST_METHOD: `PUT` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:07:10.364661 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a6f983-7fc0-4417-b83c-181b3925c09f admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:07:10.364963 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a6f983-7fc0-4417-b83c-181b3925c09f admin admin] PATH_INFO: `/v3/projects/082cc4411f8845299eb3bf4b1430d779/users/b7d6b86d49514019b0e5af9426682b6f/roles/95d753870f97426cb1ce32e078621a4c` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:07:10.380346 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a6f983-7fc0-4417-b83c-181b3925c09f admin admin] RBAC: Authorizing `identity:create_grant(project_id=082cc4411f8845299eb3bf4b1430d779, user_id=b7d6b86d49514019b0e5af9426682b6f, role_id=95d753870f97426cb1ce32e078621a4c)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:07:10.383013 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a6f983-7fc0-4417-b83c-181b3925c09f admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:07:10.396644 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1379/2758] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 18:07:10 2022] PUT /identity/v3/projects/082cc4411f8845299eb3bf4b1430d779/users/b7d6b86d49514019b0e5af9426682b6f/roles/95d753870f97426cb1ce32e078621a4c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:07:10.408391 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc7bb26-1974-4255-b97c-53c8ebf73a60 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:07:10.408677 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc7bb26-1974-4255-b97c-53c8ebf73a60 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:07:10.408980 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc7bb26-1974-4255-b97c-53c8ebf73a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:07:10.434387 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-6bc7bb26-1974-4255-b97c-53c8ebf73a60 None None] MFA Rules not processed for user `b7d6b86d49514019b0e5af9426682b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:07:10.435580 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-6bc7bb26-1974-4255-b97c-53c8ebf73a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:07:10.498936 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1380/2759] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 18:07:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 18:07:10.510427 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a6f983-7fc0-4417-b83c-181b3925c09f admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:07:10.512158 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-93a6f983-7fc0-4417-b83c-181b3925c09f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:07:10.534718 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:07:10.570088 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a6f983-7fc0-4417-b83c-181b3925c09f admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:07:10.573764 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43cd318-248e-40dd-8b79-2076390acd8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de55cae1600841889668e36402861203', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:07:10.574407 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43cd318-248e-40dd-8b79-2076390acd8e service cinder] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:07:10.574688 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43cd318-248e-40dd-8b79-2076390acd8e service cinder] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:07:10.575010 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43cd318-248e-40dd-8b79-2076390acd8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:07:10.583727 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43cd318-248e-40dd-8b79-2076390acd8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:07:10.585145 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43cd318-248e-40dd-8b79-2076390acd8e service cinder] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:07:10.594544 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1380/2760] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 18:07:10 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:07:10.618592 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc7bb26-1974-4255-b97c-53c8ebf73a60 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:07:10.637698 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:07:10.680793 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc7bb26-1974-4255-b97c-53c8ebf73a60 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:07:10.685382 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e326390b-cdd4-4085-8167-2812c43972fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:07:10.686341 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e326390b-cdd4-4085-8167-2812c43972fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:07:10.686621 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e326390b-cdd4-4085-8167-2812c43972fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:07:10.686893 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e326390b-cdd4-4085-8167-2812c43972fe admin admin] PATH_INFO: `/v3/users/b7d6b86d49514019b0e5af9426682b6f` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:07:10.688610 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e326390b-cdd4-4085-8167-2812c43972fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7d6b86d49514019b0e5af9426682b6f)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:07:10.690556 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e326390b-cdd4-4085-8167-2812c43972fe admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:07:10.735596 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-e326390b-cdd4-4085-8167-2812c43972fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7d6b86d49514019b0e5af9426682b6f'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:07:10.742799 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-e326390b-cdd4-4085-8167-2812c43972fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7d6b86d49514019b0e5af9426682b6f'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:07:10.749688 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-e326390b-cdd4-4085-8167-2812c43972fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7d6b86d49514019b0e5af9426682b6f'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:07:10.750889 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-e326390b-cdd4-4085-8167-2812c43972fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7d6b86d49514019b0e5af9426682b6f'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:07:10.762626 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-e326390b-cdd4-4085-8167-2812c43972fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7d6b86d49514019b0e5af9426682b6f'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:07:10.769053 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1381/2761] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 14 18:07:10 2022] DELETE /identity/v3/users/b7d6b86d49514019b0e5af9426682b6f => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:07:10.776994 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26614313-35db-4c71-bbb5-69d74c8f2d35 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:07:10.777312 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26614313-35db-4c71-bbb5-69d74c8f2d35 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:07:10.777630 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26614313-35db-4c71-bbb5-69d74c8f2d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:07:10.794469 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-26614313-35db-4c71-bbb5-69d74c8f2d35 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:07:10.795694 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-26614313-35db-4c71-bbb5-69d74c8f2d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:07:10.854699 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1381/2762] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 18:07:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:07:10.864628 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e326390b-cdd4-4085-8167-2812c43972fe admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:07:10.866050 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-e326390b-cdd4-4085-8167-2812c43972fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:07:10.923203 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e326390b-cdd4-4085-8167-2812c43972fe admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:07:10.926851 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6b9eca-7795-44e8-959c-b83e2fc20ee6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:07:10.927487 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b9eca-7795-44e8-959c-b83e2fc20ee6 service neutron] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:07:10.927767 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b9eca-7795-44e8-959c-b83e2fc20ee6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:07:10.928038 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b9eca-7795-44e8-959c-b83e2fc20ee6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:07:10.936984 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6b9eca-7795-44e8-959c-b83e2fc20ee6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:07:10.938946 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6b9eca-7795-44e8-959c-b83e2fc20ee6 service neutron] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:07:10.948224 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1382/2763] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 18:07:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:07:11.225099 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26614313-35db-4c71-bbb5-69d74c8f2d35 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:07:11.226709 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-26614313-35db-4c71-bbb5-69d74c8f2d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:07:11.242269 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26614313-35db-4c71-bbb5-69d74c8f2d35 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:07:11.246928 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401918df-f426-46ae-b876-c6e1f1237235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:07:11.247797 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401918df-f426-46ae-b876-c6e1f1237235 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:07:11.248074 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401918df-f426-46ae-b876-c6e1f1237235 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:07:11.248341 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401918df-f426-46ae-b876-c6e1f1237235 admin admin] PATH_INFO: `/v3/projects/082cc4411f8845299eb3bf4b1430d779` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:07:11.249860 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401918df-f426-46ae-b876-c6e1f1237235 admin admin] RBAC: Authorizing `identity:delete_project(project_id=082cc4411f8845299eb3bf4b1430d779)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:07:11.252158 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401918df-f426-46ae-b876-c6e1f1237235 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:07:11.299270 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-401918df-f426-46ae-b876-c6e1f1237235 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '082cc4411f8845299eb3bf4b1430d779', 'request_id': 'req-401918df-f426-46ae-b876-c6e1f1237235'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:07:11.305236 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-401918df-f426-46ae-b876-c6e1f1237235 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '082cc4411f8845299eb3bf4b1430d779', 'request_id': 'req-401918df-f426-46ae-b876-c6e1f1237235'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:07:11.310778 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-401918df-f426-46ae-b876-c6e1f1237235 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '082cc4411f8845299eb3bf4b1430d779', 'request_id': 'req-401918df-f426-46ae-b876-c6e1f1237235'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:07:11.323742 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-401918df-f426-46ae-b876-c6e1f1237235 admin admin] The token cache is being invalidate because project 082cc4411f8845299eb3bf4b1430d779 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86773) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 18:07:11.324052 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-401918df-f426-46ae-b876-c6e1f1237235 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:07:11.324673 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-401918df-f426-46ae-b876-c6e1f1237235 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:07:11.326288 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1382/2764] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 14 18:07:11 2022] DELETE /identity/v3/projects/082cc4411f8845299eb3bf4b1430d779 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 18:07:20.944072 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=71,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:07:21.320629 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=71,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:08:01.692075 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6b9eca-7795-44e8-959c-b83e2fc20ee6 service neutron] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:08:01.693594 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-ef6b9eca-7795-44e8-959c-b83e2fc20ee6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:08:01.767002 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6b9eca-7795-44e8-959c-b83e2fc20ee6 service neutron] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:08:01.829387 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73e3797-7339-4968-9fbd-70773cbcc6de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41b893bdf4ec474dbfa819c22fc29ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:08:01.830065 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e3797-7339-4968-9fbd-70773cbcc6de service nova] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:08:01.830353 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e3797-7339-4968-9fbd-70773cbcc6de service nova] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:08:01.830616 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e3797-7339-4968-9fbd-70773cbcc6de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:08:01.832537 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-c73e3797-7339-4968-9fbd-70773cbcc6de service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:08:01.890571 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73e3797-7339-4968-9fbd-70773cbcc6de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:08:01.892655 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73e3797-7339-4968-9fbd-70773cbcc6de service nova] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:08:01.901548 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1383/2765] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 18:08:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:08:11.695386 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401918df-f426-46ae-b876-c6e1f1237235 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:08:11.696885 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-401918df-f426-46ae-b876-c6e1f1237235 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:08:11.716420 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401918df-f426-46ae-b876-c6e1f1237235 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:08:11.723260 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d849db34-d8af-4f55-8f43-1885712ebedc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41b893bdf4ec474dbfa819c22fc29ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:08:11.724111 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849db34-d8af-4f55-8f43-1885712ebedc service nova] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:08:11.724450 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849db34-d8af-4f55-8f43-1885712ebedc service nova] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:08:11.724816 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849db34-d8af-4f55-8f43-1885712ebedc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:08:11.726773 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-d849db34-d8af-4f55-8f43-1885712ebedc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:08:11.741040 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d849db34-d8af-4f55-8f43-1885712ebedc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:08:11.742704 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d849db34-d8af-4f55-8f43-1885712ebedc service nova] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:08:11.765202 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1383/2766] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 18:08:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:08:11.897431 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=84 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:08:15.360774 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ef3e8b-8faa-4f9e-bbe3-e3baea7c0cf7 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:08:15.361422 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ef3e8b-8faa-4f9e-bbe3-e3baea7c0cf7 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:08:15.361422 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ef3e8b-8faa-4f9e-bbe3-e3baea7c0cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:08:15.379100 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-b2ef3e8b-8faa-4f9e-bbe3-e3baea7c0cf7 None None] MFA Rules not processed for user `17180b44ab2440f6ae13e674234ae1c4`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:08:15.380299 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-b2ef3e8b-8faa-4f9e-bbe3-e3baea7c0cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:08:15.387060 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1384/2767] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 18:08:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:08:15.693712 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d849db34-d8af-4f55-8f43-1885712ebedc service nova] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:08:15.695142 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-d849db34-d8af-4f55-8f43-1885712ebedc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:08:15.750244 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d849db34-d8af-4f55-8f43-1885712ebedc service nova] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:08:15.755545 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16b2b25-629f-442f-8509-c9ab69164c46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:08:15.756264 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16b2b25-629f-442f-8509-c9ab69164c46 service neutron] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:08:15.756548 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16b2b25-629f-442f-8509-c9ab69164c46 service neutron] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:08:15.756824 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16b2b25-629f-442f-8509-c9ab69164c46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:08:15.758606 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-a16b2b25-629f-442f-8509-c9ab69164c46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:08:15.769049 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16b2b25-629f-442f-8509-c9ab69164c46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:08:15.770490 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16b2b25-629f-442f-8509-c9ab69164c46 service neutron] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:08:15.778674 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1384/2768] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 18:08:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:08:16.102790 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ef3e8b-8faa-4f9e-bbe3-e3baea7c0cf7 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:08:16.104497 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-b2ef3e8b-8faa-4f9e-bbe3-e3baea7c0cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:08:16.191217 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ef3e8b-8faa-4f9e-bbe3-e3baea7c0cf7 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:08:16.196351 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c885e92-6071-49b4-bfa9-b74704485403 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5324ab45f4a4449980dad920278f5034', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:08:16.196998 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c885e92-6071-49b4-bfa9-b74704485403 service placement] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:08:16.197277 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c885e92-6071-49b4-bfa9-b74704485403 service placement] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:08:16.197582 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c885e92-6071-49b4-bfa9-b74704485403 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:08:16.199692 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-3c885e92-6071-49b4-bfa9-b74704485403 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:08:16.211620 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c885e92-6071-49b4-bfa9-b74704485403 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:08:16.214439 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c885e92-6071-49b4-bfa9-b74704485403 service placement] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:08:16.226595 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1385/2769] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 18:08:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 18:08:24.325563 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16b2b25-629f-442f-8509-c9ab69164c46 service neutron] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:08:24.327037 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-a16b2b25-629f-442f-8509-c9ab69164c46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:08:24.345260 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16b2b25-629f-442f-8509-c9ab69164c46 service neutron] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:08:24.351212 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8a2bac-dc8f-4da6-a73a-695cee6815ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41b893bdf4ec474dbfa819c22fc29ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:08:24.351833 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a2bac-dc8f-4da6-a73a-695cee6815ae service nova] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:08:24.352234 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a2bac-dc8f-4da6-a73a-695cee6815ae service nova] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:08:24.352776 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a2bac-dc8f-4da6-a73a-695cee6815ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:08:24.354601 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-0d8a2bac-dc8f-4da6-a73a-695cee6815ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:08:24.367317 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8a2bac-dc8f-4da6-a73a-695cee6815ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:08:24.368913 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8a2bac-dc8f-4da6-a73a-695cee6815ae service nova] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:08:24.381270 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1385/2770] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 18:08:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:08:26.222335 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=35 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:08:34.376478 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=38 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:09:10.800151 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c885e92-6071-49b4-bfa9-b74704485403 service placement] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:09:10.810630 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c885e92-6071-49b4-bfa9-b74704485403 service placement] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:09:10.816968 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cde7769-76ea-46af-9845-a1a3d85ab8e7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5324ab45f4a4449980dad920278f5034', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:09:10.817810 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde7769-76ea-46af-9845-a1a3d85ab8e7 service placement] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:09:10.818214 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde7769-76ea-46af-9845-a1a3d85ab8e7 service placement] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:09:10.818489 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde7769-76ea-46af-9845-a1a3d85ab8e7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:09:10.820451 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-2cde7769-76ea-46af-9845-a1a3d85ab8e7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:09:10.832771 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cde7769-76ea-46af-9845-a1a3d85ab8e7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:09:10.834359 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cde7769-76ea-46af-9845-a1a3d85ab8e7 service placement] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:09:10.844300 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1386/2771] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 18:09:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:09:20.840115 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=6 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:09:24.051773 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12100821-9547-457a-8e1a-b798a78c84eb None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:09:24.052267 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12100821-9547-457a-8e1a-b798a78c84eb None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:09:24.052469 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12100821-9547-457a-8e1a-b798a78c84eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:09:24.070745 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-12100821-9547-457a-8e1a-b798a78c84eb None None] MFA Rules not processed for user `45542602225b452fa323f5499c1843ec`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:09:24.071934 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-12100821-9547-457a-8e1a-b798a78c84eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:09:24.127474 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1386/2772] 10.222.0.67 () {58 vars in 967 bytes} [Thu Jul 14 18:09:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:09:24.166484 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cde7769-76ea-46af-9845-a1a3d85ab8e7 service placement] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:09:24.167906 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-2cde7769-76ea-46af-9845-a1a3d85ab8e7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:09:24.236835 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cde7769-76ea-46af-9845-a1a3d85ab8e7 service placement] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:09:24.241691 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0779768-493f-4418-ac68-fed7596c79fe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c65607a396474192a43c374d306ef5ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:09:24.242338 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0779768-493f-4418-ac68-fed7596c79fe service swift] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:09:24.242623 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0779768-493f-4418-ac68-fed7596c79fe service swift] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:09:24.242906 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0779768-493f-4418-ac68-fed7596c79fe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:09:24.251581 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0779768-493f-4418-ac68-fed7596c79fe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:09:24.253139 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0779768-493f-4418-ac68-fed7596c79fe service swift] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:09:24.261087 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1387/2773] 10.222.0.67 () {60 vars in 1384 bytes} [Thu Jul 14 18:09:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 18:09:30.965097 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12100821-9547-457a-8e1a-b798a78c84eb None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:09:30.971002 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-12100821-9547-457a-8e1a-b798a78c84eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:09:31.048883 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12100821-9547-457a-8e1a-b798a78c84eb None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:09:31.053887 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9741bebb-6d3d-4469-9a23-082e623b867e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:09:31.054774 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9741bebb-6d3d-4469-9a23-082e623b867e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:09:31.055063 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9741bebb-6d3d-4469-9a23-082e623b867e admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:09:31.055340 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9741bebb-6d3d-4469-9a23-082e623b867e admin admin] PATH_INFO: `/v3/users/81328923a1e74bae8a8fa862001fda62` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:09:31.056562 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9741bebb-6d3d-4469-9a23-082e623b867e admin admin] RBAC: Authorizing `identity:delete_user(user_id=81328923a1e74bae8a8fa862001fda62)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:09:31.058625 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9741bebb-6d3d-4469-9a23-082e623b867e admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:09:31.108216 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-9741bebb-6d3d-4469-9a23-082e623b867e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81328923a1e74bae8a8fa862001fda62'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:09:31.117428 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-9741bebb-6d3d-4469-9a23-082e623b867e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81328923a1e74bae8a8fa862001fda62'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:09:31.130728 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-9741bebb-6d3d-4469-9a23-082e623b867e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81328923a1e74bae8a8fa862001fda62'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:09:31.131448 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-9741bebb-6d3d-4469-9a23-082e623b867e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81328923a1e74bae8a8fa862001fda62'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:09:31.132088 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-9741bebb-6d3d-4469-9a23-082e623b867e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81328923a1e74bae8a8fa862001fda62'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:09:31.144931 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1387/2774] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 14 18:09:30 2022] DELETE /identity/v3/users/81328923a1e74bae8a8fa862001fda62 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:09:31.314134 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0779768-493f-4418-ac68-fed7596c79fe service swift] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:09:31.327565 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0779768-493f-4418-ac68-fed7596c79fe service swift] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:09:31.385606 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e3228f-ab01-4c88-a19a-6a3a0b21df36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:09:31.386395 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e3228f-ab01-4c88-a19a-6a3a0b21df36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:09:31.386673 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e3228f-ab01-4c88-a19a-6a3a0b21df36 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:09:31.386945 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e3228f-ab01-4c88-a19a-6a3a0b21df36 admin admin] PATH_INFO: `/v3/projects/a3b728f5d30a44afb9f8cdd06bc78df6` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:09:31.388104 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e3228f-ab01-4c88-a19a-6a3a0b21df36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3b728f5d30a44afb9f8cdd06bc78df6)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:09:31.390639 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e3228f-ab01-4c88-a19a-6a3a0b21df36 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:09:31.435357 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-69e3228f-ab01-4c88-a19a-6a3a0b21df36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3b728f5d30a44afb9f8cdd06bc78df6', 'request_id': 'req-69e3228f-ab01-4c88-a19a-6a3a0b21df36'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:09:31.441239 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-69e3228f-ab01-4c88-a19a-6a3a0b21df36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3b728f5d30a44afb9f8cdd06bc78df6', 'request_id': 'req-69e3228f-ab01-4c88-a19a-6a3a0b21df36'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:09:31.448691 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-69e3228f-ab01-4c88-a19a-6a3a0b21df36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3b728f5d30a44afb9f8cdd06bc78df6', 'request_id': 'req-69e3228f-ab01-4c88-a19a-6a3a0b21df36'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:09:31.465056 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-69e3228f-ab01-4c88-a19a-6a3a0b21df36 admin admin] The token cache is being invalidate because project a3b728f5d30a44afb9f8cdd06bc78df6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86772) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 18:09:31.465354 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-69e3228f-ab01-4c88-a19a-6a3a0b21df36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:09:31.466066 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-69e3228f-ab01-4c88-a19a-6a3a0b21df36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:09:31.467644 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1388/2775] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 14 18:09:31 2022] DELETE /identity/v3/projects/a3b728f5d30a44afb9f8cdd06bc78df6 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 18:09:31.471638 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9741bebb-6d3d-4469-9a23-082e623b867e admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:09:31.473050 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-9741bebb-6d3d-4469-9a23-082e623b867e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:09:31.487022 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9741bebb-6d3d-4469-9a23-082e623b867e admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:09:31.507386 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:09:31.546902 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cfeba5-629b-4afb-837d-e5db24067562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:09:31.547781 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cfeba5-629b-4afb-837d-e5db24067562 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:09:31.548063 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cfeba5-629b-4afb-837d-e5db24067562 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:09:31.548341 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cfeba5-629b-4afb-837d-e5db24067562 admin admin] PATH_INFO: `/v3/users/be8f86db415743beb1bedf3497fbc322` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:09:31.549535 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cfeba5-629b-4afb-837d-e5db24067562 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be8f86db415743beb1bedf3497fbc322)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:09:31.551487 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cfeba5-629b-4afb-837d-e5db24067562 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:09:31.596826 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-35cfeba5-629b-4afb-837d-e5db24067562 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be8f86db415743beb1bedf3497fbc322'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:09:31.604091 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-35cfeba5-629b-4afb-837d-e5db24067562 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be8f86db415743beb1bedf3497fbc322'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:09:31.616852 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-35cfeba5-629b-4afb-837d-e5db24067562 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be8f86db415743beb1bedf3497fbc322'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:09:31.617513 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-35cfeba5-629b-4afb-837d-e5db24067562 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be8f86db415743beb1bedf3497fbc322'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:09:31.618138 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-35cfeba5-629b-4afb-837d-e5db24067562 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be8f86db415743beb1bedf3497fbc322'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:09:31.630630 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1388/2776] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 14 18:09:31 2022] DELETE /identity/v3/users/be8f86db415743beb1bedf3497fbc322 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:09:31.806446 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e3228f-ab01-4c88-a19a-6a3a0b21df36 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:09:31.808191 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-69e3228f-ab01-4c88-a19a-6a3a0b21df36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:09:31.822988 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e3228f-ab01-4c88-a19a-6a3a0b21df36 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:09:31.846652 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:09:31.896365 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1a15ea-ac45-4724-b9d3-c85467e9aac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:09:31.897193 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1a15ea-ac45-4724-b9d3-c85467e9aac2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:09:31.897477 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1a15ea-ac45-4724-b9d3-c85467e9aac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:09:31.897782 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1a15ea-ac45-4724-b9d3-c85467e9aac2 admin admin] PATH_INFO: `/v3/projects/54b5df08f5554f6f902cdc38796da3ce` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:09:31.898987 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1a15ea-ac45-4724-b9d3-c85467e9aac2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54b5df08f5554f6f902cdc38796da3ce)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:09:31.900875 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1a15ea-ac45-4724-b9d3-c85467e9aac2 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:09:31.953351 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-ac1a15ea-ac45-4724-b9d3-c85467e9aac2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54b5df08f5554f6f902cdc38796da3ce', 'request_id': 'req-ac1a15ea-ac45-4724-b9d3-c85467e9aac2'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:09:31.959525 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-ac1a15ea-ac45-4724-b9d3-c85467e9aac2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54b5df08f5554f6f902cdc38796da3ce', 'request_id': 'req-ac1a15ea-ac45-4724-b9d3-c85467e9aac2'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:09:31.968063 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-ac1a15ea-ac45-4724-b9d3-c85467e9aac2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54b5df08f5554f6f902cdc38796da3ce', 'request_id': 'req-ac1a15ea-ac45-4724-b9d3-c85467e9aac2'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:09:31.979838 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-ac1a15ea-ac45-4724-b9d3-c85467e9aac2 admin admin] The token cache is being invalidate because project 54b5df08f5554f6f902cdc38796da3ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86772) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 18:09:31.980128 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-ac1a15ea-ac45-4724-b9d3-c85467e9aac2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:09:31.980787 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-ac1a15ea-ac45-4724-b9d3-c85467e9aac2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:09:31.982392 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1389/2777] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 14 18:09:31 2022] DELETE /identity/v3/projects/54b5df08f5554f6f902cdc38796da3ce => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:09:41.627225 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=42,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:09:41.976692 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=42,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:10:09.927516 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cfeba5-629b-4afb-837d-e5db24067562 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:10:09.928920 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-35cfeba5-629b-4afb-837d-e5db24067562 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:10:09.985253 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cfeba5-629b-4afb-837d-e5db24067562 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:10:10.033942 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897b2ec0-bc87-4176-84f7-2330372aa2a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:10:10.034607 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b2ec0-bc87-4176-84f7-2330372aa2a7 service neutron] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:10:10.034889 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b2ec0-bc87-4176-84f7-2330372aa2a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:10:10.035164 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b2ec0-bc87-4176-84f7-2330372aa2a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:10:10.036953 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-897b2ec0-bc87-4176-84f7-2330372aa2a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:10:10.097080 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897b2ec0-bc87-4176-84f7-2330372aa2a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:10:10.098450 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897b2ec0-bc87-4176-84f7-2330372aa2a7 service neutron] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:10:10.108529 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1389/2778] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 18:10:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:10:12.997217 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1a15ea-ac45-4724-b9d3-c85467e9aac2 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:10:12.999195 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-ac1a15ea-ac45-4724-b9d3-c85467e9aac2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:10:13.016918 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1a15ea-ac45-4724-b9d3-c85467e9aac2 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:10:13.025545 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8acbdd-365f-4068-bf64-7167eeb6416a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:10:13.026536 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8acbdd-365f-4068-bf64-7167eeb6416a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:10:13.027390 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8acbdd-365f-4068-bf64-7167eeb6416a admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:10:13.027662 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8acbdd-365f-4068-bf64-7167eeb6416a admin admin] PATH_INFO: `/v3/users/17180b44ab2440f6ae13e674234ae1c4` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:10:13.028914 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8acbdd-365f-4068-bf64-7167eeb6416a admin admin] RBAC: Authorizing `identity:delete_user(user_id=17180b44ab2440f6ae13e674234ae1c4)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:10:13.030926 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8acbdd-365f-4068-bf64-7167eeb6416a admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:10:13.077497 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-0d8acbdd-365f-4068-bf64-7167eeb6416a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17180b44ab2440f6ae13e674234ae1c4'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:10:13.085075 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-0d8acbdd-365f-4068-bf64-7167eeb6416a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17180b44ab2440f6ae13e674234ae1c4'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:10:13.092643 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-0d8acbdd-365f-4068-bf64-7167eeb6416a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17180b44ab2440f6ae13e674234ae1c4'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:10:13.093271 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-0d8acbdd-365f-4068-bf64-7167eeb6416a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17180b44ab2440f6ae13e674234ae1c4'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:10:13.105863 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-0d8acbdd-365f-4068-bf64-7167eeb6416a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17180b44ab2440f6ae13e674234ae1c4'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:10:13.111898 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1390/2779] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 14 18:10:12 2022] DELETE /identity/v3/users/17180b44ab2440f6ae13e674234ae1c4 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:10:13.281473 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897b2ec0-bc87-4176-84f7-2330372aa2a7 service neutron] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:10:13.292248 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897b2ec0-bc87-4176-84f7-2330372aa2a7 service neutron] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:10:13.349353 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ad49d2-e88b-445a-9a5f-3f31cd0961df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:10:13.350247 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ad49d2-e88b-445a-9a5f-3f31cd0961df admin admin] REQUEST_METHOD: `DELETE` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:10:13.350519 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ad49d2-e88b-445a-9a5f-3f31cd0961df admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:10:13.350796 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ad49d2-e88b-445a-9a5f-3f31cd0961df admin admin] PATH_INFO: `/v3/projects/cbec0871ac2848e093d084460db28350` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:10:13.351956 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ad49d2-e88b-445a-9a5f-3f31cd0961df admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbec0871ac2848e093d084460db28350)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:10:13.353889 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ad49d2-e88b-445a-9a5f-3f31cd0961df admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:10:13.362272 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=100 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:10:13.401897 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-22ad49d2-e88b-445a-9a5f-3f31cd0961df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbec0871ac2848e093d084460db28350', 'request_id': 'req-22ad49d2-e88b-445a-9a5f-3f31cd0961df'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:10:13.408509 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-22ad49d2-e88b-445a-9a5f-3f31cd0961df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbec0871ac2848e093d084460db28350', 'request_id': 'req-22ad49d2-e88b-445a-9a5f-3f31cd0961df'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:10:13.414133 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-22ad49d2-e88b-445a-9a5f-3f31cd0961df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbec0871ac2848e093d084460db28350', 'request_id': 'req-22ad49d2-e88b-445a-9a5f-3f31cd0961df'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:10:13.425933 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-22ad49d2-e88b-445a-9a5f-3f31cd0961df admin admin] The token cache is being invalidate because project cbec0871ac2848e093d084460db28350 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86773) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 18:10:13.426223 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-22ad49d2-e88b-445a-9a5f-3f31cd0961df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:10:13.426841 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-22ad49d2-e88b-445a-9a5f-3f31cd0961df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:10:13.428371 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1390/2780] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 14 18:10:13 2022] DELETE /identity/v3/projects/cbec0871ac2848e093d084460db28350 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:10:13.433236 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7310c507-2de6-4dc1-8e99-2593ec8745ae None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:10:13.433547 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7310c507-2de6-4dc1-8e99-2593ec8745ae None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:10:13.433814 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7310c507-2de6-4dc1-8e99-2593ec8745ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:10:13.451913 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-7310c507-2de6-4dc1-8e99-2593ec8745ae None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:10:13.453112 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-7310c507-2de6-4dc1-8e99-2593ec8745ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:10:13.513741 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1391/2781] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 18:10:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 18:10:13.521496 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9712429-509a-491f-86e2-a0b1a0161262 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:10:13.521814 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9712429-509a-491f-86e2-a0b1a0161262 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:10:13.522104 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9712429-509a-491f-86e2-a0b1a0161262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:10:13.540984 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-f9712429-509a-491f-86e2-a0b1a0161262 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:10:13.542239 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-f9712429-509a-491f-86e2-a0b1a0161262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:10:13.550831 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1391/2782] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 18:10:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:10:13.555051 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7310c507-2de6-4dc1-8e99-2593ec8745ae None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:10:13.565327 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7310c507-2de6-4dc1-8e99-2593ec8745ae None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:10:13.569795 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d1897b-02e6-44c2-ab87-ea38ed30b3c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:10:13.570447 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d1897b-02e6-44c2-ab87-ea38ed30b3c9 admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:10:13.570725 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d1897b-02e6-44c2-ab87-ea38ed30b3c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:10:13.571000 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d1897b-02e6-44c2-ab87-ea38ed30b3c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:10:13.571717 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d1897b-02e6-44c2-ab87-ea38ed30b3c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:10:13.572015 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d1897b-02e6-44c2-ab87-ea38ed30b3c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:10:13.573613 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d1897b-02e6-44c2-ab87-ea38ed30b3c9 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:10:13.589833 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1392/2783] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 14 18:10:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 18:10:13.594102 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9712429-509a-491f-86e2-a0b1a0161262 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:10:13.603544 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9712429-509a-491f-86e2-a0b1a0161262 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:10:13.608615 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db731a2e-aad8-470d-8afd-efcda4dbddbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:10:13.609256 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db731a2e-aad8-470d-8afd-efcda4dbddbb admin admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:10:13.609566 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db731a2e-aad8-470d-8afd-efcda4dbddbb admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:10:13.609844 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db731a2e-aad8-470d-8afd-efcda4dbddbb admin admin] PATH_INFO: `/v3/projects` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:10:13.610526 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db731a2e-aad8-470d-8afd-efcda4dbddbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:10:13.612387 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db731a2e-aad8-470d-8afd-efcda4dbddbb admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:10:13.637458 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1392/2784] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 14 18:10:13 2022] POST /identity/v3/projects => generated 403 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 18:10:13.641834 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d1897b-02e6-44c2-ab87-ea38ed30b3c9 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:10:13.651600 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d1897b-02e6-44c2-ab87-ea38ed30b3c9 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:10:13.708016 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21559837-fb93-40ed-bd94-d1f0237976be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:10:13.708677 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21559837-fb93-40ed-bd94-d1f0237976be admin admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:10:13.708959 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21559837-fb93-40ed-bd94-d1f0237976be admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:10:13.709227 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21559837-fb93-40ed-bd94-d1f0237976be admin admin] PATH_INFO: `/v3/users` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:10:13.709935 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21559837-fb93-40ed-bd94-d1f0237976be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:10:13.711853 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21559837-fb93-40ed-bd94-d1f0237976be admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:10:13.718483 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:10:13.734358 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1393/2785] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 14 18:10:13 2022] POST /identity/v3/users => generated 302 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 18:10:13.738605 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db731a2e-aad8-470d-8afd-efcda4dbddbb admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:10:13.749983 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db731a2e-aad8-470d-8afd-efcda4dbddbb admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:10:13.754612 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e655d923-c933-4fbd-aaa0-15f983731631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:10:13.755348 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e655d923-c933-4fbd-aaa0-15f983731631 admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:10:13.755632 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e655d923-c933-4fbd-aaa0-15f983731631 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:10:13.755909 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e655d923-c933-4fbd-aaa0-15f983731631 admin admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:10:13.756642 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e655d923-c933-4fbd-aaa0-15f983731631 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:10:13.758286 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e655d923-c933-4fbd-aaa0-15f983731631 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:10:13.768689 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1393/2786] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 18:10:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 18:10:13.772800 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21559837-fb93-40ed-bd94-d1f0237976be admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:10:13.783145 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21559837-fb93-40ed-bd94-d1f0237976be admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:10:13.787955 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af37ba05-f662-4a70-8093-c1c4430e4015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:10:13.788613 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af37ba05-f662-4a70-8093-c1c4430e4015 admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:10:13.788897 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af37ba05-f662-4a70-8093-c1c4430e4015 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:10:13.789175 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af37ba05-f662-4a70-8093-c1c4430e4015 admin admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:10:13.789942 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af37ba05-f662-4a70-8093-c1c4430e4015 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:10:13.791575 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af37ba05-f662-4a70-8093-c1c4430e4015 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:10:13.802648 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1394/2787] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 18:10:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 18:10:13.806657 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e655d923-c933-4fbd-aaa0-15f983731631 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:10:13.816610 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e655d923-c933-4fbd-aaa0-15f983731631 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:10:13.821304 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a9bbb1-326b-4df9-84b2-9f99f2ae7ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:10:13.822212 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a9bbb1-326b-4df9-84b2-9f99f2ae7ec1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:10:13.822494 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a9bbb1-326b-4df9-84b2-9f99f2ae7ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:10:13.822798 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a9bbb1-326b-4df9-84b2-9f99f2ae7ec1 admin admin] PATH_INFO: `/v3/projects/67dc111a228b43a695d5665484de43ad/users/30cf3ec10e7e40ca8d02f9ddd30bb166/roles/95d753870f97426cb1ce32e078621a4c` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:10:13.838631 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a9bbb1-326b-4df9-84b2-9f99f2ae7ec1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67dc111a228b43a695d5665484de43ad, user_id=30cf3ec10e7e40ca8d02f9ddd30bb166, role_id=95d753870f97426cb1ce32e078621a4c)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:10:13.841832 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a9bbb1-326b-4df9-84b2-9f99f2ae7ec1 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:10:13.855689 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1394/2788] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 18:10:13 2022] PUT /identity/v3/projects/67dc111a228b43a695d5665484de43ad/users/30cf3ec10e7e40ca8d02f9ddd30bb166/roles/95d753870f97426cb1ce32e078621a4c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:10:13.861227 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124b1cae-0d75-4ea8-ae69-fe6fe9a0cd20 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:10:13.861747 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124b1cae-0d75-4ea8-ae69-fe6fe9a0cd20 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:10:13.862031 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124b1cae-0d75-4ea8-ae69-fe6fe9a0cd20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:10:13.880546 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-124b1cae-0d75-4ea8-ae69-fe6fe9a0cd20 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:10:13.881809 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-124b1cae-0d75-4ea8-ae69-fe6fe9a0cd20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:10:13.950472 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1395/2789] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 18:10:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:10:13.960108 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a9bbb1-326b-4df9-84b2-9f99f2ae7ec1 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:10:13.961878 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-07a9bbb1-326b-4df9-84b2-9f99f2ae7ec1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:10:14.024272 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a9bbb1-326b-4df9-84b2-9f99f2ae7ec1 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:10:14.028315 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcd8aa1-76c8-420b-85a1-9b7f07d4a3c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:10:14.028976 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd8aa1-76c8-420b-85a1-9b7f07d4a3c9 service neutron] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:10:14.029258 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd8aa1-76c8-420b-85a1-9b7f07d4a3c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:10:14.029557 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd8aa1-76c8-420b-85a1-9b7f07d4a3c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:10:14.039837 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcd8aa1-76c8-420b-85a1-9b7f07d4a3c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:10:14.041569 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcd8aa1-76c8-420b-85a1-9b7f07d4a3c9 service neutron] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:10:14.052493 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1395/2790] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 18:10:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:10:14.661368 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424fe1bc-7d67-4198-8557-c89616090b37 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:10:14.661989 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424fe1bc-7d67-4198-8557-c89616090b37 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:10:14.661989 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424fe1bc-7d67-4198-8557-c89616090b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:10:14.688742 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-424fe1bc-7d67-4198-8557-c89616090b37 None None] MFA Rules not processed for user `30cf3ec10e7e40ca8d02f9ddd30bb166`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:10:14.690100 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-424fe1bc-7d67-4198-8557-c89616090b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:10:14.755321 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1396/2791] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 18:10:14 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:10:14.759876 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcd8aa1-76c8-420b-85a1-9b7f07d4a3c9 service neutron] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:10:14.770363 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcd8aa1-76c8-420b-85a1-9b7f07d4a3c9 service neutron] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:10:14.774859 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc95bbb-e677-4333-942f-37146ae249ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:10:14.775511 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc95bbb-e677-4333-942f-37146ae249ba admin admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:10:14.775793 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc95bbb-e677-4333-942f-37146ae249ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:10:14.776066 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc95bbb-e677-4333-942f-37146ae249ba admin admin] PATH_INFO: `/v3/projects` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:10:14.776798 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc95bbb-e677-4333-942f-37146ae249ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:10:14.778755 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc95bbb-e677-4333-942f-37146ae249ba admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:10:14.805000 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1396/2792] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 14 18:10:14 2022] POST /identity/v3/projects => generated 405 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 18:10:14.809640 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424fe1bc-7d67-4198-8557-c89616090b37 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:10:14.820559 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424fe1bc-7d67-4198-8557-c89616090b37 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:10:14.878671 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756c9e03-1d66-4f4a-9f7e-79893143ef93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:10:14.879337 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c9e03-1d66-4f4a-9f7e-79893143ef93 admin admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:10:14.879618 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c9e03-1d66-4f4a-9f7e-79893143ef93 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:10:14.879893 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c9e03-1d66-4f4a-9f7e-79893143ef93 admin admin] PATH_INFO: `/v3/users` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:10:14.880566 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756c9e03-1d66-4f4a-9f7e-79893143ef93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:10:14.882480 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756c9e03-1d66-4f4a-9f7e-79893143ef93 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:10:14.896925 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:10:14.906324 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1397/2793] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 14 18:10:14 2022] POST /identity/v3/users => generated 309 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 18:10:14.907471 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc95bbb-e677-4333-942f-37146ae249ba admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:10:14.919350 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc95bbb-e677-4333-942f-37146ae249ba admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:10:14.923951 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05efdb71-da6e-41e1-a501-68ee6d1a76e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:10:14.924614 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05efdb71-da6e-41e1-a501-68ee6d1a76e5 admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:10:14.924925 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05efdb71-da6e-41e1-a501-68ee6d1a76e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:10:14.925205 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05efdb71-da6e-41e1-a501-68ee6d1a76e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:10:14.925964 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05efdb71-da6e-41e1-a501-68ee6d1a76e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:10:14.927553 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05efdb71-da6e-41e1-a501-68ee6d1a76e5 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:10:14.938476 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1397/2794] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 18:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 18:10:14.942612 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756c9e03-1d66-4f4a-9f7e-79893143ef93 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:10:14.952461 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756c9e03-1d66-4f4a-9f7e-79893143ef93 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:10:14.957016 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15604b2a-a3c3-4820-b654-dd7be81e7d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:10:14.958281 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15604b2a-a3c3-4820-b654-dd7be81e7d22 admin admin] REQUEST_METHOD: `PUT` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:10:14.958572 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15604b2a-a3c3-4820-b654-dd7be81e7d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:10:14.958847 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15604b2a-a3c3-4820-b654-dd7be81e7d22 admin admin] PATH_INFO: `/v3/projects/95c6c762b17a4d38b89b12257843e9f2/users/3b38128abeee48c285ff18702d226eb7/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:10:14.974336 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15604b2a-a3c3-4820-b654-dd7be81e7d22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95c6c762b17a4d38b89b12257843e9f2, user_id=3b38128abeee48c285ff18702d226eb7, role_id=4651a1cc7b4d4ab7a7a9ca1e77e58e71)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:10:14.976972 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15604b2a-a3c3-4820-b654-dd7be81e7d22 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:10:14.990337 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1398/2795] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 18:10:14 2022] PUT /identity/v3/projects/95c6c762b17a4d38b89b12257843e9f2/users/3b38128abeee48c285ff18702d226eb7/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:10:14.994463 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05efdb71-da6e-41e1-a501-68ee6d1a76e5 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:10:15.000418 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:10:15.007057 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05efdb71-da6e-41e1-a501-68ee6d1a76e5 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:10:15.065213 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1173aa85-7c77-4532-b08d-17d6361e68f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:10:15.065917 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1173aa85-7c77-4532-b08d-17d6361e68f3 admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:10:15.066204 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1173aa85-7c77-4532-b08d-17d6361e68f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:10:15.066483 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1173aa85-7c77-4532-b08d-17d6361e68f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:10:15.067210 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1173aa85-7c77-4532-b08d-17d6361e68f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:10:15.068799 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1173aa85-7c77-4532-b08d-17d6361e68f3 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:10:15.078597 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1398/2796] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 18:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 18:10:15.082784 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15604b2a-a3c3-4820-b654-dd7be81e7d22 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:10:15.093017 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15604b2a-a3c3-4820-b654-dd7be81e7d22 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:10:15.097736 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0895ad16-c1f2-4339-aa6c-37cd320f7952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:10:15.098620 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0895ad16-c1f2-4339-aa6c-37cd320f7952 admin admin] REQUEST_METHOD: `PUT` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:10:15.098900 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0895ad16-c1f2-4339-aa6c-37cd320f7952 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:10:15.099173 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0895ad16-c1f2-4339-aa6c-37cd320f7952 admin admin] PATH_INFO: `/v3/projects/95c6c762b17a4d38b89b12257843e9f2/users/3b38128abeee48c285ff18702d226eb7/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:10:15.101112 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0895ad16-c1f2-4339-aa6c-37cd320f7952 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95c6c762b17a4d38b89b12257843e9f2, user_id=3b38128abeee48c285ff18702d226eb7, role_id=4651a1cc7b4d4ab7a7a9ca1e77e58e71)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:10:15.103741 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0895ad16-c1f2-4339-aa6c-37cd320f7952 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:10:15.114427 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1399/2797] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 18:10:15 2022] PUT /identity/v3/projects/95c6c762b17a4d38b89b12257843e9f2/users/3b38128abeee48c285ff18702d226eb7/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:10:15.725370 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d830369-4d8b-4133-8dff-06d313f6524e None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:10:15.725779 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d830369-4d8b-4133-8dff-06d313f6524e None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:10:15.726120 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d830369-4d8b-4133-8dff-06d313f6524e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:10:15.752663 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-5d830369-4d8b-4133-8dff-06d313f6524e None None] MFA Rules not processed for user `3b38128abeee48c285ff18702d226eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:10:15.753949 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-5d830369-4d8b-4133-8dff-06d313f6524e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:10:15.827005 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1399/2798] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 18:10:15 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 18:10:16.796455 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0895ad16-c1f2-4339-aa6c-37cd320f7952 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:10:16.798184 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-0895ad16-c1f2-4339-aa6c-37cd320f7952 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:10:16.870084 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d830369-4d8b-4133-8dff-06d313f6524e None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:10:16.877499 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0895ad16-c1f2-4339-aa6c-37cd320f7952 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:10:16.882619 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcb852f-790f-4b62-a9c7-e2251c072cc4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5324ab45f4a4449980dad920278f5034', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:10:16.883273 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb852f-790f-4b62-a9c7-e2251c072cc4 service placement] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:10:16.883566 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb852f-790f-4b62-a9c7-e2251c072cc4 service placement] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:10:16.883845 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb852f-790f-4b62-a9c7-e2251c072cc4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:10:16.885682 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-9dcb852f-790f-4b62-a9c7-e2251c072cc4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:10:16.898019 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcb852f-790f-4b62-a9c7-e2251c072cc4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:10:16.899597 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcb852f-790f-4b62-a9c7-e2251c072cc4 service placement] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:10:16.911606 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1400/2799] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 18:10:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:10:16.935761 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d830369-4d8b-4133-8dff-06d313f6524e None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:10:16.940639 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0c1ba8-53e0-4b8d-9964-59c27c4ac60e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:10:16.941444 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c1ba8-53e0-4b8d-9964-59c27c4ac60e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:10:16.941896 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c1ba8-53e0-4b8d-9964-59c27c4ac60e admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:10:16.942187 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c1ba8-53e0-4b8d-9964-59c27c4ac60e admin admin] PATH_INFO: `/v3/users/30cf3ec10e7e40ca8d02f9ddd30bb166` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:10:16.943404 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0c1ba8-53e0-4b8d-9964-59c27c4ac60e admin admin] RBAC: Authorizing `identity:delete_user(user_id=30cf3ec10e7e40ca8d02f9ddd30bb166)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:10:16.945344 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0c1ba8-53e0-4b8d-9964-59c27c4ac60e admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:10:16.974203 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:10:16.994927 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-1a0c1ba8-53e0-4b8d-9964-59c27c4ac60e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30cf3ec10e7e40ca8d02f9ddd30bb166'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:10:17.001822 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-1a0c1ba8-53e0-4b8d-9964-59c27c4ac60e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30cf3ec10e7e40ca8d02f9ddd30bb166'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:10:17.014106 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-1a0c1ba8-53e0-4b8d-9964-59c27c4ac60e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30cf3ec10e7e40ca8d02f9ddd30bb166'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:10:17.014751 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-1a0c1ba8-53e0-4b8d-9964-59c27c4ac60e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30cf3ec10e7e40ca8d02f9ddd30bb166'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:10:17.015343 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-1a0c1ba8-53e0-4b8d-9964-59c27c4ac60e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30cf3ec10e7e40ca8d02f9ddd30bb166'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:10:17.027294 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1400/2800] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 14 18:10:16 2022] DELETE /identity/v3/users/30cf3ec10e7e40ca8d02f9ddd30bb166 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 18:10:17.198195 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcb852f-790f-4b62-a9c7-e2251c072cc4 service placement] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:10:17.209543 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcb852f-790f-4b62-a9c7-e2251c072cc4 service placement] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:10:17.268904 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff57255-6dd2-4e73-b24e-c503cbbf1f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:10:17.269803 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff57255-6dd2-4e73-b24e-c503cbbf1f9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:10:17.270087 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff57255-6dd2-4e73-b24e-c503cbbf1f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:10:17.270364 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff57255-6dd2-4e73-b24e-c503cbbf1f9f admin admin] PATH_INFO: `/v3/projects/67dc111a228b43a695d5665484de43ad` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:10:17.271551 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff57255-6dd2-4e73-b24e-c503cbbf1f9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=67dc111a228b43a695d5665484de43ad)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:10:17.273439 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff57255-6dd2-4e73-b24e-c503cbbf1f9f admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:10:17.318099 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-fff57255-6dd2-4e73-b24e-c503cbbf1f9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67dc111a228b43a695d5665484de43ad', 'request_id': 'req-fff57255-6dd2-4e73-b24e-c503cbbf1f9f'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:10:17.320002 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:10:17.325088 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-fff57255-6dd2-4e73-b24e-c503cbbf1f9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67dc111a228b43a695d5665484de43ad', 'request_id': 'req-fff57255-6dd2-4e73-b24e-c503cbbf1f9f'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:10:17.333297 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-fff57255-6dd2-4e73-b24e-c503cbbf1f9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67dc111a228b43a695d5665484de43ad', 'request_id': 'req-fff57255-6dd2-4e73-b24e-c503cbbf1f9f'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:10:17.345114 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-fff57255-6dd2-4e73-b24e-c503cbbf1f9f admin admin] The token cache is being invalidate because project 67dc111a228b43a695d5665484de43ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86772) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 18:10:17.345403 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-fff57255-6dd2-4e73-b24e-c503cbbf1f9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:10:17.346361 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-fff57255-6dd2-4e73-b24e-c503cbbf1f9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:10:17.347870 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1401/2801] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 14 18:10:17 2022] DELETE /identity/v3/projects/67dc111a228b43a695d5665484de43ad => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:10:17.351806 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0c1ba8-53e0-4b8d-9964-59c27c4ac60e admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:10:17.353226 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-1a0c1ba8-53e0-4b8d-9964-59c27c4ac60e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:10:17.366261 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0c1ba8-53e0-4b8d-9964-59c27c4ac60e admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:10:17.422112 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee9b450-2df7-4b3b-9f14-10c410e719d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:10:17.422990 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee9b450-2df7-4b3b-9f14-10c410e719d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:10:17.423284 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee9b450-2df7-4b3b-9f14-10c410e719d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:10:17.423551 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee9b450-2df7-4b3b-9f14-10c410e719d3 admin admin] PATH_INFO: `/v3/users/3b38128abeee48c285ff18702d226eb7` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:10:17.424753 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee9b450-2df7-4b3b-9f14-10c410e719d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b38128abeee48c285ff18702d226eb7)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:10:17.426721 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee9b450-2df7-4b3b-9f14-10c410e719d3 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:10:17.474287 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-1ee9b450-2df7-4b3b-9f14-10c410e719d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b38128abeee48c285ff18702d226eb7'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:10:17.481616 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-1ee9b450-2df7-4b3b-9f14-10c410e719d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b38128abeee48c285ff18702d226eb7'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:10:17.493784 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-1ee9b450-2df7-4b3b-9f14-10c410e719d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b38128abeee48c285ff18702d226eb7'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:10:17.494367 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-1ee9b450-2df7-4b3b-9f14-10c410e719d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b38128abeee48c285ff18702d226eb7'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:10:17.494966 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-1ee9b450-2df7-4b3b-9f14-10c410e719d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b38128abeee48c285ff18702d226eb7'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:10:17.507607 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1401/2802] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 14 18:10:17 2022] DELETE /identity/v3/users/3b38128abeee48c285ff18702d226eb7 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:10:17.677126 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff57255-6dd2-4e73-b24e-c503cbbf1f9f admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:10:17.678586 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-fff57255-6dd2-4e73-b24e-c503cbbf1f9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:10:17.694567 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff57255-6dd2-4e73-b24e-c503cbbf1f9f admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:10:17.754060 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8577cd85-f61c-4c97-baef-f2c53e88ac79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:10:17.754841 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577cd85-f61c-4c97-baef-f2c53e88ac79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:10:17.755123 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577cd85-f61c-4c97-baef-f2c53e88ac79 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:10:17.755394 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577cd85-f61c-4c97-baef-f2c53e88ac79 admin admin] PATH_INFO: `/v3/projects/95c6c762b17a4d38b89b12257843e9f2` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:10:17.756566 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8577cd85-f61c-4c97-baef-f2c53e88ac79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95c6c762b17a4d38b89b12257843e9f2)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:10:17.758545 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8577cd85-f61c-4c97-baef-f2c53e88ac79 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:10:17.805207 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-8577cd85-f61c-4c97-baef-f2c53e88ac79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95c6c762b17a4d38b89b12257843e9f2', 'request_id': 'req-8577cd85-f61c-4c97-baef-f2c53e88ac79'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:10:17.811156 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-8577cd85-f61c-4c97-baef-f2c53e88ac79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95c6c762b17a4d38b89b12257843e9f2', 'request_id': 'req-8577cd85-f61c-4c97-baef-f2c53e88ac79'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:10:17.818563 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-8577cd85-f61c-4c97-baef-f2c53e88ac79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95c6c762b17a4d38b89b12257843e9f2', 'request_id': 'req-8577cd85-f61c-4c97-baef-f2c53e88ac79'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:10:17.830527 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-8577cd85-f61c-4c97-baef-f2c53e88ac79 admin admin] The token cache is being invalidate because project 95c6c762b17a4d38b89b12257843e9f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86772) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 18:10:17.830817 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-8577cd85-f61c-4c97-baef-f2c53e88ac79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:10:17.831469 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-8577cd85-f61c-4c97-baef-f2c53e88ac79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:10:17.833009 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1402/2803] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 14 18:10:17 2022] DELETE /identity/v3/projects/95c6c762b17a4d38b89b12257843e9f2 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:10:17.837862 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4dfe0b-f795-4fd7-92b5-ef2b1367ff96 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:10:17.838167 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4dfe0b-f795-4fd7-92b5-ef2b1367ff96 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:10:17.838464 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4dfe0b-f795-4fd7-92b5-ef2b1367ff96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:10:17.857090 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-fc4dfe0b-f795-4fd7-92b5-ef2b1367ff96 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:10:17.858341 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-fc4dfe0b-f795-4fd7-92b5-ef2b1367ff96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:10:17.876386 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:10:17.921496 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1402/2804] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 18:10:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:10:17.930376 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc69fc70-ce16-49f7-bef1-d5859d9a0a59 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:10:17.930826 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc69fc70-ce16-49f7-bef1-d5859d9a0a59 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:10:17.931205 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc69fc70-ce16-49f7-bef1-d5859d9a0a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:10:17.951617 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-fc69fc70-ce16-49f7-bef1-d5859d9a0a59 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:10:17.951617 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-fc69fc70-ce16-49f7-bef1-d5859d9a0a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:10:17.959190 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1403/2805] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 18:10:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:10:17.963419 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4dfe0b-f795-4fd7-92b5-ef2b1367ff96 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:10:17.973494 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4dfe0b-f795-4fd7-92b5-ef2b1367ff96 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:10:17.978027 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceb2059-8825-4ec7-95ba-0347bfb335d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:10:17.978685 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceb2059-8825-4ec7-95ba-0347bfb335d7 admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:10:17.978965 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceb2059-8825-4ec7-95ba-0347bfb335d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:10:17.979241 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceb2059-8825-4ec7-95ba-0347bfb335d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:10:17.979967 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceb2059-8825-4ec7-95ba-0347bfb335d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:10:17.980273 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceb2059-8825-4ec7-95ba-0347bfb335d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:10:17.982395 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceb2059-8825-4ec7-95ba-0347bfb335d7 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:10:17.993818 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1403/2806] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 14 18:10:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:10:17.998656 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc69fc70-ce16-49f7-bef1-d5859d9a0a59 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:10:18.007976 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc69fc70-ce16-49f7-bef1-d5859d9a0a59 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:10:18.012948 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a2e9f7-d74f-4ccc-8738-a127e02378d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:10:18.013726 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a2e9f7-d74f-4ccc-8738-a127e02378d3 admin admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:10:18.014060 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a2e9f7-d74f-4ccc-8738-a127e02378d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:10:18.014332 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a2e9f7-d74f-4ccc-8738-a127e02378d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:10:18.015081 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a2e9f7-d74f-4ccc-8738-a127e02378d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:10:18.016956 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a2e9f7-d74f-4ccc-8738-a127e02378d3 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:10:18.041220 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1404/2807] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 14 18:10:17 2022] POST /identity/v3/projects => generated 363 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 18:10:18.046274 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceb2059-8825-4ec7-95ba-0347bfb335d7 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:10:18.056726 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceb2059-8825-4ec7-95ba-0347bfb335d7 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:10:18.113205 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3eb501-df3e-4e37-9f38-0a07bf4b7bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:10:18.113907 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3eb501-df3e-4e37-9f38-0a07bf4b7bd6 admin admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:10:18.114189 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3eb501-df3e-4e37-9f38-0a07bf4b7bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:10:18.114464 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3eb501-df3e-4e37-9f38-0a07bf4b7bd6 admin admin] PATH_INFO: `/v3/users` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:10:18.115140 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3eb501-df3e-4e37-9f38-0a07bf4b7bd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:10:18.117034 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3eb501-df3e-4e37-9f38-0a07bf4b7bd6 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:10:18.136639 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1404/2808] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 14 18:10:18 2022] POST /identity/v3/users => generated 282 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 18:10:18.141314 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a2e9f7-d74f-4ccc-8738-a127e02378d3 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:10:18.151565 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a2e9f7-d74f-4ccc-8738-a127e02378d3 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:10:18.156854 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1807e63f-ee2a-4dde-99b2-6d818993ce49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:10:18.157561 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1807e63f-ee2a-4dde-99b2-6d818993ce49 admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:10:18.157848 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1807e63f-ee2a-4dde-99b2-6d818993ce49 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:10:18.158124 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1807e63f-ee2a-4dde-99b2-6d818993ce49 admin admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:10:18.158876 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1807e63f-ee2a-4dde-99b2-6d818993ce49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:10:18.160469 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1807e63f-ee2a-4dde-99b2-6d818993ce49 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:10:18.172111 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1405/2809] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 18:10:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 18:10:18.176171 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3eb501-df3e-4e37-9f38-0a07bf4b7bd6 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:10:18.188547 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3eb501-df3e-4e37-9f38-0a07bf4b7bd6 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:10:18.193099 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67ebae3-82dc-4917-bba1-afb5706ad412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:10:18.194024 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ebae3-82dc-4917-bba1-afb5706ad412 admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:10:18.194307 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ebae3-82dc-4917-bba1-afb5706ad412 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:10:18.194580 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ebae3-82dc-4917-bba1-afb5706ad412 admin admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:10:18.195299 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67ebae3-82dc-4917-bba1-afb5706ad412 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:10:18.196868 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67ebae3-82dc-4917-bba1-afb5706ad412 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:10:18.207189 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1405/2810] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 18:10:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 18:10:18.211297 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1807e63f-ee2a-4dde-99b2-6d818993ce49 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:10:18.222091 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1807e63f-ee2a-4dde-99b2-6d818993ce49 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:10:18.227082 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5966a728-e57a-40af-b0ba-fb4392b335a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:10:18.227974 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5966a728-e57a-40af-b0ba-fb4392b335a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:10:18.228274 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5966a728-e57a-40af-b0ba-fb4392b335a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:10:18.228561 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5966a728-e57a-40af-b0ba-fb4392b335a3 admin admin] PATH_INFO: `/v3/projects/7f1ec95e8688450f84b321ca52956e44/users/60302ad8df2647eeae5651ee788e97cb/roles/95d753870f97426cb1ce32e078621a4c` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:10:18.243139 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5966a728-e57a-40af-b0ba-fb4392b335a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f1ec95e8688450f84b321ca52956e44, user_id=60302ad8df2647eeae5651ee788e97cb, role_id=95d753870f97426cb1ce32e078621a4c)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:10:18.246623 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5966a728-e57a-40af-b0ba-fb4392b335a3 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:10:18.259720 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1406/2811] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 18:10:18 2022] PUT /identity/v3/projects/7f1ec95e8688450f84b321ca52956e44/users/60302ad8df2647eeae5651ee788e97cb/roles/95d753870f97426cb1ce32e078621a4c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:10:18.271550 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a668ab9c-9b60-4b86-8bea-6b1a1a252ffe None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:10:18.271942 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a668ab9c-9b60-4b86-8bea-6b1a1a252ffe None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:10:18.272336 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a668ab9c-9b60-4b86-8bea-6b1a1a252ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:10:18.298498 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-a668ab9c-9b60-4b86-8bea-6b1a1a252ffe None None] MFA Rules not processed for user `60302ad8df2647eeae5651ee788e97cb`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:10:18.299683 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-a668ab9c-9b60-4b86-8bea-6b1a1a252ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:10:18.364311 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1406/2812] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 18:10:18 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 18:10:18.368781 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5966a728-e57a-40af-b0ba-fb4392b335a3 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:10:18.378312 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:10:18.432279 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5966a728-e57a-40af-b0ba-fb4392b335a3 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:10:18.437468 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1577c206-9cd9-4e1f-aacc-a52831ed3cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:10:18.438149 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1577c206-9cd9-4e1f-aacc-a52831ed3cc5 admin admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:10:18.438431 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1577c206-9cd9-4e1f-aacc-a52831ed3cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:10:18.438704 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1577c206-9cd9-4e1f-aacc-a52831ed3cc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:10:18.439429 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1577c206-9cd9-4e1f-aacc-a52831ed3cc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:10:18.441310 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1577c206-9cd9-4e1f-aacc-a52831ed3cc5 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:10:18.466988 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1407/2813] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 14 18:10:18 2022] POST /identity/v3/projects => generated 363 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 18:10:18.470944 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a668ab9c-9b60-4b86-8bea-6b1a1a252ffe None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:10:18.481788 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a668ab9c-9b60-4b86-8bea-6b1a1a252ffe None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:10:18.493694 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:10:18.539167 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bae5c3-7333-4cc2-913c-4bffdf6401a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:10:18.539765 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bae5c3-7333-4cc2-913c-4bffdf6401a0 admin admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:10:18.540047 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bae5c3-7333-4cc2-913c-4bffdf6401a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:10:18.540353 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bae5c3-7333-4cc2-913c-4bffdf6401a0 admin admin] PATH_INFO: `/v3/users` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:10:18.541039 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bae5c3-7333-4cc2-913c-4bffdf6401a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:10:18.542966 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bae5c3-7333-4cc2-913c-4bffdf6401a0 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:10:18.564318 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1407/2814] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 14 18:10:18 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 18:10:18.568241 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1577c206-9cd9-4e1f-aacc-a52831ed3cc5 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:10:18.578932 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1577c206-9cd9-4e1f-aacc-a52831ed3cc5 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:10:18.583616 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fddca7-7a4c-4b6c-b6fe-2fda6c948fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:10:18.584278 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fddca7-7a4c-4b6c-b6fe-2fda6c948fdc admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:10:18.584560 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fddca7-7a4c-4b6c-b6fe-2fda6c948fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:10:18.584834 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fddca7-7a4c-4b6c-b6fe-2fda6c948fdc admin admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:10:18.585630 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fddca7-7a4c-4b6c-b6fe-2fda6c948fdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:10:18.587211 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fddca7-7a4c-4b6c-b6fe-2fda6c948fdc admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:10:18.598098 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1408/2815] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 18:10:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 18:10:18.602210 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bae5c3-7333-4cc2-913c-4bffdf6401a0 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:10:18.613006 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bae5c3-7333-4cc2-913c-4bffdf6401a0 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:10:18.617842 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff23ec4-09bd-4f4d-93b0-12a37e974aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:10:18.618769 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff23ec4-09bd-4f4d-93b0-12a37e974aef admin admin] REQUEST_METHOD: `PUT` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:10:18.619046 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff23ec4-09bd-4f4d-93b0-12a37e974aef admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:10:18.619321 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff23ec4-09bd-4f4d-93b0-12a37e974aef admin admin] PATH_INFO: `/v3/projects/1b22e38668f948308a0d9fc9c4183511/users/eb0e8f1cb86648d3a7a18f50da9b77d1/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:10:18.634550 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff23ec4-09bd-4f4d-93b0-12a37e974aef admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b22e38668f948308a0d9fc9c4183511, user_id=eb0e8f1cb86648d3a7a18f50da9b77d1, role_id=4651a1cc7b4d4ab7a7a9ca1e77e58e71)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:10:18.637175 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff23ec4-09bd-4f4d-93b0-12a37e974aef admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:10:18.650364 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1408/2816] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 18:10:18 2022] PUT /identity/v3/projects/1b22e38668f948308a0d9fc9c4183511/users/eb0e8f1cb86648d3a7a18f50da9b77d1/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:10:18.654309 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fddca7-7a4c-4b6c-b6fe-2fda6c948fdc admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:10:18.664604 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fddca7-7a4c-4b6c-b6fe-2fda6c948fdc admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:10:18.720123 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46e681f-a875-42f3-b5db-f39d34c6f153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:10:18.720787 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46e681f-a875-42f3-b5db-f39d34c6f153 admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:10:18.721328 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46e681f-a875-42f3-b5db-f39d34c6f153 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:10:18.721643 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46e681f-a875-42f3-b5db-f39d34c6f153 admin admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:10:18.722377 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46e681f-a875-42f3-b5db-f39d34c6f153 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:10:18.723998 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46e681f-a875-42f3-b5db-f39d34c6f153 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:10:18.734433 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1409/2817] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 18:10:18 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 18:10:18.738817 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff23ec4-09bd-4f4d-93b0-12a37e974aef admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:10:18.749874 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff23ec4-09bd-4f4d-93b0-12a37e974aef admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:10:18.754527 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72357e60-204e-43e8-a975-4716310d65a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:10:18.755422 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72357e60-204e-43e8-a975-4716310d65a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:10:18.755708 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72357e60-204e-43e8-a975-4716310d65a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:10:18.756007 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72357e60-204e-43e8-a975-4716310d65a8 admin admin] PATH_INFO: `/v3/projects/1b22e38668f948308a0d9fc9c4183511/users/eb0e8f1cb86648d3a7a18f50da9b77d1/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:10:18.758061 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72357e60-204e-43e8-a975-4716310d65a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b22e38668f948308a0d9fc9c4183511, user_id=eb0e8f1cb86648d3a7a18f50da9b77d1, role_id=4651a1cc7b4d4ab7a7a9ca1e77e58e71)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:10:18.760732 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72357e60-204e-43e8-a975-4716310d65a8 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:10:18.771962 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1409/2818] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 18:10:18 2022] PUT /identity/v3/projects/1b22e38668f948308a0d9fc9c4183511/users/eb0e8f1cb86648d3a7a18f50da9b77d1/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:10:18.783653 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8344ab-bcde-4038-b3d3-be2f0bd2c3fa None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:10:18.783943 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8344ab-bcde-4038-b3d3-be2f0bd2c3fa None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:10:18.784219 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8344ab-bcde-4038-b3d3-be2f0bd2c3fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:10:18.810531 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-3c8344ab-bcde-4038-b3d3-be2f0bd2c3fa None None] MFA Rules not processed for user `eb0e8f1cb86648d3a7a18f50da9b77d1`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:10:18.811657 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-3c8344ab-bcde-4038-b3d3-be2f0bd2c3fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:10:18.879125 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1410/2819] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 18:10:18 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:10:18.890533 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72357e60-204e-43e8-a975-4716310d65a8 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:10:18.892286 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-72357e60-204e-43e8-a975-4716310d65a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:10:18.950281 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72357e60-204e-43e8-a975-4716310d65a8 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:10:18.953888 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060b3f00-f899-4df7-aea6-67477e87afdf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de55cae1600841889668e36402861203', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:10:18.954551 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b3f00-f899-4df7-aea6-67477e87afdf service cinder] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:10:18.954827 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b3f00-f899-4df7-aea6-67477e87afdf service cinder] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:10:18.955101 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b3f00-f899-4df7-aea6-67477e87afdf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:10:18.964247 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060b3f00-f899-4df7-aea6-67477e87afdf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:10:18.966227 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060b3f00-f899-4df7-aea6-67477e87afdf service cinder] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:10:18.975799 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1410/2820] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 18:10:18 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:10:19.374669 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8344ab-bcde-4038-b3d3-be2f0bd2c3fa None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:10:19.378923 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:10:19.436908 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8344ab-bcde-4038-b3d3-be2f0bd2c3fa None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:10:19.441368 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8e96e6-695c-4764-b651-38a6b416ee44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:10:19.442347 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e96e6-695c-4764-b651-38a6b416ee44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:10:19.442530 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e96e6-695c-4764-b651-38a6b416ee44 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:10:19.442801 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e96e6-695c-4764-b651-38a6b416ee44 admin admin] PATH_INFO: `/v3/users/60302ad8df2647eeae5651ee788e97cb` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:10:19.443970 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8e96e6-695c-4764-b651-38a6b416ee44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60302ad8df2647eeae5651ee788e97cb)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:10:19.445901 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8e96e6-695c-4764-b651-38a6b416ee44 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:10:19.491998 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-0c8e96e6-695c-4764-b651-38a6b416ee44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60302ad8df2647eeae5651ee788e97cb'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:10:19.500168 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-0c8e96e6-695c-4764-b651-38a6b416ee44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60302ad8df2647eeae5651ee788e97cb'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:10:19.506970 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-0c8e96e6-695c-4764-b651-38a6b416ee44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60302ad8df2647eeae5651ee788e97cb'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:10:19.507595 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-0c8e96e6-695c-4764-b651-38a6b416ee44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60302ad8df2647eeae5651ee788e97cb'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:10:19.519312 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-0c8e96e6-695c-4764-b651-38a6b416ee44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60302ad8df2647eeae5651ee788e97cb'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:10:19.525217 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1411/2821] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 14 18:10:19 2022] DELETE /identity/v3/users/60302ad8df2647eeae5651ee788e97cb => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 18:10:19.529742 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9426f3-91e1-4072-88ce-90f0b2466b60 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:10:19.530037 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9426f3-91e1-4072-88ce-90f0b2466b60 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:10:19.530315 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9426f3-91e1-4072-88ce-90f0b2466b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:10:19.548790 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-6e9426f3-91e1-4072-88ce-90f0b2466b60 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:10:19.550032 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-6e9426f3-91e1-4072-88ce-90f0b2466b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:10:19.611966 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1411/2822] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 18:10:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:10:19.622643 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8e96e6-695c-4764-b651-38a6b416ee44 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:10:19.624033 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-0c8e96e6-695c-4764-b651-38a6b416ee44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:10:19.680612 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8e96e6-695c-4764-b651-38a6b416ee44 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:10:19.684814 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ce1f35-05d8-41ae-9822-10626f53eeb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:10:19.685450 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce1f35-05d8-41ae-9822-10626f53eeb2 service neutron] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:10:19.685757 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce1f35-05d8-41ae-9822-10626f53eeb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:10:19.686026 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce1f35-05d8-41ae-9822-10626f53eeb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:10:19.694961 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ce1f35-05d8-41ae-9822-10626f53eeb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:10:19.696372 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ce1f35-05d8-41ae-9822-10626f53eeb2 service neutron] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:10:19.706588 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1412/2823] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 18:10:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:10:19.976398 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9426f3-91e1-4072-88ce-90f0b2466b60 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:10:19.978087 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-6e9426f3-91e1-4072-88ce-90f0b2466b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:10:19.993468 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9426f3-91e1-4072-88ce-90f0b2466b60 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:10:19.998495 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0951da40-7d51-42ba-82ba-ff369805fb16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:10:19.999393 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0951da40-7d51-42ba-82ba-ff369805fb16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:10:19.999674 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0951da40-7d51-42ba-82ba-ff369805fb16 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:10:19.999949 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0951da40-7d51-42ba-82ba-ff369805fb16 admin admin] PATH_INFO: `/v3/projects/7f1ec95e8688450f84b321ca52956e44` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:10:20.001215 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0951da40-7d51-42ba-82ba-ff369805fb16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f1ec95e8688450f84b321ca52956e44)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:10:20.003277 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0951da40-7d51-42ba-82ba-ff369805fb16 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:10:20.012014 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:10:20.051722 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-0951da40-7d51-42ba-82ba-ff369805fb16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f1ec95e8688450f84b321ca52956e44', 'request_id': 'req-0951da40-7d51-42ba-82ba-ff369805fb16'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:10:20.057821 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-0951da40-7d51-42ba-82ba-ff369805fb16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f1ec95e8688450f84b321ca52956e44', 'request_id': 'req-0951da40-7d51-42ba-82ba-ff369805fb16'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:10:20.063387 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-0951da40-7d51-42ba-82ba-ff369805fb16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f1ec95e8688450f84b321ca52956e44', 'request_id': 'req-0951da40-7d51-42ba-82ba-ff369805fb16'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:10:20.076277 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-0951da40-7d51-42ba-82ba-ff369805fb16 admin admin] The token cache is being invalidate because project 7f1ec95e8688450f84b321ca52956e44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86773) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 18:10:20.076562 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-0951da40-7d51-42ba-82ba-ff369805fb16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:10:20.077181 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-0951da40-7d51-42ba-82ba-ff369805fb16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:10:20.078744 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1412/2824] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 14 18:10:19 2022] DELETE /identity/v3/projects/7f1ec95e8688450f84b321ca52956e44 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:10:20.082764 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ce1f35-05d8-41ae-9822-10626f53eeb2 service neutron] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:10:20.093055 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ce1f35-05d8-41ae-9822-10626f53eeb2 service neutron] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:10:20.113455 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:10:20.150518 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de50b05-2d78-4ef0-b023-9a31bbe2b302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:10:20.151394 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de50b05-2d78-4ef0-b023-9a31bbe2b302 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:10:20.151676 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de50b05-2d78-4ef0-b023-9a31bbe2b302 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:10:20.151952 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de50b05-2d78-4ef0-b023-9a31bbe2b302 admin admin] PATH_INFO: `/v3/users/eb0e8f1cb86648d3a7a18f50da9b77d1` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:10:20.153757 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de50b05-2d78-4ef0-b023-9a31bbe2b302 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb0e8f1cb86648d3a7a18f50da9b77d1)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:10:20.155671 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de50b05-2d78-4ef0-b023-9a31bbe2b302 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:10:20.201928 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-6de50b05-2d78-4ef0-b023-9a31bbe2b302 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb0e8f1cb86648d3a7a18f50da9b77d1'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:10:20.209938 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-6de50b05-2d78-4ef0-b023-9a31bbe2b302 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb0e8f1cb86648d3a7a18f50da9b77d1'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:10:20.217752 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-6de50b05-2d78-4ef0-b023-9a31bbe2b302 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb0e8f1cb86648d3a7a18f50da9b77d1'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:10:20.218390 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-6de50b05-2d78-4ef0-b023-9a31bbe2b302 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb0e8f1cb86648d3a7a18f50da9b77d1'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:10:20.230664 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-6de50b05-2d78-4ef0-b023-9a31bbe2b302 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb0e8f1cb86648d3a7a18f50da9b77d1'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:10:20.236640 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1413/2825] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 14 18:10:20 2022] DELETE /identity/v3/users/eb0e8f1cb86648d3a7a18f50da9b77d1 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:10:20.507601 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0951da40-7d51-42ba-82ba-ff369805fb16 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:10:20.509015 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-0951da40-7d51-42ba-82ba-ff369805fb16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:10:20.523274 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0951da40-7d51-42ba-82ba-ff369805fb16 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:10:20.584102 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f77dc0c-e737-4853-bf61-dfe9720ffc50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:10:20.584966 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f77dc0c-e737-4853-bf61-dfe9720ffc50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:10:20.585246 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f77dc0c-e737-4853-bf61-dfe9720ffc50 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:10:20.585521 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f77dc0c-e737-4853-bf61-dfe9720ffc50 admin admin] PATH_INFO: `/v3/projects/1b22e38668f948308a0d9fc9c4183511` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:10:20.586712 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f77dc0c-e737-4853-bf61-dfe9720ffc50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b22e38668f948308a0d9fc9c4183511)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:10:20.588580 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f77dc0c-e737-4853-bf61-dfe9720ffc50 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:10:20.633469 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-0f77dc0c-e737-4853-bf61-dfe9720ffc50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b22e38668f948308a0d9fc9c4183511', 'request_id': 'req-0f77dc0c-e737-4853-bf61-dfe9720ffc50'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:10:20.640155 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-0f77dc0c-e737-4853-bf61-dfe9720ffc50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b22e38668f948308a0d9fc9c4183511', 'request_id': 'req-0f77dc0c-e737-4853-bf61-dfe9720ffc50'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:10:20.645602 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-0f77dc0c-e737-4853-bf61-dfe9720ffc50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b22e38668f948308a0d9fc9c4183511', 'request_id': 'req-0f77dc0c-e737-4853-bf61-dfe9720ffc50'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:10:20.657617 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-0f77dc0c-e737-4853-bf61-dfe9720ffc50 admin admin] The token cache is being invalidate because project 1b22e38668f948308a0d9fc9c4183511 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86773) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 18:10:20.657903 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-0f77dc0c-e737-4853-bf61-dfe9720ffc50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:10:20.658518 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-0f77dc0c-e737-4853-bf61-dfe9720ffc50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:10:20.660032 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1413/2826] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 14 18:10:20 2022] DELETE /identity/v3/projects/1b22e38668f948308a0d9fc9c4183511 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:10:20.664993 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbcd0b9-57a4-485e-a857-6e51f4393a1c None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:10:20.665282 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbcd0b9-57a4-485e-a857-6e51f4393a1c None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:10:20.665648 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbcd0b9-57a4-485e-a857-6e51f4393a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:10:20.685406 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-7dbcd0b9-57a4-485e-a857-6e51f4393a1c None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:10:20.686630 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-7dbcd0b9-57a4-485e-a857-6e51f4393a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:10:20.744016 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1414/2827] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 18:10:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:10:20.752387 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38588f5e-58a5-4516-9ddb-91627d6329d3 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:10:20.752675 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38588f5e-58a5-4516-9ddb-91627d6329d3 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:10:20.752956 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38588f5e-58a5-4516-9ddb-91627d6329d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:10:20.771528 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-38588f5e-58a5-4516-9ddb-91627d6329d3 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:10:20.772720 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-38588f5e-58a5-4516-9ddb-91627d6329d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:10:20.780566 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1414/2828] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 18:10:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:10:20.784759 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbcd0b9-57a4-485e-a857-6e51f4393a1c None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:10:20.794303 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbcd0b9-57a4-485e-a857-6e51f4393a1c None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:10:20.798762 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ad37dc-6d69-4485-ad03-a03800b294dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:10:20.799397 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad37dc-6d69-4485-ad03-a03800b294dd admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:10:20.799675 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad37dc-6d69-4485-ad03-a03800b294dd admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:10:20.799947 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad37dc-6d69-4485-ad03-a03800b294dd admin admin] PATH_INFO: `/v3/domains` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:10:20.800663 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ad37dc-6d69-4485-ad03-a03800b294dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:10:20.800962 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ad37dc-6d69-4485-ad03-a03800b294dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:10:20.802577 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ad37dc-6d69-4485-ad03-a03800b294dd admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:10:20.814602 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1415/2829] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 14 18:10:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:10:20.818893 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38588f5e-58a5-4516-9ddb-91627d6329d3 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:10:20.828801 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38588f5e-58a5-4516-9ddb-91627d6329d3 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:10:20.833550 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713ef6f5-db3d-4adf-bcd7-1212bdf4eb3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:10:20.834222 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713ef6f5-db3d-4adf-bcd7-1212bdf4eb3f admin admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:10:20.834505 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713ef6f5-db3d-4adf-bcd7-1212bdf4eb3f admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:10:20.834781 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713ef6f5-db3d-4adf-bcd7-1212bdf4eb3f admin admin] PATH_INFO: `/v3/projects` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:10:20.835501 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713ef6f5-db3d-4adf-bcd7-1212bdf4eb3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:10:20.837385 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713ef6f5-db3d-4adf-bcd7-1212bdf4eb3f admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:10:20.856980 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:10:20.868259 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1415/2830] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 14 18:10:20 2022] POST /identity/v3/projects => generated 367 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 18:10:20.869403 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ad37dc-6d69-4485-ad03-a03800b294dd admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:10:20.879916 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ad37dc-6d69-4485-ad03-a03800b294dd admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:10:20.908066 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:10:20.947122 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4715f2-dc78-41b3-abde-fcd704c2272c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:10:20.947799 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4715f2-dc78-41b3-abde-fcd704c2272c admin admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:10:20.948064 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4715f2-dc78-41b3-abde-fcd704c2272c admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:10:20.948336 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4715f2-dc78-41b3-abde-fcd704c2272c admin admin] PATH_INFO: `/v3/users` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:10:20.949009 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4715f2-dc78-41b3-abde-fcd704c2272c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:10:20.950917 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4715f2-dc78-41b3-abde-fcd704c2272c admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:10:20.970852 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1416/2831] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 14 18:10:20 2022] POST /identity/v3/users => generated 284 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 18:10:20.975292 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713ef6f5-db3d-4adf-bcd7-1212bdf4eb3f admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:10:20.985923 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713ef6f5-db3d-4adf-bcd7-1212bdf4eb3f admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:10:20.990463 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a1e1b1-ac29-42bc-a6ae-151bd7e45263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:10:20.991121 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1e1b1-ac29-42bc-a6ae-151bd7e45263 admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:10:20.991400 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1e1b1-ac29-42bc-a6ae-151bd7e45263 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:10:20.991673 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1e1b1-ac29-42bc-a6ae-151bd7e45263 admin admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:10:20.992396 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a1e1b1-ac29-42bc-a6ae-151bd7e45263 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:10:20.994008 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a1e1b1-ac29-42bc-a6ae-151bd7e45263 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:10:21.004799 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1416/2832] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 18:10:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 18:10:21.008651 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4715f2-dc78-41b3-abde-fcd704c2272c admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:10:21.018944 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4715f2-dc78-41b3-abde-fcd704c2272c admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:10:21.023589 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d229e91a-1efc-4f04-acfb-472baf6446aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:10:21.024241 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d229e91a-1efc-4f04-acfb-472baf6446aa admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:10:21.024520 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d229e91a-1efc-4f04-acfb-472baf6446aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:10:21.024789 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d229e91a-1efc-4f04-acfb-472baf6446aa admin admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:10:21.025503 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d229e91a-1efc-4f04-acfb-472baf6446aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:10:21.027099 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d229e91a-1efc-4f04-acfb-472baf6446aa admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:10:21.036810 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1417/2833] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 18:10:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 18:10:21.040805 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a1e1b1-ac29-42bc-a6ae-151bd7e45263 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:10:21.051557 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a1e1b1-ac29-42bc-a6ae-151bd7e45263 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:10:21.056157 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c320cba-c4b5-4878-8448-f73cfefd41a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:10:21.057027 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c320cba-c4b5-4878-8448-f73cfefd41a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:10:21.057305 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c320cba-c4b5-4878-8448-f73cfefd41a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:10:21.057608 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c320cba-c4b5-4878-8448-f73cfefd41a4 admin admin] PATH_INFO: `/v3/projects/632326a79b834f2a96fa390016b5d005/users/19de8f7673264249afd4badd83ca3849/roles/95d753870f97426cb1ce32e078621a4c` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:10:21.072716 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c320cba-c4b5-4878-8448-f73cfefd41a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=632326a79b834f2a96fa390016b5d005, user_id=19de8f7673264249afd4badd83ca3849, role_id=95d753870f97426cb1ce32e078621a4c)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:10:21.075403 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c320cba-c4b5-4878-8448-f73cfefd41a4 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:10:21.088086 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1417/2834] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 18:10:21 2022] PUT /identity/v3/projects/632326a79b834f2a96fa390016b5d005/users/19de8f7673264249afd4badd83ca3849/roles/95d753870f97426cb1ce32e078621a4c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:10:21.149032 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef36ec5-e52f-49c0-87fb-f1c21457a140 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:10:21.149636 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef36ec5-e52f-49c0-87fb-f1c21457a140 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:10:21.149636 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef36ec5-e52f-49c0-87fb-f1c21457a140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:10:21.176481 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-fef36ec5-e52f-49c0-87fb-f1c21457a140 None None] MFA Rules not processed for user `19de8f7673264249afd4badd83ca3849`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:10:21.177789 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-fef36ec5-e52f-49c0-87fb-f1c21457a140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:10:21.241047 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1418/2835] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 18:10:21 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:10:21.245773 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c320cba-c4b5-4878-8448-f73cfefd41a4 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:10:21.305902 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c320cba-c4b5-4878-8448-f73cfefd41a4 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:10:21.310865 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f439098-ce60-4561-8bb1-29eb11e17708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:10:21.311513 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f439098-ce60-4561-8bb1-29eb11e17708 admin admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:10:21.311791 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f439098-ce60-4561-8bb1-29eb11e17708 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:10:21.312066 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f439098-ce60-4561-8bb1-29eb11e17708 admin admin] PATH_INFO: `/v3/projects` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:10:21.312749 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f439098-ce60-4561-8bb1-29eb11e17708 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:10:21.314668 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f439098-ce60-4561-8bb1-29eb11e17708 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:10:21.340868 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1418/2836] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 14 18:10:21 2022] POST /identity/v3/projects => generated 367 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 18:10:21.344850 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef36ec5-e52f-49c0-87fb-f1c21457a140 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:10:21.356609 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef36ec5-e52f-49c0-87fb-f1c21457a140 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:10:21.412311 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a43e8d8-3c0b-4953-b25e-b676517927dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:10:21.412972 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a43e8d8-3c0b-4953-b25e-b676517927dd admin admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:10:21.413256 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a43e8d8-3c0b-4953-b25e-b676517927dd admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:10:21.413555 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a43e8d8-3c0b-4953-b25e-b676517927dd admin admin] PATH_INFO: `/v3/users` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:10:21.414268 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a43e8d8-3c0b-4953-b25e-b676517927dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:10:21.416168 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a43e8d8-3c0b-4953-b25e-b676517927dd admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:10:21.436782 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1419/2837] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 14 18:10:21 2022] POST /identity/v3/users => generated 290 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 18:10:21.441089 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f439098-ce60-4561-8bb1-29eb11e17708 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:10:21.451260 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f439098-ce60-4561-8bb1-29eb11e17708 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:10:21.455833 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcab8d8-d197-4831-80c1-26002ccdc2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:10:21.456502 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcab8d8-d197-4831-80c1-26002ccdc2cb admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:10:21.456781 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcab8d8-d197-4831-80c1-26002ccdc2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:10:21.457056 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcab8d8-d197-4831-80c1-26002ccdc2cb admin admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:10:21.457819 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcab8d8-d197-4831-80c1-26002ccdc2cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:10:21.459626 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcab8d8-d197-4831-80c1-26002ccdc2cb admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:10:21.471544 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1419/2838] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 18:10:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 18:10:21.476171 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a43e8d8-3c0b-4953-b25e-b676517927dd admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:10:21.486718 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a43e8d8-3c0b-4953-b25e-b676517927dd admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:10:21.491286 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28204a39-533c-4ddb-bfd0-0ea247191dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:10:21.492165 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28204a39-533c-4ddb-bfd0-0ea247191dd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:10:21.492450 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28204a39-533c-4ddb-bfd0-0ea247191dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:10:21.492728 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28204a39-533c-4ddb-bfd0-0ea247191dd2 admin admin] PATH_INFO: `/v3/projects/285a96e2f27c476eb04d3f157c4deebf/users/871ff3df57814f4ba26cbb894ca9c1af/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:10:21.509034 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28204a39-533c-4ddb-bfd0-0ea247191dd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=285a96e2f27c476eb04d3f157c4deebf, user_id=871ff3df57814f4ba26cbb894ca9c1af, role_id=4651a1cc7b4d4ab7a7a9ca1e77e58e71)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:10:21.511841 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28204a39-533c-4ddb-bfd0-0ea247191dd2 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:10:21.524865 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1420/2839] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 18:10:21 2022] PUT /identity/v3/projects/285a96e2f27c476eb04d3f157c4deebf/users/871ff3df57814f4ba26cbb894ca9c1af/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:10:21.529261 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcab8d8-d197-4831-80c1-26002ccdc2cb admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:10:21.539098 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcab8d8-d197-4831-80c1-26002ccdc2cb admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:10:21.596770 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bf528b-b876-403a-b08c-5f7e268986a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:10:21.597432 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bf528b-b876-403a-b08c-5f7e268986a8 admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:10:21.597743 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bf528b-b876-403a-b08c-5f7e268986a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:10:21.598019 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bf528b-b876-403a-b08c-5f7e268986a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:10:21.598741 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bf528b-b876-403a-b08c-5f7e268986a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:10:21.600342 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bf528b-b876-403a-b08c-5f7e268986a8 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:10:21.610598 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1420/2840] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 18:10:21 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 18:10:21.614802 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28204a39-533c-4ddb-bfd0-0ea247191dd2 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:10:21.621318 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:10:21.625208 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28204a39-533c-4ddb-bfd0-0ea247191dd2 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:10:21.631030 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c560cf8e-1a19-4323-bb6d-9411f15890fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:10:21.631929 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c560cf8e-1a19-4323-bb6d-9411f15890fc admin admin] REQUEST_METHOD: `PUT` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:10:21.632206 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c560cf8e-1a19-4323-bb6d-9411f15890fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:10:21.632476 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c560cf8e-1a19-4323-bb6d-9411f15890fc admin admin] PATH_INFO: `/v3/projects/285a96e2f27c476eb04d3f157c4deebf/users/871ff3df57814f4ba26cbb894ca9c1af/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:10:21.634640 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c560cf8e-1a19-4323-bb6d-9411f15890fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=285a96e2f27c476eb04d3f157c4deebf, user_id=871ff3df57814f4ba26cbb894ca9c1af, role_id=4651a1cc7b4d4ab7a7a9ca1e77e58e71)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:10:21.637644 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c560cf8e-1a19-4323-bb6d-9411f15890fc admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:10:21.647558 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1421/2841] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 18:10:21 2022] PUT /identity/v3/projects/285a96e2f27c476eb04d3f157c4deebf/users/871ff3df57814f4ba26cbb894ca9c1af/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:10:21.658263 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c90cfc5-09d4-44e8-95d3-439f28838544 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:10:21.658561 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c90cfc5-09d4-44e8-95d3-439f28838544 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:10:21.658842 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c90cfc5-09d4-44e8-95d3-439f28838544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:10:21.684309 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-6c90cfc5-09d4-44e8-95d3-439f28838544 None None] MFA Rules not processed for user `871ff3df57814f4ba26cbb894ca9c1af`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:10:21.685514 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-6c90cfc5-09d4-44e8-95d3-439f28838544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:10:21.705408 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:10:21.753417 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1421/2842] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 18:10:21 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:10:21.765111 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c560cf8e-1a19-4323-bb6d-9411f15890fc admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:10:21.766842 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-c560cf8e-1a19-4323-bb6d-9411f15890fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:10:21.824920 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c560cf8e-1a19-4323-bb6d-9411f15890fc admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:10:21.828654 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02453f93-ae3f-4f03-a46e-20c3c76256d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de55cae1600841889668e36402861203', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:10:21.829298 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02453f93-ae3f-4f03-a46e-20c3c76256d2 service cinder] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:10:21.829612 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02453f93-ae3f-4f03-a46e-20c3c76256d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:10:21.829893 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02453f93-ae3f-4f03-a46e-20c3c76256d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:10:21.839342 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02453f93-ae3f-4f03-a46e-20c3c76256d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:10:21.840815 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02453f93-ae3f-4f03-a46e-20c3c76256d2 service cinder] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:10:21.850412 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1422/2843] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 18:10:21 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:10:21.930628 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c90cfc5-09d4-44e8-95d3-439f28838544 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:10:21.940963 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c90cfc5-09d4-44e8-95d3-439f28838544 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:10:21.944569 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2217a9d-6ec8-4c55-a49c-d9e36bb81ee6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de55cae1600841889668e36402861203', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:10:21.945206 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2217a9d-6ec8-4c55-a49c-d9e36bb81ee6 service cinder] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:10:21.945490 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2217a9d-6ec8-4c55-a49c-d9e36bb81ee6 service cinder] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:10:21.945799 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2217a9d-6ec8-4c55-a49c-d9e36bb81ee6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:10:22.004187 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2217a9d-6ec8-4c55-a49c-d9e36bb81ee6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:10:22.005553 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2217a9d-6ec8-4c55-a49c-d9e36bb81ee6 service cinder] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:10:22.014621 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1422/2844] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 18:10:21 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:10:26.662517 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02453f93-ae3f-4f03-a46e-20c3c76256d2 service cinder] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:10:26.724164 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02453f93-ae3f-4f03-a46e-20c3c76256d2 service cinder] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:10:26.728618 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513e84e4-569f-419c-9668-53c72ab069fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:10:26.729479 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e84e4-569f-419c-9668-53c72ab069fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:10:26.729792 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e84e4-569f-419c-9668-53c72ab069fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:10:26.730066 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e84e4-569f-419c-9668-53c72ab069fc admin admin] PATH_INFO: `/v3/users/19de8f7673264249afd4badd83ca3849` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:10:26.731842 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513e84e4-569f-419c-9668-53c72ab069fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=19de8f7673264249afd4badd83ca3849)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:10:26.733785 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513e84e4-569f-419c-9668-53c72ab069fc admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:10:26.780041 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-513e84e4-569f-419c-9668-53c72ab069fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19de8f7673264249afd4badd83ca3849'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:10:26.786721 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-513e84e4-569f-419c-9668-53c72ab069fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19de8f7673264249afd4badd83ca3849'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:10:26.794352 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-513e84e4-569f-419c-9668-53c72ab069fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19de8f7673264249afd4badd83ca3849'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:10:26.794989 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-513e84e4-569f-419c-9668-53c72ab069fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19de8f7673264249afd4badd83ca3849'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:10:26.806692 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-513e84e4-569f-419c-9668-53c72ab069fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19de8f7673264249afd4badd83ca3849'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:10:26.812480 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1423/2845] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 14 18:10:26 2022] DELETE /identity/v3/users/19de8f7673264249afd4badd83ca3849 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:10:26.817195 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee5fc81-b817-44d6-81d8-bb8f19a16576 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:10:26.817726 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee5fc81-b817-44d6-81d8-bb8f19a16576 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:10:26.817830 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee5fc81-b817-44d6-81d8-bb8f19a16576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:10:26.834811 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-3ee5fc81-b817-44d6-81d8-bb8f19a16576 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:10:26.835996 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-3ee5fc81-b817-44d6-81d8-bb8f19a16576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:10:26.894766 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1423/2846] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 18:10:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:10:26.904749 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513e84e4-569f-419c-9668-53c72ab069fc admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:10:26.906172 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-513e84e4-569f-419c-9668-53c72ab069fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:10:26.921161 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:10:26.968954 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513e84e4-569f-419c-9668-53c72ab069fc admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:10:26.972842 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128f018a-bcaf-4c28-adcf-53e6fc2c86e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:10:26.973467 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128f018a-bcaf-4c28-adcf-53e6fc2c86e4 service neutron] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:10:26.973839 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128f018a-bcaf-4c28-adcf-53e6fc2c86e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:10:26.974116 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128f018a-bcaf-4c28-adcf-53e6fc2c86e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:10:26.983074 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128f018a-bcaf-4c28-adcf-53e6fc2c86e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:10:26.984454 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128f018a-bcaf-4c28-adcf-53e6fc2c86e4 service neutron] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:10:26.994169 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1424/2847] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 18:10:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:10:27.262322 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee5fc81-b817-44d6-81d8-bb8f19a16576 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:10:27.264372 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-3ee5fc81-b817-44d6-81d8-bb8f19a16576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:10:27.276463 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee5fc81-b817-44d6-81d8-bb8f19a16576 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:10:27.281149 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c6e635-9952-4ddf-8567-0658917fc447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:10:27.282049 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c6e635-9952-4ddf-8567-0658917fc447 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:10:27.282330 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c6e635-9952-4ddf-8567-0658917fc447 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:10:27.282603 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c6e635-9952-4ddf-8567-0658917fc447 admin admin] PATH_INFO: `/v3/projects/632326a79b834f2a96fa390016b5d005` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:10:27.283817 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c6e635-9952-4ddf-8567-0658917fc447 admin admin] RBAC: Authorizing `identity:delete_project(project_id=632326a79b834f2a96fa390016b5d005)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:10:27.285772 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c6e635-9952-4ddf-8567-0658917fc447 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:10:27.338016 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-09c6e635-9952-4ddf-8567-0658917fc447 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '632326a79b834f2a96fa390016b5d005', 'request_id': 'req-09c6e635-9952-4ddf-8567-0658917fc447'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:10:27.339911 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:10:27.346317 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-09c6e635-9952-4ddf-8567-0658917fc447 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '632326a79b834f2a96fa390016b5d005', 'request_id': 'req-09c6e635-9952-4ddf-8567-0658917fc447'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:10:27.352085 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-09c6e635-9952-4ddf-8567-0658917fc447 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '632326a79b834f2a96fa390016b5d005', 'request_id': 'req-09c6e635-9952-4ddf-8567-0658917fc447'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:10:27.364129 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-09c6e635-9952-4ddf-8567-0658917fc447 admin admin] The token cache is being invalidate because project 632326a79b834f2a96fa390016b5d005 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86773) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 18:10:27.364425 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-09c6e635-9952-4ddf-8567-0658917fc447 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:10:27.365040 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-09c6e635-9952-4ddf-8567-0658917fc447 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:10:27.366612 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1424/2848] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 14 18:10:27 2022] DELETE /identity/v3/projects/632326a79b834f2a96fa390016b5d005 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:10:27.370574 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128f018a-bcaf-4c28-adcf-53e6fc2c86e4 service neutron] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:10:27.381308 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128f018a-bcaf-4c28-adcf-53e6fc2c86e4 service neutron] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:10:27.436685 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34788d1e-3cd0-419b-968c-b0fe72197e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:10:27.437581 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34788d1e-3cd0-419b-968c-b0fe72197e8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:10:27.437868 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34788d1e-3cd0-419b-968c-b0fe72197e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:10:27.438147 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34788d1e-3cd0-419b-968c-b0fe72197e8b admin admin] PATH_INFO: `/v3/users/871ff3df57814f4ba26cbb894ca9c1af` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:10:27.439328 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34788d1e-3cd0-419b-968c-b0fe72197e8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=871ff3df57814f4ba26cbb894ca9c1af)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:10:27.441240 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34788d1e-3cd0-419b-968c-b0fe72197e8b admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:10:27.487510 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-34788d1e-3cd0-419b-968c-b0fe72197e8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '871ff3df57814f4ba26cbb894ca9c1af'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:10:27.494096 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-34788d1e-3cd0-419b-968c-b0fe72197e8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '871ff3df57814f4ba26cbb894ca9c1af'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:10:27.501963 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-34788d1e-3cd0-419b-968c-b0fe72197e8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '871ff3df57814f4ba26cbb894ca9c1af'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:10:27.502603 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-34788d1e-3cd0-419b-968c-b0fe72197e8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '871ff3df57814f4ba26cbb894ca9c1af'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:10:27.514868 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-34788d1e-3cd0-419b-968c-b0fe72197e8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '871ff3df57814f4ba26cbb894ca9c1af'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:10:27.520677 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1425/2849] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 14 18:10:27 2022] DELETE /identity/v3/users/871ff3df57814f4ba26cbb894ca9c1af => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:10:27.796894 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c6e635-9952-4ddf-8567-0658917fc447 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:10:27.798718 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-09c6e635-9952-4ddf-8567-0658917fc447 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:10:27.813208 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c6e635-9952-4ddf-8567-0658917fc447 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:10:27.872477 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65be9903-2466-454b-9dd0-4a4ce775d353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:10:27.873432 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be9903-2466-454b-9dd0-4a4ce775d353 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:10:27.873756 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be9903-2466-454b-9dd0-4a4ce775d353 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:10:27.874037 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be9903-2466-454b-9dd0-4a4ce775d353 admin admin] PATH_INFO: `/v3/projects/285a96e2f27c476eb04d3f157c4deebf` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:10:27.875328 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65be9903-2466-454b-9dd0-4a4ce775d353 admin admin] RBAC: Authorizing `identity:delete_project(project_id=285a96e2f27c476eb04d3f157c4deebf)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:10:27.877254 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65be9903-2466-454b-9dd0-4a4ce775d353 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:10:27.929466 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-65be9903-2466-454b-9dd0-4a4ce775d353 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '285a96e2f27c476eb04d3f157c4deebf', 'request_id': 'req-65be9903-2466-454b-9dd0-4a4ce775d353'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:10:27.937139 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-65be9903-2466-454b-9dd0-4a4ce775d353 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '285a96e2f27c476eb04d3f157c4deebf', 'request_id': 'req-65be9903-2466-454b-9dd0-4a4ce775d353'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:10:27.942832 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-65be9903-2466-454b-9dd0-4a4ce775d353 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '285a96e2f27c476eb04d3f157c4deebf', 'request_id': 'req-65be9903-2466-454b-9dd0-4a4ce775d353'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:10:27.955178 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-65be9903-2466-454b-9dd0-4a4ce775d353 admin admin] The token cache is being invalidate because project 285a96e2f27c476eb04d3f157c4deebf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86773) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 18:10:27.955467 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-65be9903-2466-454b-9dd0-4a4ce775d353 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:10:27.956083 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-65be9903-2466-454b-9dd0-4a4ce775d353 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:10:27.957715 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1425/2850] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 14 18:10:27 2022] DELETE /identity/v3/projects/285a96e2f27c476eb04d3f157c4deebf => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:10:27.962600 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfde575-1fc4-4dd5-80e8-9ccdf4d57e21 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:10:27.963678 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfde575-1fc4-4dd5-80e8-9ccdf4d57e21 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:10:27.963678 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfde575-1fc4-4dd5-80e8-9ccdf4d57e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:10:27.982649 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-dbfde575-1fc4-4dd5-80e8-9ccdf4d57e21 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:10:27.983839 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-dbfde575-1fc4-4dd5-80e8-9ccdf4d57e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:10:28.012720 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:10:28.044239 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1426/2851] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 18:10:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 18:10:28.052711 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67ad51-0707-42af-b096-b3ca6db6f893 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:10:28.053025 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67ad51-0707-42af-b096-b3ca6db6f893 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:10:28.053303 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67ad51-0707-42af-b096-b3ca6db6f893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:10:28.071332 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-ce67ad51-0707-42af-b096-b3ca6db6f893 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:10:28.072524 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-ce67ad51-0707-42af-b096-b3ca6db6f893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:10:28.080434 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1426/2852] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 18:10:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 18:10:28.084566 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfde575-1fc4-4dd5-80e8-9ccdf4d57e21 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:10:28.094782 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfde575-1fc4-4dd5-80e8-9ccdf4d57e21 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:10:28.099803 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84580af6-7094-43d2-ae6a-81abc174190b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:10:28.100447 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84580af6-7094-43d2-ae6a-81abc174190b admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:10:28.100730 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84580af6-7094-43d2-ae6a-81abc174190b admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:10:28.101016 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84580af6-7094-43d2-ae6a-81abc174190b admin admin] PATH_INFO: `/v3/domains` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:10:28.101761 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84580af6-7094-43d2-ae6a-81abc174190b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:10:28.102065 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84580af6-7094-43d2-ae6a-81abc174190b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:10:28.103660 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84580af6-7094-43d2-ae6a-81abc174190b admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:10:28.116000 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1427/2853] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 14 18:10:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:10:28.120090 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce67ad51-0707-42af-b096-b3ca6db6f893 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:10:28.129755 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce67ad51-0707-42af-b096-b3ca6db6f893 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:10:28.134435 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9df915-ec87-49a4-97d5-e630931ac0c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:10:28.135106 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9df915-ec87-49a4-97d5-e630931ac0c7 admin admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:10:28.135390 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9df915-ec87-49a4-97d5-e630931ac0c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:10:28.135675 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9df915-ec87-49a4-97d5-e630931ac0c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:10:28.136399 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9df915-ec87-49a4-97d5-e630931ac0c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:10:28.138343 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9df915-ec87-49a4-97d5-e630931ac0c7 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:10:28.164914 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1427/2854] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 14 18:10:28 2022] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 18:10:28.169738 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84580af6-7094-43d2-ae6a-81abc174190b admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:10:28.180235 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84580af6-7094-43d2-ae6a-81abc174190b admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:10:28.235558 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6a4e4f-ac33-415e-b194-7bb2e8593621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:10:28.236227 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6a4e4f-ac33-415e-b194-7bb2e8593621 admin admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:10:28.236508 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6a4e4f-ac33-415e-b194-7bb2e8593621 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:10:28.236783 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6a4e4f-ac33-415e-b194-7bb2e8593621 admin admin] PATH_INFO: `/v3/users` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:10:28.237476 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6a4e4f-ac33-415e-b194-7bb2e8593621 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:10:28.239403 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6a4e4f-ac33-415e-b194-7bb2e8593621 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:10:28.258885 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1428/2855] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 14 18:10:28 2022] POST /identity/v3/users => generated 286 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 18:10:28.262938 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9df915-ec87-49a4-97d5-e630931ac0c7 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:10:28.273006 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9df915-ec87-49a4-97d5-e630931ac0c7 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:10:28.277697 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aa2dc0-1ad9-4c60-ac0a-92a0d6430e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:10:28.279090 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aa2dc0-1ad9-4c60-ac0a-92a0d6430e40 admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:10:28.279376 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aa2dc0-1ad9-4c60-ac0a-92a0d6430e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:10:28.279656 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aa2dc0-1ad9-4c60-ac0a-92a0d6430e40 admin admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:10:28.280381 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aa2dc0-1ad9-4c60-ac0a-92a0d6430e40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:10:28.282008 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aa2dc0-1ad9-4c60-ac0a-92a0d6430e40 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:10:28.292191 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1428/2856] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 18:10:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 18:10:28.296828 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6a4e4f-ac33-415e-b194-7bb2e8593621 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:10:28.306351 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6a4e4f-ac33-415e-b194-7bb2e8593621 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:10:28.310900 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d5dc89-392b-4cff-b514-b7972fcd7455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:10:28.311542 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d5dc89-392b-4cff-b514-b7972fcd7455 admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:10:28.311822 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d5dc89-392b-4cff-b514-b7972fcd7455 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:10:28.312094 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d5dc89-392b-4cff-b514-b7972fcd7455 admin admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:10:28.312818 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d5dc89-392b-4cff-b514-b7972fcd7455 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:10:28.314398 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d5dc89-392b-4cff-b514-b7972fcd7455 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:10:28.323915 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1429/2857] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 18:10:28 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 18:10:28.328476 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aa2dc0-1ad9-4c60-ac0a-92a0d6430e40 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:10:28.338246 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aa2dc0-1ad9-4c60-ac0a-92a0d6430e40 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:10:28.343361 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c958485e-ec60-4c82-bed1-a85499c77ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:10:28.344492 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c958485e-ec60-4c82-bed1-a85499c77ea5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:10:28.344782 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c958485e-ec60-4c82-bed1-a85499c77ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:10:28.345058 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c958485e-ec60-4c82-bed1-a85499c77ea5 admin admin] PATH_INFO: `/v3/projects/4a272020524242778113079d713ba9f8/users/ee9ea8f51a9b41a4864380f18d6c98a2/roles/95d753870f97426cb1ce32e078621a4c` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:10:28.360106 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c958485e-ec60-4c82-bed1-a85499c77ea5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a272020524242778113079d713ba9f8, user_id=ee9ea8f51a9b41a4864380f18d6c98a2, role_id=95d753870f97426cb1ce32e078621a4c)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:10:28.362782 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c958485e-ec60-4c82-bed1-a85499c77ea5 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:10:28.375736 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1429/2858] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 18:10:28 2022] PUT /identity/v3/projects/4a272020524242778113079d713ba9f8/users/ee9ea8f51a9b41a4864380f18d6c98a2/roles/95d753870f97426cb1ce32e078621a4c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:10:28.380914 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e60262e-249c-4671-b2c1-456d5fba669a None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:10:28.381199 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e60262e-249c-4671-b2c1-456d5fba669a None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:10:28.381491 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e60262e-249c-4671-b2c1-456d5fba669a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:10:28.399305 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-5e60262e-249c-4671-b2c1-456d5fba669a None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:10:28.400490 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-5e60262e-249c-4671-b2c1-456d5fba669a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:10:28.458594 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1430/2859] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 18:10:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:10:28.468827 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c958485e-ec60-4c82-bed1-a85499c77ea5 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:10:28.470572 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-c958485e-ec60-4c82-bed1-a85499c77ea5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:10:28.480683 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:10:28.529898 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c958485e-ec60-4c82-bed1-a85499c77ea5 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:10:28.533640 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228c304e-36db-416b-9a4f-21b565bbd9ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:10:28.534289 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228c304e-36db-416b-9a4f-21b565bbd9ac service neutron] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:10:28.534574 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228c304e-36db-416b-9a4f-21b565bbd9ac service neutron] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:10:28.534849 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228c304e-36db-416b-9a4f-21b565bbd9ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:10:28.543946 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228c304e-36db-416b-9a4f-21b565bbd9ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:10:28.545367 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228c304e-36db-416b-9a4f-21b565bbd9ac service neutron] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:10:28.554847 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1430/2860] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 18:10:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:10:29.452509 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea32ef-5e35-490b-aa88-7f93022aaa5f None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:10:29.453052 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea32ef-5e35-490b-aa88-7f93022aaa5f None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:10:29.453186 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea32ef-5e35-490b-aa88-7f93022aaa5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:10:29.484734 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-dcea32ef-5e35-490b-aa88-7f93022aaa5f None None] MFA Rules not processed for user `ee9ea8f51a9b41a4864380f18d6c98a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:10:29.486066 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-dcea32ef-5e35-490b-aa88-7f93022aaa5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:10:29.518618 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:10:29.557382 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1431/2861] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 18:10:29 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:10:29.561762 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228c304e-36db-416b-9a4f-21b565bbd9ac service neutron] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:10:29.571885 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228c304e-36db-416b-9a4f-21b565bbd9ac service neutron] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:10:29.577352 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d827926c-f849-4289-9a0b-138013f3775f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:10:29.578137 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d827926c-f849-4289-9a0b-138013f3775f admin admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:10:29.578483 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d827926c-f849-4289-9a0b-138013f3775f admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:10:29.578875 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d827926c-f849-4289-9a0b-138013f3775f admin admin] PATH_INFO: `/v3/projects` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:10:29.579643 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d827926c-f849-4289-9a0b-138013f3775f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:10:29.581629 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d827926c-f849-4289-9a0b-138013f3775f admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:10:29.609348 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1431/2862] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 14 18:10:29 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 18:10:29.613341 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcea32ef-5e35-490b-aa88-7f93022aaa5f None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:10:29.624373 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcea32ef-5e35-490b-aa88-7f93022aaa5f None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:10:29.681395 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13acb882-c595-4496-8a3e-af023e6feb07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:10:29.682102 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13acb882-c595-4496-8a3e-af023e6feb07 admin admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:10:29.682385 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13acb882-c595-4496-8a3e-af023e6feb07 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:10:29.682660 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13acb882-c595-4496-8a3e-af023e6feb07 admin admin] PATH_INFO: `/v3/users` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:10:29.683342 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13acb882-c595-4496-8a3e-af023e6feb07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:10:29.685295 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13acb882-c595-4496-8a3e-af023e6feb07 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:10:29.704742 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1432/2863] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 14 18:10:29 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 18:10:29.708722 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d827926c-f849-4289-9a0b-138013f3775f admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:10:29.719550 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d827926c-f849-4289-9a0b-138013f3775f admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:10:29.724385 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c105d4fe-8d01-4b2c-a56d-3259f5b62cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:10:29.725044 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c105d4fe-8d01-4b2c-a56d-3259f5b62cc8 admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:10:29.725328 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c105d4fe-8d01-4b2c-a56d-3259f5b62cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:10:29.725628 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c105d4fe-8d01-4b2c-a56d-3259f5b62cc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:10:29.726355 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c105d4fe-8d01-4b2c-a56d-3259f5b62cc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:10:29.727941 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c105d4fe-8d01-4b2c-a56d-3259f5b62cc8 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:10:29.739163 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1432/2864] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 18:10:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 18:10:29.743335 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13acb882-c595-4496-8a3e-af023e6feb07 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:10:29.753654 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13acb882-c595-4496-8a3e-af023e6feb07 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:10:29.758295 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fe2d6d-0179-4f7f-97b4-d33a8d651836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:10:29.759170 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fe2d6d-0179-4f7f-97b4-d33a8d651836 admin admin] REQUEST_METHOD: `PUT` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:10:29.759460 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fe2d6d-0179-4f7f-97b4-d33a8d651836 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:10:29.759740 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fe2d6d-0179-4f7f-97b4-d33a8d651836 admin admin] PATH_INFO: `/v3/projects/e3fe15e706764b21ac2c7afe109f1c03/users/471754f3c25c42138ba25f8822e852ff/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:10:29.774151 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fe2d6d-0179-4f7f-97b4-d33a8d651836 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3fe15e706764b21ac2c7afe109f1c03, user_id=471754f3c25c42138ba25f8822e852ff, role_id=4651a1cc7b4d4ab7a7a9ca1e77e58e71)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:10:29.776822 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fe2d6d-0179-4f7f-97b4-d33a8d651836 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:10:29.790130 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1433/2865] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 18:10:29 2022] PUT /identity/v3/projects/e3fe15e706764b21ac2c7afe109f1c03/users/471754f3c25c42138ba25f8822e852ff/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:10:29.794691 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c105d4fe-8d01-4b2c-a56d-3259f5b62cc8 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:10:29.804569 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c105d4fe-8d01-4b2c-a56d-3259f5b62cc8 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:10:29.861545 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de74143-128a-4c4d-8d24-b3a26607c54d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:10:29.862235 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de74143-128a-4c4d-8d24-b3a26607c54d admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:10:29.862516 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de74143-128a-4c4d-8d24-b3a26607c54d admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:10:29.862790 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de74143-128a-4c4d-8d24-b3a26607c54d admin admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:10:29.863515 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de74143-128a-4c4d-8d24-b3a26607c54d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:10:29.865120 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de74143-128a-4c4d-8d24-b3a26607c54d admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:10:29.875109 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1433/2866] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 18:10:29 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 18:10:29.879248 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fe2d6d-0179-4f7f-97b4-d33a8d651836 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:10:29.889761 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fe2d6d-0179-4f7f-97b4-d33a8d651836 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:10:29.894288 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca4eca0-4704-4369-a131-8c325ab036b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:10:29.895154 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca4eca0-4704-4369-a131-8c325ab036b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:10:29.895434 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca4eca0-4704-4369-a131-8c325ab036b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:10:29.895706 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca4eca0-4704-4369-a131-8c325ab036b8 admin admin] PATH_INFO: `/v3/projects/e3fe15e706764b21ac2c7afe109f1c03/users/471754f3c25c42138ba25f8822e852ff/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:10:29.897696 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca4eca0-4704-4369-a131-8c325ab036b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3fe15e706764b21ac2c7afe109f1c03, user_id=471754f3c25c42138ba25f8822e852ff, role_id=4651a1cc7b4d4ab7a7a9ca1e77e58e71)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:10:29.900285 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca4eca0-4704-4369-a131-8c325ab036b8 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:10:29.912198 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1434/2867] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 18:10:29 2022] PUT /identity/v3/projects/e3fe15e706764b21ac2c7afe109f1c03/users/471754f3c25c42138ba25f8822e852ff/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:10:30.535821 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af21cdc8-9e3a-4e3a-acd9-730a89179a77 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:10:30.536116 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af21cdc8-9e3a-4e3a-acd9-730a89179a77 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:10:30.536394 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af21cdc8-9e3a-4e3a-acd9-730a89179a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:10:30.562943 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-af21cdc8-9e3a-4e3a-acd9-730a89179a77 None None] MFA Rules not processed for user `471754f3c25c42138ba25f8822e852ff`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:10:30.564186 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-af21cdc8-9e3a-4e3a-acd9-730a89179a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:10:30.630324 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:10:30.641855 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1434/2868] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 18:10:30 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:10:30.647890 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9389ad-5d52-47ab-8425-ba78cf7d58dd None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:10:30.648387 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9389ad-5d52-47ab-8425-ba78cf7d58dd None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:10:30.648516 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9389ad-5d52-47ab-8425-ba78cf7d58dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:10:30.667801 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-ac9389ad-5d52-47ab-8425-ba78cf7d58dd None None] MFA Rules not processed for user `ee9ea8f51a9b41a4864380f18d6c98a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:10:30.668346 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-ac9389ad-5d52-47ab-8425-ba78cf7d58dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:10:30.724510 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1435/2869] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 18:10:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:10:30.737585 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af21cdc8-9e3a-4e3a-acd9-730a89179a77 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:10:30.739600 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-af21cdc8-9e3a-4e3a-acd9-730a89179a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:10:30.812370 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af21cdc8-9e3a-4e3a-acd9-730a89179a77 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:10:30.817780 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931132d4-20cc-4df7-8e20-64abf4bf36d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41b893bdf4ec474dbfa819c22fc29ce9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:10:30.818438 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931132d4-20cc-4df7-8e20-64abf4bf36d5 service nova] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:10:30.818712 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931132d4-20cc-4df7-8e20-64abf4bf36d5 service nova] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:10:30.818984 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931132d4-20cc-4df7-8e20-64abf4bf36d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:10:30.827385 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931132d4-20cc-4df7-8e20-64abf4bf36d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:10:30.828959 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931132d4-20cc-4df7-8e20-64abf4bf36d5 service nova] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:10:30.837970 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1435/2870] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 18:10:30 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:10:30.868922 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9389ad-5d52-47ab-8425-ba78cf7d58dd None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:10:30.870340 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-ac9389ad-5d52-47ab-8425-ba78cf7d58dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:10:30.905557 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:10:30.952713 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9389ad-5d52-47ab-8425-ba78cf7d58dd None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:10:30.956497 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50241fb1-ce58-4b78-88de-b0f686fca57b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eb7180aab4541b4aab6cf8648eac1f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:10:30.957136 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50241fb1-ce58-4b78-88de-b0f686fca57b service glance] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:10:30.957423 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50241fb1-ce58-4b78-88de-b0f686fca57b service glance] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:10:30.957727 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50241fb1-ce58-4b78-88de-b0f686fca57b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:10:30.959498 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-50241fb1-ce58-4b78-88de-b0f686fca57b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:10:30.973965 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50241fb1-ce58-4b78-88de-b0f686fca57b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:10:30.975365 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50241fb1-ce58-4b78-88de-b0f686fca57b service glance] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:10:30.986165 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1436/2871] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 18:10:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:10:31.503639 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931132d4-20cc-4df7-8e20-64abf4bf36d5 service nova] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:10:31.565509 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931132d4-20cc-4df7-8e20-64abf4bf36d5 service nova] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:10:31.569119 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c07851-a27a-4559-a4cf-ebc479b5d42f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:10:31.569795 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c07851-a27a-4559-a4cf-ebc479b5d42f service neutron] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:10:31.570080 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c07851-a27a-4559-a4cf-ebc479b5d42f service neutron] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:10:31.570347 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c07851-a27a-4559-a4cf-ebc479b5d42f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:10:31.572187 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-57c07851-a27a-4559-a4cf-ebc479b5d42f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:10:31.586143 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c07851-a27a-4559-a4cf-ebc479b5d42f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:10:31.587589 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c07851-a27a-4559-a4cf-ebc479b5d42f service neutron] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:10:31.599178 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1436/2872] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 18:10:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:10:40.981252 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=22 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:10:41.594593 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=61 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:10:44.860193 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50241fb1-ce58-4b78-88de-b0f686fca57b service glance] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:10:44.861640 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-50241fb1-ce58-4b78-88de-b0f686fca57b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:10:44.917214 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50241fb1-ce58-4b78-88de-b0f686fca57b service glance] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:10:44.921174 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b7c2ff-04f0-4532-b2f1-22db0419b2c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de55cae1600841889668e36402861203', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:10:44.921852 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b7c2ff-04f0-4532-b2f1-22db0419b2c1 service cinder] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:10:44.922135 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b7c2ff-04f0-4532-b2f1-22db0419b2c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:10:44.922409 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b7c2ff-04f0-4532-b2f1-22db0419b2c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:10:44.931431 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b7c2ff-04f0-4532-b2f1-22db0419b2c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:10:44.932840 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b7c2ff-04f0-4532-b2f1-22db0419b2c1 service cinder] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:10:44.942299 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1437/2873] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 18:10:44 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:10:54.938070 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=26 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:11:04.539418 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c07851-a27a-4559-a4cf-ebc479b5d42f service neutron] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:11:04.601955 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c07851-a27a-4559-a4cf-ebc479b5d42f service neutron] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:11:04.606478 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11ae007-97ca-4a26-93dd-03f8ebddfeb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:11:04.607350 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ae007-97ca-4a26-93dd-03f8ebddfeb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:11:04.607629 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ae007-97ca-4a26-93dd-03f8ebddfeb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:11:04.607905 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ae007-97ca-4a26-93dd-03f8ebddfeb1 admin admin] PATH_INFO: `/v3/users/ee9ea8f51a9b41a4864380f18d6c98a2` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:11:04.609084 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11ae007-97ca-4a26-93dd-03f8ebddfeb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee9ea8f51a9b41a4864380f18d6c98a2)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:11:04.611068 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11ae007-97ca-4a26-93dd-03f8ebddfeb1 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:11:04.655883 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-e11ae007-97ca-4a26-93dd-03f8ebddfeb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee9ea8f51a9b41a4864380f18d6c98a2'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:11:04.662264 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-e11ae007-97ca-4a26-93dd-03f8ebddfeb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee9ea8f51a9b41a4864380f18d6c98a2'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:11:04.675021 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-e11ae007-97ca-4a26-93dd-03f8ebddfeb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee9ea8f51a9b41a4864380f18d6c98a2'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:11:04.675647 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-e11ae007-97ca-4a26-93dd-03f8ebddfeb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee9ea8f51a9b41a4864380f18d6c98a2'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:11:04.676234 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-e11ae007-97ca-4a26-93dd-03f8ebddfeb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee9ea8f51a9b41a4864380f18d6c98a2'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:11:04.688827 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1437/2874] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 14 18:11:04 2022] DELETE /identity/v3/users/ee9ea8f51a9b41a4864380f18d6c98a2 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:11:04.864832 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b7c2ff-04f0-4532-b2f1-22db0419b2c1 service cinder] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:11:04.876124 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b7c2ff-04f0-4532-b2f1-22db0419b2c1 service cinder] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:11:04.936496 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8b2d96-2332-45fb-a301-5c81fd394378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:11:04.937277 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8b2d96-2332-45fb-a301-5c81fd394378 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:11:04.937584 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8b2d96-2332-45fb-a301-5c81fd394378 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:11:04.937861 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8b2d96-2332-45fb-a301-5c81fd394378 admin admin] PATH_INFO: `/v3/projects/4a272020524242778113079d713ba9f8` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:11:04.939668 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8b2d96-2332-45fb-a301-5c81fd394378 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a272020524242778113079d713ba9f8)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:11:04.941574 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8b2d96-2332-45fb-a301-5c81fd394378 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:11:04.985709 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-2b8b2d96-2332-45fb-a301-5c81fd394378 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a272020524242778113079d713ba9f8', 'request_id': 'req-2b8b2d96-2332-45fb-a301-5c81fd394378'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:11:04.990985 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-2b8b2d96-2332-45fb-a301-5c81fd394378 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a272020524242778113079d713ba9f8', 'request_id': 'req-2b8b2d96-2332-45fb-a301-5c81fd394378'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:11:04.998656 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-2b8b2d96-2332-45fb-a301-5c81fd394378 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a272020524242778113079d713ba9f8', 'request_id': 'req-2b8b2d96-2332-45fb-a301-5c81fd394378'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:11:05.010473 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-2b8b2d96-2332-45fb-a301-5c81fd394378 admin admin] The token cache is being invalidate because project 4a272020524242778113079d713ba9f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86772) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 18:11:05.010780 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-2b8b2d96-2332-45fb-a301-5c81fd394378 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:11:05.011411 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-2b8b2d96-2332-45fb-a301-5c81fd394378 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:11:05.013006 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1438/2875] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 14 18:11:04 2022] DELETE /identity/v3/projects/4a272020524242778113079d713ba9f8 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:11:05.017160 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11ae007-97ca-4a26-93dd-03f8ebddfeb1 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:11:05.018582 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-e11ae007-97ca-4a26-93dd-03f8ebddfeb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:11:05.031347 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11ae007-97ca-4a26-93dd-03f8ebddfeb1 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:11:05.086287 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ad9104-ee6b-44e1-854a-e7702b381635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:11:05.087156 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ad9104-ee6b-44e1-854a-e7702b381635 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:11:05.087433 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ad9104-ee6b-44e1-854a-e7702b381635 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:11:05.087711 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ad9104-ee6b-44e1-854a-e7702b381635 admin admin] PATH_INFO: `/v3/users/471754f3c25c42138ba25f8822e852ff` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:11:05.088897 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ad9104-ee6b-44e1-854a-e7702b381635 admin admin] RBAC: Authorizing `identity:delete_user(user_id=471754f3c25c42138ba25f8822e852ff)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:11:05.090836 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ad9104-ee6b-44e1-854a-e7702b381635 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:11:05.112724 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:11:05.137283 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-11ad9104-ee6b-44e1-854a-e7702b381635 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '471754f3c25c42138ba25f8822e852ff'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:11:05.144930 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-11ad9104-ee6b-44e1-854a-e7702b381635 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '471754f3c25c42138ba25f8822e852ff'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:11:05.157030 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-11ad9104-ee6b-44e1-854a-e7702b381635 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '471754f3c25c42138ba25f8822e852ff'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:11:05.157719 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-11ad9104-ee6b-44e1-854a-e7702b381635 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '471754f3c25c42138ba25f8822e852ff'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:11:05.158422 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-11ad9104-ee6b-44e1-854a-e7702b381635 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '471754f3c25c42138ba25f8822e852ff'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:11:05.170382 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1438/2876] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 14 18:11:05 2022] DELETE /identity/v3/users/471754f3c25c42138ba25f8822e852ff => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:11:05.341992 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8b2d96-2332-45fb-a301-5c81fd394378 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:11:05.343425 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-2b8b2d96-2332-45fb-a301-5c81fd394378 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:11:05.357477 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8b2d96-2332-45fb-a301-5c81fd394378 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:11:05.416099 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8880f88-fb24-49c5-b230-c1530c9d4b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:11:05.416961 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8880f88-fb24-49c5-b230-c1530c9d4b5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:11:05.417236 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8880f88-fb24-49c5-b230-c1530c9d4b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:11:05.417505 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8880f88-fb24-49c5-b230-c1530c9d4b5a admin admin] PATH_INFO: `/v3/projects/e3fe15e706764b21ac2c7afe109f1c03` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:11:05.418706 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8880f88-fb24-49c5-b230-c1530c9d4b5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3fe15e706764b21ac2c7afe109f1c03)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:11:05.420587 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8880f88-fb24-49c5-b230-c1530c9d4b5a admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:11:05.463649 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:11:05.479294 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-d8880f88-fb24-49c5-b230-c1530c9d4b5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3fe15e706764b21ac2c7afe109f1c03', 'request_id': 'req-d8880f88-fb24-49c5-b230-c1530c9d4b5a'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:11:05.486050 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-d8880f88-fb24-49c5-b230-c1530c9d4b5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3fe15e706764b21ac2c7afe109f1c03', 'request_id': 'req-d8880f88-fb24-49c5-b230-c1530c9d4b5a'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:11:05.494482 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-d8880f88-fb24-49c5-b230-c1530c9d4b5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3fe15e706764b21ac2c7afe109f1c03', 'request_id': 'req-d8880f88-fb24-49c5-b230-c1530c9d4b5a'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:11:05.505918 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-d8880f88-fb24-49c5-b230-c1530c9d4b5a admin admin] The token cache is being invalidate because project e3fe15e706764b21ac2c7afe109f1c03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86772) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 18:11:05.506212 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-d8880f88-fb24-49c5-b230-c1530c9d4b5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:11:05.506826 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-d8880f88-fb24-49c5-b230-c1530c9d4b5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:11:05.508342 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1439/2877] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 14 18:11:05 2022] DELETE /identity/v3/projects/e3fe15e706764b21ac2c7afe109f1c03 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:11:05.513334 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af2c25-b7fa-4785-8e87-66004c3d1de1 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:11:05.513650 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af2c25-b7fa-4785-8e87-66004c3d1de1 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:11:05.513937 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af2c25-b7fa-4785-8e87-66004c3d1de1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:11:05.531314 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-05af2c25-b7fa-4785-8e87-66004c3d1de1 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:11:05.533004 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-05af2c25-b7fa-4785-8e87-66004c3d1de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:11:05.593643 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1439/2878] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 18:11:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:11:05.602181 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc0e47e-1aac-47ec-aac0-ecbf42c640e7 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:11:05.602467 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc0e47e-1aac-47ec-aac0-ecbf42c640e7 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:11:05.602743 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc0e47e-1aac-47ec-aac0-ecbf42c640e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:11:05.621229 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-dcc0e47e-1aac-47ec-aac0-ecbf42c640e7 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:11:05.622443 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-dcc0e47e-1aac-47ec-aac0-ecbf42c640e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:11:05.630296 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1440/2879] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 18:11:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:11:05.634595 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05af2c25-b7fa-4785-8e87-66004c3d1de1 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:11:05.644465 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05af2c25-b7fa-4785-8e87-66004c3d1de1 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:11:05.649053 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eedd2f-e02b-41f7-b861-6a04ed2dbb1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:11:05.649761 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eedd2f-e02b-41f7-b861-6a04ed2dbb1e admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:11:05.650043 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eedd2f-e02b-41f7-b861-6a04ed2dbb1e admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:11:05.650442 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eedd2f-e02b-41f7-b861-6a04ed2dbb1e admin admin] PATH_INFO: `/v3/domains` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:11:05.651188 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eedd2f-e02b-41f7-b861-6a04ed2dbb1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86773) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:11:05.651494 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eedd2f-e02b-41f7-b861-6a04ed2dbb1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:11:05.653109 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eedd2f-e02b-41f7-b861-6a04ed2dbb1e admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:11:05.665816 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1440/2880] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 14 18:11:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 18:11:05.670236 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc0e47e-1aac-47ec-aac0-ecbf42c640e7 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:11:05.680480 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc0e47e-1aac-47ec-aac0-ecbf42c640e7 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:11:05.685244 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c8bbe0-1550-48fe-b77d-600224ce99ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:11:05.686049 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c8bbe0-1550-48fe-b77d-600224ce99ae admin admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:11:05.686402 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c8bbe0-1550-48fe-b77d-600224ce99ae admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:11:05.686745 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c8bbe0-1550-48fe-b77d-600224ce99ae admin admin] PATH_INFO: `/v3/projects` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:11:05.687553 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c8bbe0-1550-48fe-b77d-600224ce99ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:11:05.689599 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c8bbe0-1550-48fe-b77d-600224ce99ae admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:11:05.722396 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1441/2881] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 14 18:11:05 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 18:11:05.723858 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eedd2f-e02b-41f7-b861-6a04ed2dbb1e admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:11:05.735051 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eedd2f-e02b-41f7-b861-6a04ed2dbb1e admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:11:05.795512 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d434f2c-150b-4b6a-a553-78db0897c015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:11:05.796195 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d434f2c-150b-4b6a-a553-78db0897c015 admin admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:11:05.796477 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d434f2c-150b-4b6a-a553-78db0897c015 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:11:05.796755 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d434f2c-150b-4b6a-a553-78db0897c015 admin admin] PATH_INFO: `/v3/users` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:11:05.797495 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d434f2c-150b-4b6a-a553-78db0897c015 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:11:05.799507 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d434f2c-150b-4b6a-a553-78db0897c015 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:11:05.823578 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1441/2882] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 14 18:11:05 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 18:11:05.824885 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c8bbe0-1550-48fe-b77d-600224ce99ae admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:11:05.836595 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c8bbe0-1550-48fe-b77d-600224ce99ae admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:11:05.841322 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9c265b-803b-4cc8-aa0f-2ab519536fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:11:05.841932 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9c265b-803b-4cc8-aa0f-2ab519536fc4 admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:11:05.842214 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9c265b-803b-4cc8-aa0f-2ab519536fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:11:05.842490 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9c265b-803b-4cc8-aa0f-2ab519536fc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:11:05.843227 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9c265b-803b-4cc8-aa0f-2ab519536fc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:11:05.845645 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9c265b-803b-4cc8-aa0f-2ab519536fc4 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:11:05.856300 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1442/2883] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 18:11:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 18:11:05.860249 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d434f2c-150b-4b6a-a553-78db0897c015 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:11:05.879137 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d434f2c-150b-4b6a-a553-78db0897c015 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:11:05.884285 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59a173b-9193-4290-abbc-b02b548b3974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:11:05.884997 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a173b-9193-4290-abbc-b02b548b3974 admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:11:05.885280 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a173b-9193-4290-abbc-b02b548b3974 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:11:05.885580 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a173b-9193-4290-abbc-b02b548b3974 admin admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:11:05.886318 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59a173b-9193-4290-abbc-b02b548b3974 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:11:05.888017 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59a173b-9193-4290-abbc-b02b548b3974 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:11:05.899252 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1442/2884] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 18:11:05 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 18:11:05.903275 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9c265b-803b-4cc8-aa0f-2ab519536fc4 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:11:05.914455 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9c265b-803b-4cc8-aa0f-2ab519536fc4 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:11:05.920356 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0ee11a-ab38-427c-b1c5-e49fe4cf873c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:11:05.921250 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ee11a-ab38-427c-b1c5-e49fe4cf873c admin admin] REQUEST_METHOD: `PUT` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:11:05.921575 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ee11a-ab38-427c-b1c5-e49fe4cf873c admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:11:05.921829 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ee11a-ab38-427c-b1c5-e49fe4cf873c admin admin] PATH_INFO: `/v3/projects/c1d1985de00949db8b2fe1b1cffa4afb/users/77443cebfbc8434e9c9d26cd4eb7fea4/roles/95d753870f97426cb1ce32e078621a4c` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:11:05.937079 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0ee11a-ab38-427c-b1c5-e49fe4cf873c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1d1985de00949db8b2fe1b1cffa4afb, user_id=77443cebfbc8434e9c9d26cd4eb7fea4, role_id=95d753870f97426cb1ce32e078621a4c)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:11:05.939798 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0ee11a-ab38-427c-b1c5-e49fe4cf873c admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:11:05.953052 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1443/2885] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 18:11:05 2022] PUT /identity/v3/projects/c1d1985de00949db8b2fe1b1cffa4afb/users/77443cebfbc8434e9c9d26cd4eb7fea4/roles/95d753870f97426cb1ce32e078621a4c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:11:05.963808 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ea9847-868c-4066-9cb4-6e85dcd1b534 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:11:05.964099 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ea9847-868c-4066-9cb4-6e85dcd1b534 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:11:05.964377 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ea9847-868c-4066-9cb4-6e85dcd1b534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:11:05.972084 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:11:05.995582 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-89ea9847-868c-4066-9cb4-6e85dcd1b534 None None] MFA Rules not processed for user `77443cebfbc8434e9c9d26cd4eb7fea4`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:11:05.997033 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-89ea9847-868c-4066-9cb4-6e85dcd1b534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:11:06.073547 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1443/2886] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 18:11:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:11:06.079255 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0ee11a-ab38-427c-b1c5-e49fe4cf873c admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:11:06.148069 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0ee11a-ab38-427c-b1c5-e49fe4cf873c admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:11:06.153163 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d9f537-56db-4a53-8742-e235d44e05e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:11:06.153828 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d9f537-56db-4a53-8742-e235d44e05e9 admin admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:11:06.154201 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d9f537-56db-4a53-8742-e235d44e05e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:11:06.154429 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d9f537-56db-4a53-8742-e235d44e05e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:11:06.155208 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d9f537-56db-4a53-8742-e235d44e05e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:11:06.157515 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d9f537-56db-4a53-8742-e235d44e05e9 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:11:06.184351 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1444/2887] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 14 18:11:06 2022] POST /identity/v3/projects => generated 377 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 18:11:06.189129 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ea9847-868c-4066-9cb4-6e85dcd1b534 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:11:06.200191 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ea9847-868c-4066-9cb4-6e85dcd1b534 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:11:06.259637 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86e6565-f8b4-41dd-8898-b890bf52dcf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:11:06.260222 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e6565-f8b4-41dd-8898-b890bf52dcf8 admin admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:11:06.260507 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e6565-f8b4-41dd-8898-b890bf52dcf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:11:06.260786 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e6565-f8b4-41dd-8898-b890bf52dcf8 admin admin] PATH_INFO: `/v3/users` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:11:06.261506 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86e6565-f8b4-41dd-8898-b890bf52dcf8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:11:06.263468 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86e6565-f8b4-41dd-8898-b890bf52dcf8 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:11:06.284700 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1444/2888] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 14 18:11:06 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 18:11:06.288765 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d9f537-56db-4a53-8742-e235d44e05e9 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:11:06.299301 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d9f537-56db-4a53-8742-e235d44e05e9 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:11:06.303910 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56392f47-feed-4790-a743-22315df40f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:11:06.304577 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56392f47-feed-4790-a743-22315df40f40 admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:11:06.304857 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56392f47-feed-4790-a743-22315df40f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:11:06.305154 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56392f47-feed-4790-a743-22315df40f40 admin admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:11:06.305919 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56392f47-feed-4790-a743-22315df40f40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:11:06.307507 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56392f47-feed-4790-a743-22315df40f40 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:11:06.319247 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1445/2889] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 18:11:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 18:11:06.323510 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86e6565-f8b4-41dd-8898-b890bf52dcf8 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:11:06.334817 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86e6565-f8b4-41dd-8898-b890bf52dcf8 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:11:06.339604 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc88ede6-6a3d-4540-be78-89107b5632a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:11:06.340276 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc88ede6-6a3d-4540-be78-89107b5632a9 admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:11:06.340555 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc88ede6-6a3d-4540-be78-89107b5632a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:11:06.340827 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc88ede6-6a3d-4540-be78-89107b5632a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:11:06.341587 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc88ede6-6a3d-4540-be78-89107b5632a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:11:06.343182 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc88ede6-6a3d-4540-be78-89107b5632a9 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:11:06.353875 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1445/2890] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 18:11:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 18:11:06.358078 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56392f47-feed-4790-a743-22315df40f40 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:11:06.368186 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56392f47-feed-4790-a743-22315df40f40 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:11:06.372876 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d33396-c086-4662-b7cd-b6de96c2d09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:11:06.373787 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d33396-c086-4662-b7cd-b6de96c2d09d admin admin] REQUEST_METHOD: `PUT` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:11:06.374065 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d33396-c086-4662-b7cd-b6de96c2d09d admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:11:06.374337 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d33396-c086-4662-b7cd-b6de96c2d09d admin admin] PATH_INFO: `/v3/projects/48263da6c1d849838c5b8812870613c9/users/da35a313f5fc483d8426d0e641abef80/roles/95d753870f97426cb1ce32e078621a4c` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:11:06.389727 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d33396-c086-4662-b7cd-b6de96c2d09d admin admin] RBAC: Authorizing `identity:create_grant(project_id=48263da6c1d849838c5b8812870613c9, user_id=da35a313f5fc483d8426d0e641abef80, role_id=95d753870f97426cb1ce32e078621a4c)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:11:06.393017 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d33396-c086-4662-b7cd-b6de96c2d09d admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:11:06.406329 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1446/2891] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 18:11:06 2022] PUT /identity/v3/projects/48263da6c1d849838c5b8812870613c9/users/da35a313f5fc483d8426d0e641abef80/roles/95d753870f97426cb1ce32e078621a4c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:11:06.416927 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0fbcd2-1df5-45df-a389-38d8f7557395 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:11:06.417262 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0fbcd2-1df5-45df-a389-38d8f7557395 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:11:06.417480 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0fbcd2-1df5-45df-a389-38d8f7557395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:11:06.447203 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-cb0fbcd2-1df5-45df-a389-38d8f7557395 None None] MFA Rules not processed for user `da35a313f5fc483d8426d0e641abef80`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:11:06.448544 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-cb0fbcd2-1df5-45df-a389-38d8f7557395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:11:06.516351 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1446/2892] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 18:11:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:11:06.520887 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d33396-c086-4662-b7cd-b6de96c2d09d admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:11:06.529921 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:11:06.583892 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d33396-c086-4662-b7cd-b6de96c2d09d admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:11:06.588744 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d180e4a-ddb4-498e-a71c-166933f0b07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:11:06.589398 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d180e4a-ddb4-498e-a71c-166933f0b07f admin admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:11:06.589711 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d180e4a-ddb4-498e-a71c-166933f0b07f admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:11:06.589984 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d180e4a-ddb4-498e-a71c-166933f0b07f admin admin] PATH_INFO: `/v3/projects` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:11:06.590671 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d180e4a-ddb4-498e-a71c-166933f0b07f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:11:06.592610 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d180e4a-ddb4-498e-a71c-166933f0b07f admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:11:06.628154 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1447/2893] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 14 18:11:06 2022] POST /identity/v3/projects => generated 375 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 18:11:06.632582 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0fbcd2-1df5-45df-a389-38d8f7557395 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:11:06.638228 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:11:06.644882 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0fbcd2-1df5-45df-a389-38d8f7557395 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:11:06.699645 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb2fa7d-11fe-44c8-a9bf-47d08df0e87f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:11:06.700315 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb2fa7d-11fe-44c8-a9bf-47d08df0e87f admin admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:11:06.700599 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb2fa7d-11fe-44c8-a9bf-47d08df0e87f admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:11:06.700875 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb2fa7d-11fe-44c8-a9bf-47d08df0e87f admin admin] PATH_INFO: `/v3/users` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:11:06.701586 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb2fa7d-11fe-44c8-a9bf-47d08df0e87f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:11:06.703501 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb2fa7d-11fe-44c8-a9bf-47d08df0e87f admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:11:06.735594 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1447/2894] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 14 18:11:06 2022] POST /identity/v3/users => generated 294 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 18:11:06.739674 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d180e4a-ddb4-498e-a71c-166933f0b07f admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:11:06.750110 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d180e4a-ddb4-498e-a71c-166933f0b07f admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:11:06.757630 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4b84d2-b4ee-45dc-a52c-feac5e808526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:11:06.758298 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4b84d2-b4ee-45dc-a52c-feac5e808526 admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:11:06.758580 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4b84d2-b4ee-45dc-a52c-feac5e808526 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:11:06.758855 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4b84d2-b4ee-45dc-a52c-feac5e808526 admin admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:11:06.759581 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4b84d2-b4ee-45dc-a52c-feac5e808526 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:11:06.761160 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4b84d2-b4ee-45dc-a52c-feac5e808526 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:11:06.771325 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1448/2895] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 18:11:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 18:11:06.775352 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb2fa7d-11fe-44c8-a9bf-47d08df0e87f admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:11:06.785328 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb2fa7d-11fe-44c8-a9bf-47d08df0e87f admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:11:06.790074 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f342556a-d173-4073-841f-111e8ba2a036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:11:06.790955 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f342556a-d173-4073-841f-111e8ba2a036 admin admin] REQUEST_METHOD: `PUT` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:11:06.791229 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f342556a-d173-4073-841f-111e8ba2a036 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:11:06.791503 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f342556a-d173-4073-841f-111e8ba2a036 admin admin] PATH_INFO: `/v3/projects/3adb5e224dfd4c7b85f78dfe215536ce/users/e9f674d32b0d438f861265b488b9255a/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:11:06.806805 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f342556a-d173-4073-841f-111e8ba2a036 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3adb5e224dfd4c7b85f78dfe215536ce, user_id=e9f674d32b0d438f861265b488b9255a, role_id=4651a1cc7b4d4ab7a7a9ca1e77e58e71)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:11:06.809598 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f342556a-d173-4073-841f-111e8ba2a036 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:11:06.823929 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1448/2896] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 18:11:06 2022] PUT /identity/v3/projects/3adb5e224dfd4c7b85f78dfe215536ce/users/e9f674d32b0d438f861265b488b9255a/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 18:11:06.827839 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4b84d2-b4ee-45dc-a52c-feac5e808526 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:11:06.838689 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4b84d2-b4ee-45dc-a52c-feac5e808526 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:11:06.895310 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd9ea53-017d-4870-bf0d-1332cb819203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:11:06.895983 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd9ea53-017d-4870-bf0d-1332cb819203 admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:11:06.896266 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd9ea53-017d-4870-bf0d-1332cb819203 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:11:06.896543 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd9ea53-017d-4870-bf0d-1332cb819203 admin admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:11:06.897274 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd9ea53-017d-4870-bf0d-1332cb819203 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:11:06.898894 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd9ea53-017d-4870-bf0d-1332cb819203 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:11:06.909198 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1449/2897] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 18:11:06 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 18:11:06.913286 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f342556a-d173-4073-841f-111e8ba2a036 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:11:06.924928 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f342556a-d173-4073-841f-111e8ba2a036 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:11:06.929565 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55185df8-44da-4acc-b044-683d726b9843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:11:06.930451 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55185df8-44da-4acc-b044-683d726b9843 admin admin] REQUEST_METHOD: `PUT` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:11:06.930736 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55185df8-44da-4acc-b044-683d726b9843 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:11:06.931013 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55185df8-44da-4acc-b044-683d726b9843 admin admin] PATH_INFO: `/v3/projects/3adb5e224dfd4c7b85f78dfe215536ce/users/e9f674d32b0d438f861265b488b9255a/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:11:06.933018 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55185df8-44da-4acc-b044-683d726b9843 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3adb5e224dfd4c7b85f78dfe215536ce, user_id=e9f674d32b0d438f861265b488b9255a, role_id=4651a1cc7b4d4ab7a7a9ca1e77e58e71)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:11:06.935679 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55185df8-44da-4acc-b044-683d726b9843 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:11:06.945901 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1449/2898] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 18:11:06 2022] PUT /identity/v3/projects/3adb5e224dfd4c7b85f78dfe215536ce/users/e9f674d32b0d438f861265b488b9255a/roles/4651a1cc7b4d4ab7a7a9ca1e77e58e71 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:11:06.955920 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ae0c6e-f34f-4cbe-a33c-8c061a123272 None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:11:06.956275 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ae0c6e-f34f-4cbe-a33c-8c061a123272 None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:11:06.956557 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ae0c6e-f34f-4cbe-a33c-8c061a123272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:11:06.982548 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-89ae0c6e-f34f-4cbe-a33c-8c061a123272 None None] MFA Rules not processed for user `e9f674d32b0d438f861265b488b9255a`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:11:06.983753 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-89ae0c6e-f34f-4cbe-a33c-8c061a123272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:11:07.042013 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:11:07.053598 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1450/2899] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 18:11:06 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:11:07.064928 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55185df8-44da-4acc-b044-683d726b9843 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:11:07.066653 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-55185df8-44da-4acc-b044-683d726b9843 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:11:07.121998 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55185df8-44da-4acc-b044-683d726b9843 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:11:07.125635 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b5668c-e91f-469a-ae63-67627141f1d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de55cae1600841889668e36402861203', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:11:07.126282 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b5668c-e91f-469a-ae63-67627141f1d2 service cinder] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:11:07.126561 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b5668c-e91f-469a-ae63-67627141f1d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:11:07.126835 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b5668c-e91f-469a-ae63-67627141f1d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:11:07.183239 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b5668c-e91f-469a-ae63-67627141f1d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:11:07.184674 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b5668c-e91f-469a-ae63-67627141f1d2 service cinder] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:11:07.194008 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1450/2900] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 18:11:07 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:11:08.867163 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ae0c6e-f34f-4cbe-a33c-8c061a123272 None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:11:08.868714 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-89ae0c6e-f34f-4cbe-a33c-8c061a123272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:11:08.880911 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ae0c6e-f34f-4cbe-a33c-8c061a123272 None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:11:08.884649 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60551d8-70e3-4299-a387-beb6895543a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de55cae1600841889668e36402861203', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:11:08.885353 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60551d8-70e3-4299-a387-beb6895543a3 service cinder] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:11:08.885675 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60551d8-70e3-4299-a387-beb6895543a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:11:08.885956 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60551d8-70e3-4299-a387-beb6895543a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:11:08.943432 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60551d8-70e3-4299-a387-beb6895543a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:11:08.944864 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60551d8-70e3-4299-a387-beb6895543a3 service cinder] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:11:08.954430 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1451/2901] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 18:11:08 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:11:09.467299 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b5668c-e91f-469a-ae63-67627141f1d2 service cinder] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:11:09.476215 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b5668c-e91f-469a-ae63-67627141f1d2 service cinder] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:11:09.479816 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c981518-8a85-4d6b-8987-2e3b806afc7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de55cae1600841889668e36402861203', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:11:09.480453 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c981518-8a85-4d6b-8987-2e3b806afc7e service cinder] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:11:09.480738 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c981518-8a85-4d6b-8987-2e3b806afc7e service cinder] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:11:09.481015 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c981518-8a85-4d6b-8987-2e3b806afc7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:11:09.488334 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:11:09.490698 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c981518-8a85-4d6b-8987-2e3b806afc7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:11:09.492600 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c981518-8a85-4d6b-8987-2e3b806afc7e service cinder] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:11:09.503246 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1451/2902] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 18:11:09 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:11:13.339007 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60551d8-70e3-4299-a387-beb6895543a3 service cinder] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:11:13.400898 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60551d8-70e3-4299-a387-beb6895543a3 service cinder] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:11:13.405502 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1d108e-de65-4767-aaa6-201c3d2411c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:11:13.406489 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d108e-de65-4767-aaa6-201c3d2411c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:11:13.407274 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d108e-de65-4767-aaa6-201c3d2411c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:11:13.407548 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d108e-de65-4767-aaa6-201c3d2411c3 admin admin] PATH_INFO: `/v3/users/77443cebfbc8434e9c9d26cd4eb7fea4` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:11:13.408735 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1d108e-de65-4767-aaa6-201c3d2411c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77443cebfbc8434e9c9d26cd4eb7fea4)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:11:13.410678 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1d108e-de65-4767-aaa6-201c3d2411c3 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:11:13.461718 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-1e1d108e-de65-4767-aaa6-201c3d2411c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77443cebfbc8434e9c9d26cd4eb7fea4'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:11:13.468255 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-1e1d108e-de65-4767-aaa6-201c3d2411c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77443cebfbc8434e9c9d26cd4eb7fea4'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:11:13.476080 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-1e1d108e-de65-4767-aaa6-201c3d2411c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77443cebfbc8434e9c9d26cd4eb7fea4'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:11:13.476762 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-1e1d108e-de65-4767-aaa6-201c3d2411c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77443cebfbc8434e9c9d26cd4eb7fea4'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:11:13.488471 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-1e1d108e-de65-4767-aaa6-201c3d2411c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77443cebfbc8434e9c9d26cd4eb7fea4'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:11:13.494306 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1452/2903] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 14 18:11:13 2022] DELETE /identity/v3/users/77443cebfbc8434e9c9d26cd4eb7fea4 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:11:13.498779 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33569bc3-43b7-463d-8b20-79a041df579e None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:11:13.499261 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33569bc3-43b7-463d-8b20-79a041df579e None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:11:13.499371 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33569bc3-43b7-463d-8b20-79a041df579e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:11:13.516317 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-33569bc3-43b7-463d-8b20-79a041df579e None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:11:13.517507 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-33569bc3-43b7-463d-8b20-79a041df579e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:11:13.576050 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1452/2904] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 18:11:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:11:13.586212 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1d108e-de65-4767-aaa6-201c3d2411c3 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:11:13.587626 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-1e1d108e-de65-4767-aaa6-201c3d2411c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:11:13.601500 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:11:13.647961 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1d108e-de65-4767-aaa6-201c3d2411c3 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:11:13.651592 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d10348c-1cde-4a2d-9d3b-6ddd6ba7d4e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:11:13.652207 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d10348c-1cde-4a2d-9d3b-6ddd6ba7d4e8 service neutron] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:11:13.652484 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d10348c-1cde-4a2d-9d3b-6ddd6ba7d4e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:11:13.652756 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d10348c-1cde-4a2d-9d3b-6ddd6ba7d4e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:11:13.661632 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d10348c-1cde-4a2d-9d3b-6ddd6ba7d4e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:11:13.663038 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d10348c-1cde-4a2d-9d3b-6ddd6ba7d4e8 service neutron] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:11:13.672237 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1453/2905] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 18:11:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:11:13.943656 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33569bc3-43b7-463d-8b20-79a041df579e None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:11:13.946977 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-33569bc3-43b7-463d-8b20-79a041df579e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:11:13.960370 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33569bc3-43b7-463d-8b20-79a041df579e None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:11:13.965517 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f091e2-3a84-40e1-bcb9-32c6f69bd0bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:11:13.966562 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f091e2-3a84-40e1-bcb9-32c6f69bd0bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:11:13.966725 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f091e2-3a84-40e1-bcb9-32c6f69bd0bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:11:13.967001 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f091e2-3a84-40e1-bcb9-32c6f69bd0bb admin admin] PATH_INFO: `/v3/projects/c1d1985de00949db8b2fe1b1cffa4afb` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:11:13.968243 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f091e2-3a84-40e1-bcb9-32c6f69bd0bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1d1985de00949db8b2fe1b1cffa4afb)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:11:13.970669 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f091e2-3a84-40e1-bcb9-32c6f69bd0bb admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:11:14.032208 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-08f091e2-3a84-40e1-bcb9-32c6f69bd0bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1d1985de00949db8b2fe1b1cffa4afb', 'request_id': 'req-08f091e2-3a84-40e1-bcb9-32c6f69bd0bb'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:11:14.038527 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-08f091e2-3a84-40e1-bcb9-32c6f69bd0bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1d1985de00949db8b2fe1b1cffa4afb', 'request_id': 'req-08f091e2-3a84-40e1-bcb9-32c6f69bd0bb'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:11:14.044208 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-08f091e2-3a84-40e1-bcb9-32c6f69bd0bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1d1985de00949db8b2fe1b1cffa4afb', 'request_id': 'req-08f091e2-3a84-40e1-bcb9-32c6f69bd0bb'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:11:14.058012 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-08f091e2-3a84-40e1-bcb9-32c6f69bd0bb admin admin] The token cache is being invalidate because project c1d1985de00949db8b2fe1b1cffa4afb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86773) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 18:11:14.058303 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-08f091e2-3a84-40e1-bcb9-32c6f69bd0bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:11:14.058934 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-08f091e2-3a84-40e1-bcb9-32c6f69bd0bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:11:14.060469 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1453/2906] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 14 18:11:13 2022] DELETE /identity/v3/projects/c1d1985de00949db8b2fe1b1cffa4afb => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:11:14.065312 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d10348c-1cde-4a2d-9d3b-6ddd6ba7d4e8 service neutron] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:11:14.075301 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d10348c-1cde-4a2d-9d3b-6ddd6ba7d4e8 service neutron] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:11:14.135238 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c78e10e-5348-4c15-bab9-f0eb3450c14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:11:14.136112 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c78e10e-5348-4c15-bab9-f0eb3450c14f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:11:14.136435 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c78e10e-5348-4c15-bab9-f0eb3450c14f admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:11:14.136712 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c78e10e-5348-4c15-bab9-f0eb3450c14f admin admin] PATH_INFO: `/v3/users/da35a313f5fc483d8426d0e641abef80` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:11:14.137954 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c78e10e-5348-4c15-bab9-f0eb3450c14f admin admin] RBAC: Authorizing `identity:delete_user(user_id=da35a313f5fc483d8426d0e641abef80)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:11:14.139860 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c78e10e-5348-4c15-bab9-f0eb3450c14f admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:11:14.192905 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-1c78e10e-5348-4c15-bab9-f0eb3450c14f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da35a313f5fc483d8426d0e641abef80'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:11:14.201216 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-1c78e10e-5348-4c15-bab9-f0eb3450c14f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da35a313f5fc483d8426d0e641abef80'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:11:14.209319 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-1c78e10e-5348-4c15-bab9-f0eb3450c14f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da35a313f5fc483d8426d0e641abef80'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:11:14.210122 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-1c78e10e-5348-4c15-bab9-f0eb3450c14f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da35a313f5fc483d8426d0e641abef80'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:11:14.224413 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-1c78e10e-5348-4c15-bab9-f0eb3450c14f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da35a313f5fc483d8426d0e641abef80'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:11:14.231306 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1454/2907] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 14 18:11:14 2022] DELETE /identity/v3/users/da35a313f5fc483d8426d0e641abef80 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:11:14.504939 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f091e2-3a84-40e1-bcb9-32c6f69bd0bb admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:11:14.506428 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-08f091e2-3a84-40e1-bcb9-32c6f69bd0bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:11:14.520633 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f091e2-3a84-40e1-bcb9-32c6f69bd0bb admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:11:14.576573 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b2546e-0662-4eab-b261-046604bfca2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:11:14.577436 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b2546e-0662-4eab-b261-046604bfca2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:11:14.577750 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b2546e-0662-4eab-b261-046604bfca2d admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:11:14.578266 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b2546e-0662-4eab-b261-046604bfca2d admin admin] PATH_INFO: `/v3/projects/48263da6c1d849838c5b8812870613c9` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:11:14.579265 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b2546e-0662-4eab-b261-046604bfca2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=48263da6c1d849838c5b8812870613c9)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:11:14.581166 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b2546e-0662-4eab-b261-046604bfca2d admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:11:14.604394 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:11:14.628300 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-08b2546e-0662-4eab-b261-046604bfca2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48263da6c1d849838c5b8812870613c9', 'request_id': 'req-08b2546e-0662-4eab-b261-046604bfca2d'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:11:14.634270 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-08b2546e-0662-4eab-b261-046604bfca2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48263da6c1d849838c5b8812870613c9', 'request_id': 'req-08b2546e-0662-4eab-b261-046604bfca2d'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:11:14.639834 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-08b2546e-0662-4eab-b261-046604bfca2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48263da6c1d849838c5b8812870613c9', 'request_id': 'req-08b2546e-0662-4eab-b261-046604bfca2d'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:11:14.651599 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-08b2546e-0662-4eab-b261-046604bfca2d admin admin] The token cache is being invalidate because project 48263da6c1d849838c5b8812870613c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86773) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 18:11:14.651888 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-08b2546e-0662-4eab-b261-046604bfca2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:11:14.652510 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-08b2546e-0662-4eab-b261-046604bfca2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:11:14.654106 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1454/2908] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 14 18:11:14 2022] DELETE /identity/v3/projects/48263da6c1d849838c5b8812870613c9 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:11:14.658606 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c78e10e-5348-4c15-bab9-f0eb3450c14f admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:11:14.660035 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-1c78e10e-5348-4c15-bab9-f0eb3450c14f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:11:14.673357 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c78e10e-5348-4c15-bab9-f0eb3450c14f admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:11:14.702382 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:11:14.730718 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7232f6e8-c678-4a3a-806a-1ffda24797cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:11:14.731696 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7232f6e8-c678-4a3a-806a-1ffda24797cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:11:14.732046 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7232f6e8-c678-4a3a-806a-1ffda24797cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:11:14.732368 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7232f6e8-c678-4a3a-806a-1ffda24797cb admin admin] PATH_INFO: `/v3/users/e9f674d32b0d438f861265b488b9255a` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:11:14.733571 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7232f6e8-c678-4a3a-806a-1ffda24797cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9f674d32b0d438f861265b488b9255a)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:11:14.735575 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7232f6e8-c678-4a3a-806a-1ffda24797cb admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:11:14.786145 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-7232f6e8-c678-4a3a-806a-1ffda24797cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9f674d32b0d438f861265b488b9255a'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:11:14.793621 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-7232f6e8-c678-4a3a-806a-1ffda24797cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9f674d32b0d438f861265b488b9255a'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:11:14.800648 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-7232f6e8-c678-4a3a-806a-1ffda24797cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9f674d32b0d438f861265b488b9255a'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:11:14.801302 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-7232f6e8-c678-4a3a-806a-1ffda24797cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9f674d32b0d438f861265b488b9255a'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:11:14.813695 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-7232f6e8-c678-4a3a-806a-1ffda24797cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9f674d32b0d438f861265b488b9255a'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:11:14.820523 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1455/2909] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 14 18:11:14 2022] DELETE /identity/v3/users/e9f674d32b0d438f861265b488b9255a => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:11:15.097447 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b2546e-0662-4eab-b261-046604bfca2d admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:11:15.098897 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-08b2546e-0662-4eab-b261-046604bfca2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:11:15.114718 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b2546e-0662-4eab-b261-046604bfca2d admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:11:15.171351 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4bf00b-8307-4eb6-b09f-355ccf722baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:11:15.172762 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4bf00b-8307-4eb6-b09f-355ccf722baa admin admin] REQUEST_METHOD: `DELETE` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:11:15.173040 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4bf00b-8307-4eb6-b09f-355ccf722baa admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:11:15.173310 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4bf00b-8307-4eb6-b09f-355ccf722baa admin admin] PATH_INFO: `/v3/projects/3adb5e224dfd4c7b85f78dfe215536ce` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:11:15.174513 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4bf00b-8307-4eb6-b09f-355ccf722baa admin admin] RBAC: Authorizing `identity:delete_project(project_id=3adb5e224dfd4c7b85f78dfe215536ce)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:11:15.176490 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4bf00b-8307-4eb6-b09f-355ccf722baa admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:11:15.221163 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-9c4bf00b-8307-4eb6-b09f-355ccf722baa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3adb5e224dfd4c7b85f78dfe215536ce', 'request_id': 'req-9c4bf00b-8307-4eb6-b09f-355ccf722baa'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:11:15.227123 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-9c4bf00b-8307-4eb6-b09f-355ccf722baa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3adb5e224dfd4c7b85f78dfe215536ce', 'request_id': 'req-9c4bf00b-8307-4eb6-b09f-355ccf722baa'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:11:15.232818 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-9c4bf00b-8307-4eb6-b09f-355ccf722baa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3adb5e224dfd4c7b85f78dfe215536ce', 'request_id': 'req-9c4bf00b-8307-4eb6-b09f-355ccf722baa'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:11:15.245709 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-9c4bf00b-8307-4eb6-b09f-355ccf722baa admin admin] The token cache is being invalidate because project 3adb5e224dfd4c7b85f78dfe215536ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86773) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 18:11:15.246000 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-9c4bf00b-8307-4eb6-b09f-355ccf722baa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:11:15.246629 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-9c4bf00b-8307-4eb6-b09f-355ccf722baa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:11:15.248196 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1455/2910] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 14 18:11:15 2022] DELETE /identity/v3/projects/3adb5e224dfd4c7b85f78dfe215536ce => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:11:15.253110 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f67a9-178a-4d8b-902d-0e98484f58af None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:11:15.253398 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f67a9-178a-4d8b-902d-0e98484f58af None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:11:15.253710 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f67a9-178a-4d8b-902d-0e98484f58af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:11:15.271507 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-189f67a9-178a-4d8b-902d-0e98484f58af None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:11:15.272694 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-189f67a9-178a-4d8b-902d-0e98484f58af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:11:15.346875 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1456/2911] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 18:11:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:11:15.354664 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e852faf7-e6a5-4efc-8153-042cb57ef393 None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:11:15.354961 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e852faf7-e6a5-4efc-8153-042cb57ef393 None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:11:15.355239 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e852faf7-e6a5-4efc-8153-042cb57ef393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:11:15.375616 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-e852faf7-e6a5-4efc-8153-042cb57ef393 None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:11:15.376822 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-e852faf7-e6a5-4efc-8153-042cb57ef393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:11:15.385135 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1456/2912] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 18:11:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 18:11:15.389363 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189f67a9-178a-4d8b-902d-0e98484f58af None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:11:15.399089 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189f67a9-178a-4d8b-902d-0e98484f58af None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:11:15.403624 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4d16e7-e5ea-4952-9ce8-d2901da28539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:11:15.404274 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4d16e7-e5ea-4952-9ce8-d2901da28539 admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:11:15.404553 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4d16e7-e5ea-4952-9ce8-d2901da28539 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:11:15.404828 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4d16e7-e5ea-4952-9ce8-d2901da28539 admin admin] PATH_INFO: `/v3/domains` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:11:15.405587 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4d16e7-e5ea-4952-9ce8-d2901da28539 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86772) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 18:11:15.405897 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4d16e7-e5ea-4952-9ce8-d2901da28539 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:11:15.407987 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4d16e7-e5ea-4952-9ce8-d2901da28539 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:11:15.419520 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1457/2913] 10.222.0.67 () {58 vars in 1152 bytes} [Thu Jul 14 18:11:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 18:11:15.424446 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e852faf7-e6a5-4efc-8153-042cb57ef393 None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:11:15.433806 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e852faf7-e6a5-4efc-8153-042cb57ef393 None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:11:15.438731 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7652e502-035a-4f79-b265-b3f66ca93095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:11:15.439390 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7652e502-035a-4f79-b265-b3f66ca93095 admin admin] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:11:15.439673 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7652e502-035a-4f79-b265-b3f66ca93095 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:11:15.439948 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7652e502-035a-4f79-b265-b3f66ca93095 admin admin] PATH_INFO: `/v3/projects` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:11:15.440646 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7652e502-035a-4f79-b265-b3f66ca93095 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:11:15.442605 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7652e502-035a-4f79-b265-b3f66ca93095 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:11:15.474834 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1457/2914] 10.222.0.67 () {60 vars in 1152 bytes} [Thu Jul 14 18:11:15 2022] POST /identity/v3/projects => generated 399 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 18:11:15.479006 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4d16e7-e5ea-4952-9ce8-d2901da28539 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:11:15.489043 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4d16e7-e5ea-4952-9ce8-d2901da28539 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:11:15.525691 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:11:15.545912 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd689a68-0e40-4207-8f2c-837d370334e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:11:15.546579 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd689a68-0e40-4207-8f2c-837d370334e5 admin admin] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:11:15.546860 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd689a68-0e40-4207-8f2c-837d370334e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:11:15.547135 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd689a68-0e40-4207-8f2c-837d370334e5 admin admin] PATH_INFO: `/v3/users` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:11:15.547846 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd689a68-0e40-4207-8f2c-837d370334e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:11:15.549856 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd689a68-0e40-4207-8f2c-837d370334e5 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:11:15.568681 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1458/2915] 10.222.0.67 () {60 vars in 1143 bytes} [Thu Jul 14 18:11:15 2022] POST /identity/v3/users => generated 300 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 18:11:15.572816 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7652e502-035a-4f79-b265-b3f66ca93095 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:11:15.583845 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7652e502-035a-4f79-b265-b3f66ca93095 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:11:15.588435 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8a923d-aa53-496b-9fd0-8b1d1600d82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:11:15.589099 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a923d-aa53-496b-9fd0-8b1d1600d82c admin admin] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:11:15.589383 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a923d-aa53-496b-9fd0-8b1d1600d82c admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:11:15.589703 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a923d-aa53-496b-9fd0-8b1d1600d82c admin admin] PATH_INFO: `/v3/roles` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:11:15.590435 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8a923d-aa53-496b-9fd0-8b1d1600d82c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:11:15.592022 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8a923d-aa53-496b-9fd0-8b1d1600d82c admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:11:15.597861 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:11:15.604074 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1458/2916] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 18:11:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 18:11:15.607801 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd689a68-0e40-4207-8f2c-837d370334e5 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:11:15.617884 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd689a68-0e40-4207-8f2c-837d370334e5 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:11:15.622473 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd213618-f766-41e4-9362-3f3ca3793ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:11:15.623142 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd213618-f766-41e4-9362-3f3ca3793ea3 admin admin] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:11:15.623414 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd213618-f766-41e4-9362-3f3ca3793ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:11:15.623688 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd213618-f766-41e4-9362-3f3ca3793ea3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:11:15.624415 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd213618-f766-41e4-9362-3f3ca3793ea3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:11:15.626534 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd213618-f766-41e4-9362-3f3ca3793ea3 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:11:15.636393 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1459/2917] 10.222.0.67 () {58 vars in 1121 bytes} [Thu Jul 14 18:11:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 18:11:15.641241 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8a923d-aa53-496b-9fd0-8b1d1600d82c admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:11:15.651220 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8a923d-aa53-496b-9fd0-8b1d1600d82c admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:11:15.655812 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13339ee3-edf0-4b7f-98b6-d47519958d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:11:15.657334 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13339ee3-edf0-4b7f-98b6-d47519958d01 admin admin] REQUEST_METHOD: `PUT` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:11:15.657659 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13339ee3-edf0-4b7f-98b6-d47519958d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:11:15.657939 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13339ee3-edf0-4b7f-98b6-d47519958d01 admin admin] PATH_INFO: `/v3/projects/785c4e05cfdd417b9a72d37ad5fed6ec/users/9e892102ce6b4c7987ce9846e219d478/roles/95d753870f97426cb1ce32e078621a4c` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:11:15.672285 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13339ee3-edf0-4b7f-98b6-d47519958d01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=785c4e05cfdd417b9a72d37ad5fed6ec, user_id=9e892102ce6b4c7987ce9846e219d478, role_id=95d753870f97426cb1ce32e078621a4c)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:11:15.674979 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13339ee3-edf0-4b7f-98b6-d47519958d01 admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:11:15.687600 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1459/2918] 10.222.0.67 () {60 vars in 1482 bytes} [Thu Jul 14 18:11:15 2022] PUT /identity/v3/projects/785c4e05cfdd417b9a72d37ad5fed6ec/users/9e892102ce6b4c7987ce9846e219d478/roles/95d753870f97426cb1ce32e078621a4c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:11:15.697774 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab1b9f-d818-4997-952b-4895c98a88fc None None] REQUEST_METHOD: `POST` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:11:15.698237 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab1b9f-d818-4997-952b-4895c98a88fc None None] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:11:15.698336 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab1b9f-d818-4997-952b-4895c98a88fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:11:15.725126 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.auth.core [None req-8cab1b9f-d818-4997-952b-4895c98a88fc None None] MFA Rules not processed for user `9e892102ce6b4c7987ce9846e219d478`. Rule list: `[]` (Enabled: `True`). {{(pid=86772) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:11:15.726411 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-8cab1b9f-d818-4997-952b-4895c98a88fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:11:15.789392 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1460/2919] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 18:11:15 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:11:15.800517 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13339ee3-edf0-4b7f-98b6-d47519958d01 admin admin] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:11:15.802225 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-13339ee3-edf0-4b7f-98b6-d47519958d01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:11:15.859755 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13339ee3-edf0-4b7f-98b6-d47519958d01 admin admin] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:11:15.863396 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d507654-8687-4b30-8bcb-d816631d4814 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de55cae1600841889668e36402861203', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:11:15.864038 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d507654-8687-4b30-8bcb-d816631d4814 service cinder] REQUEST_METHOD: `GET` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:11:15.864317 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d507654-8687-4b30-8bcb-d816631d4814 service cinder] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:11:15.864591 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d507654-8687-4b30-8bcb-d816631d4814 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:11:15.873232 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d507654-8687-4b30-8bcb-d816631d4814 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:11:15.874689 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d507654-8687-4b30-8bcb-d816631d4814 service cinder] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:11:15.884059 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1460/2920] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 18:11:15 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:11:20.831310 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cab1b9f-d818-4997-952b-4895c98a88fc None None] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:11:20.916831 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cab1b9f-d818-4997-952b-4895c98a88fc None None] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:11:20.922404 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd8a5b5-08f8-4377-b0d4-c408ed941e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:11:20.923285 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd8a5b5-08f8-4377-b0d4-c408ed941e54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:11:20.923568 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd8a5b5-08f8-4377-b0d4-c408ed941e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:11:20.923875 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd8a5b5-08f8-4377-b0d4-c408ed941e54 admin admin] PATH_INFO: `/v3/users/9e892102ce6b4c7987ce9846e219d478` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:11:20.925092 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd8a5b5-08f8-4377-b0d4-c408ed941e54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e892102ce6b4c7987ce9846e219d478)` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:11:20.927026 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd8a5b5-08f8-4377-b0d4-c408ed941e54 admin admin] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:11:20.969600 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:11:20.986766 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-0fd8a5b5-08f8-4377-b0d4-c408ed941e54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e892102ce6b4c7987ce9846e219d478'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:11:20.994654 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-0fd8a5b5-08f8-4377-b0d4-c408ed941e54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e892102ce6b4c7987ce9846e219d478'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:11:21.002820 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-0fd8a5b5-08f8-4377-b0d4-c408ed941e54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e892102ce6b4c7987ce9846e219d478'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:11:21.003488 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-0fd8a5b5-08f8-4377-b0d4-c408ed941e54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e892102ce6b4c7987ce9846e219d478'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:11:21.015514 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.notifications [None req-0fd8a5b5-08f8-4377-b0d4-c408ed941e54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e892102ce6b4c7987ce9846e219d478'} {{(pid=86772) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:11:21.021433 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1461/2921] 10.222.0.67 () {58 vars in 1223 bytes} [Thu Jul 14 18:11:20 2022] DELETE /identity/v3/users/9e892102ce6b4c7987ce9846e219d478 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:11:21.026213 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0924af3c-4062-4120-8eb2-a900803a35ca None None] REQUEST_METHOD: `POST` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:11:21.026726 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0924af3c-4062-4120-8eb2-a900803a35ca None None] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:11:21.026848 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0924af3c-4062-4120-8eb2-a900803a35ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:11:21.043462 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.auth.core [None req-0924af3c-4062-4120-8eb2-a900803a35ca None None] MFA Rules not processed for user `7ce563cc32c246e59d48c2a6266075e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86773) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 18:11:21.044671 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-0924af3c-4062-4120-8eb2-a900803a35ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:11:21.104950 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1461/2922] 10.222.0.67 () {58 vars in 957 bytes} [Thu Jul 14 18:11:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 18:11:21.115205 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd8a5b5-08f8-4377-b0d4-c408ed941e54 admin admin] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:11:21.116645 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-0fd8a5b5-08f8-4377-b0d4-c408ed941e54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:11:21.174037 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd8a5b5-08f8-4377-b0d4-c408ed941e54 admin admin] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:11:21.177691 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f87833-9cd5-41ee-b2f5-2d5e41be271a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bda83c5499f43f9838fda2679a522d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:11:21.178344 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f87833-9cd5-41ee-b2f5-2d5e41be271a service neutron] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:11:21.178622 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f87833-9cd5-41ee-b2f5-2d5e41be271a service neutron] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:11:21.178899 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f87833-9cd5-41ee-b2f5-2d5e41be271a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:11:21.188346 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f87833-9cd5-41ee-b2f5-2d5e41be271a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:11:21.189801 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f87833-9cd5-41ee-b2f5-2d5e41be271a service neutron] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:11:21.199202 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1462/2923] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 18:11:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:11:21.469717 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0924af3c-4062-4120-8eb2-a900803a35ca None None] Authenticating user token {{(pid=86773) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:11:21.471918 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.fernet_utils [None req-0924af3c-4062-4120-8eb2-a900803a35ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86773) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:11:21.493785 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0924af3c-4062-4120-8eb2-a900803a35ca None None] Validating token access rules against request {{(pid=86773) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:11:21.501934 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efdfae1-f206-4666-b881-3c8b6936895f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce563cc32c246e59d48c2a6266075e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbe4032be1b14bfe82df97ec9e98e7c0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86773) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:11:21.503121 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efdfae1-f206-4666-b881-3c8b6936895f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:11:21.503450 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efdfae1-f206-4666-b881-3c8b6936895f admin admin] SCRIPT_NAME: `/identity` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:11:21.503807 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efdfae1-f206-4666-b881-3c8b6936895f admin admin] PATH_INFO: `/v3/projects/785c4e05cfdd417b9a72d37ad5fed6ec` {{(pid=86773) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:11:21.505289 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efdfae1-f206-4666-b881-3c8b6936895f admin admin] RBAC: Authorizing `identity:delete_project(project_id=785c4e05cfdd417b9a72d37ad5fed6ec)` {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:11:21.508234 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efdfae1-f206-4666-b881-3c8b6936895f admin admin] RBAC: Authorization granted {{(pid=86773) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:11:21.557325 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-6efdfae1-f206-4666-b881-3c8b6936895f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '785c4e05cfdd417b9a72d37ad5fed6ec', 'request_id': 'req-6efdfae1-f206-4666-b881-3c8b6936895f'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:11:21.563788 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-6efdfae1-f206-4666-b881-3c8b6936895f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '785c4e05cfdd417b9a72d37ad5fed6ec', 'request_id': 'req-6efdfae1-f206-4666-b881-3c8b6936895f'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:11:21.569402 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-6efdfae1-f206-4666-b881-3c8b6936895f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '785c4e05cfdd417b9a72d37ad5fed6ec', 'request_id': 'req-6efdfae1-f206-4666-b881-3c8b6936895f'} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:11:21.583034 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-6efdfae1-f206-4666-b881-3c8b6936895f admin admin] The token cache is being invalidate because project 785c4e05cfdd417b9a72d37ad5fed6ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86773) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 18:11:21.583431 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-6efdfae1-f206-4666-b881-3c8b6936895f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:11:21.584051 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG keystone.notifications [None req-6efdfae1-f206-4666-b881-3c8b6936895f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86773) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 18:11:21.585640 dv-cinder-849890-1-smb devstack@keystone.service[86773]: [pid: 86773|app: 0|req: 1462/2924] 10.222.0.67 () {58 vars in 1232 bytes} [Thu Jul 14 18:11:21 2022] DELETE /identity/v3/projects/785c4e05cfdd417b9a72d37ad5fed6ec => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 18:11:31.195000 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=44,keystone:DELETE=5,keystone:INSERT=1 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:11:31.579787 dv-cinder-849890-1-smb devstack@keystone.service[86773]: DEBUG dbcounter [-] [86773] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=7 {{(pid=86773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 18:14:14.745457 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f87833-9cd5-41ee-b2f5-2d5e41be271a service neutron] Authenticating user token {{(pid=86772) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 18:14:14.746874 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-c5f87833-9cd5-41ee-b2f5-2d5e41be271a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:14:14.853283 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f87833-9cd5-41ee-b2f5-2d5e41be271a service neutron] Validating token access rules against request {{(pid=86772) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 18:14:14.913107 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f9b745-0650-46f5-8797-813d68e15069 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5324ab45f4a4449980dad920278f5034', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39a570421bb64fac8b1a0129f1bcc7d9', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86772) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 18:14:14.913789 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9b745-0650-46f5-8797-813d68e15069 service placement] REQUEST_METHOD: `GET` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 18:14:14.914079 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9b745-0650-46f5-8797-813d68e15069 service placement] SCRIPT_NAME: `/identity` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 18:14:14.914359 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9b745-0650-46f5-8797-813d68e15069 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86772) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 18:14:14.916232 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.fernet_utils [None req-90f9b745-0650-46f5-8797-813d68e15069 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86772) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 18:14:14.927386 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f9b745-0650-46f5-8797-813d68e15069 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 18:14:14.929447 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f9b745-0650-46f5-8797-813d68e15069 service placement] RBAC: Authorization granted {{(pid=86772) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 18:14:14.939765 dv-cinder-849890-1-smb devstack@keystone.service[86772]: [pid: 86772|app: 0|req: 1463/2925] 10.222.0.67 () {60 vars in 1365 bytes} [Thu Jul 14 18:14:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 18:14:24.935258 dv-cinder-849890-1-smb devstack@keystone.service[86772]: DEBUG dbcounter [-] [86772] Writing DB stats keystone:SELECT=76 {{(pid=86772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}